Senior Data Engineer

Sydney, NSW
Permanent
Full-time

21 days ago
Apply easily

Our client, a Federal Government agency is seeking a highly skilled Senior Data Engineer to join their team in New South Wales.As a Senior Data Engineer, you will play a pivotal role as a Full Stack Developer and Technical Lead, driving the development and support of critical financial intelligence systems including the AWB Palantir product.Key Responsibilities:

Lead and mentor a cross-functional development team, nurturing junior staff.
Collaborate closely with internal and external stakeholders to deliver quality solutions.
Develop high-quality pipeline and API code aligned with best practices and approved designs.
Coordinate technical releases weekly and manage cutover releases for clients.
Proactively manage and mitigate potential API outages affecting internal and external users.
Perform various development and support tasks aligned with team and business objectives.

Essential Skills and Experience:

Degree in Computer Science, Software Engineering or equivalent.
Proficient in Java and Scala programming, web containers (Tomcat, JBoss), and web servers (Apache, IIS).
Experience integrating with external systems using APIs, FTP, JSON, EDI, XML.
Strong knowledge of SQL and NoSQL databases.
Expertise with UNIX and Windows server environments.
Familiarity with technologies such as Spark, Postgres, Hadoop Distributed File System (HDFS), and Elastic Search.
Solid understanding of data modelling and data pipeline design.
Hands-on experience with technical application support and deployment, including identity and access management (IAM) products.
Comfortable working in Agile environments using tools like JIRA, supporting sprints and scrums.
Ability to obtain Negative Vetting Level 1 security clearance.

Desirable Skills:

Knowledge of cloud deployment and container orchestration tools such as Kubernetes and Docker.
Experience with commercial off-the-shelf (COTS) development environments.
Exposure to continuous integration/continuous delivery (CI/CD) and test-driven development (TDD) practices.
Familiarity with OpenText platform and Palantir software.
Strong time management skills to meet challenging deadlines.

Working Arrangements:This role is based in New South Wales with hybrid working arrangements requiring presence at the agency's premises at least two days per week.The position is offered on a full-time, 40 hours per week basis, initially contracted for 12 months with potential extensions.If you are a motivated and experienced software engineer seeking a role with significant national impact, offering leadership opportunities and cutting-edge technology, this is a unique chance to join a respected government agency, please apply now to Jin quoting JL648265Balance Recruitment is committed to equal opportunity employment. We celebrate diversity and encourage people from all sections of our community to apply for this role.

Balance Recruitment