Multiple Data Engineer

Scrumtech Digital

  • Canberra, ACT
  • Permanent
  • Full-time
  • 22 days ago
  • Apply easily
Job detailsThe Department of Agriculture, Fisheries and Forestry (DAFF) is looking for Data Engineers to join its Enterprise Analytics section to work across several data and analytics platforms. We are seeking candidates with strong experience in developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes, and /or the development of data products and complex data visualisations.The role will be responsible for design, development and unit testing activities across several data movement, data transformation, and data visualisation processes within DAFF. The data movement and transformation processes focus on the preparation of data for use in decision making processes across the department, utilising modern cloud technology (Azure) to enable operational analytics use cases.To be successful in the role, you must have a strong work ethic including taking ownership, providing leadership, having a high level of productivity, and working with a multi-disciplinary team in an Agile development environment. You must have suitable qualifications or training in data engineering techniques and at least 5 years’ experience working as a data engineer.Candidates must hold a valid Baseline security clearance or be willing and eligible to obtain one. Commencement within the section is contingent on the candidate obtaining a Baseline clearance. Please provide your CSID on your resumé/CV (if known).RequirementsKey duties and responsibilitiesResponsibilities include, but not limited to:
  • Designing, building and testing various Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes on the department’s Azure data and analytics platform.
  • Designing, building and testing data storage solutions to meet current and emerging needs.
  • Utilising expert level knowledge of best practices to uplift capability maturity and governance practices.
  • Be responsive, flexible, and work collaboratively as part of an agile team.
  • Creating and maintaining frameworks and strategies.
  • Sharing outcomes, knowledge and experience with other data engineers in the section.
  • Acting as technical escalation point.
  • Providing technical support in the development of deliverables.
  • Assisting project teams achieve objectives that align with departmental, divisional, and sectional priorities.
  • Strong relationship building, communication and negotiation skills.
  • Strong written and oral communication skills.
  • Training and mentoring junior data engineers through regular quality reviews and constructive feedback on industry best practices.
Technical skillsMS Azure Stack o Data Integration - Data Factory, SQL Server Integration Services and/or Databricks o Data Store - SQL Server and/or Data Lake Storage o Analytics - Azure Databricks, Azure Machine Learning, ArcGIS Enterprise • Development tools – DevOps, Visual Studio, VS Code • Data technology solutions – sourcing (Oracle, Ingres, Azure, SQL Server), collecting, ingesting and storing • Data Preparation o Transformation of data into formats tailored to analytics use cases – Parquet and/or Delta

Scrumtech Digital