Data Engineer

Brisbane, QLD
Contract
Full-time

1 month ago

Our QLD Government client is currently seeking a Data Engineer to join their organisation and contribute to achieving their 3-year Technology Roadmap. In this role you will build fit for purpose data assets as per their new data model, designed to achieve the organisation’s Data, BI, and Analytics requirements, within the Azure Databricks environment.As the Data Engineer you will play a critical role in developing robust datasets (Standardised / Silver and Consumer / Gold) according to requirements and ensure the availability of high-quality, structured, and scalable data models to enable effective decision-making and insights generation. A key focus of your role will be to work closely with data professionals and business stakeholders to translate business requirements into data assetsWhat you will do:

Reconfigure existing pipelines for intraday refreshes (currently overnight load)
Create new or refactor existing datasets as per data model around core business entities (Claims, Policies, Contacts, Documents, Payments, Assets/Exposures)
Technical documentation for all new datasets
Support implementation of data quality fixes
Support refactoring existing reporting

What you’ll bring to the role:

Demonstrated experience building data assets within medallion architecture (or equivalent: Raw, Standardised, Consumer layers)
Proficiency in SQL and Python in relational database management systems, with Type 2 Change Data Capture
Proficiency in cloud data warehousing concepts and technologies, including ETL/ ELT pipeline development and data integration (e.g. Databricks, Snowflake, Synapse, Redshift)
Experience conducting data lineage and impact analysis to ensure data integrity and traceability
Understanding of the principles of data governance
Experience within a data team in an insurance business or other highly regulated environment
Familiarity with management and operations within Databricks, Delta Lake, Azure Data Lake Storage, Azure Synapse
Familiarity with Appian (insurance software)
Experience in developing Power BI reports and semantic models
Experience in performance optimisation activities across queries, scripts, ETL/ELT pipelines and process workflows
University Degree in Data Analytics, Computer Science, or a related field

HOW TO APPLY:
Please submit your resume for consideration via the appropriate link. A cover letter demonstrating your relevant experience may also be reviewed.Should you wish to discuss, please contact Jemma Walker at Jemma.Walker@hudson.com quoting reference number: 245949. Your interest will be treated in the strictest of confidence.Diversity, Equity & Inclusion at Hudson
Hudson is committed to helping you find a workplace where you feel respected, supported, and free to thrive. We welcome applications from all backgrounds, identities, and lived experiences—because when different voices come together, amazing things happen.Casual Loading
Please note for all Australian based contract and temporary roles only, the pay rate is inclusive of mandatory 25% casual loading. This excludes permanent and fixed term roles.

Hudson

Apply Now