Data Engineer
Softtestpays
- Hobart, TAS
- Permanent
- Full-time
- Contract start 05 February 2024 to 6 months, 2 x 6 months extensions.
- Australian Citizen, baseline Clearance preferred, Canberra or offsite role.
- Harmonizing the data migration, data architecture design and analytics across different schemes needed to effectively manage resources and delivery operations.
- Collecting data in an unformed and consistent way.
- Decrease the data migration complexity with well-defined common entity designs across the projects.
- Defining a common set of semantics being managed and reflected in the data architecture.
- Hold workshops to determine common and specific data attribution for each scheme.
- Implement data pipelines across D365 into DataLake and Synapse Analysis
- Minimum 7 years experience as a data engineer within the data and analytics domain
- Strong project delivery toolset experience in data integration tools
- Experience with processing large volumes of complex data.
- Ability to assess complexity of data (volume, structure, relationship etc.)
- A strong understanding of data modelling, data structures, databases, and processes
- Implemented Azure DecOps CI/CD with custom parameters for build and release pipelines for Data Factory, Synapse, and data lake artifacts.
- Hands on technical expertise implementing and delivering data solutions and pipelines in Azure.
- Hands on technical expertise working with DataLake and Synapse Analytics
- Hands on technical expertise working with Dynamics 365 Dataverse and SQL data sources.
- Hands on technical expertise setting up DevOps automation using tools such as GitHub etc.
- Experience building data profiling, data cleansing and data engineering frameworks.
- Exceptional communication, documentation, and presentation skills
- Will require Australian Citizenship with a Baseline Security clearance as a minimum.