
Data Engineer
- Australia
- Permanent
- Full-time
- Develop scalable & robust data solution, pipelines and processes in Databricks on complex data using SQL & Python
- Design, develop, test and implement data products to solve business problems
- Manage and optimise data assets for performance, scalability, reliability and cost efficiency.
- Identify, design, and implement internal process improvements, such as automating manual processes and optimising data delivery
- Collaborate with stakeholders to understand their data requirements and provide effective solutions
- Able to consult with squads and leadership on issues related to data technologies, data usage, project planning, prioritisation, and timeline estimates.
- Experienced in Cloud Data Warehouse services - Databricks (preferred), otherwise Snowflake, AWS Redshift or Azure. Experience working with Python, Unix and Git (or other distributed version control tools) is desirable.
- Experienced in implementing end-to-end ETL processes/pipelines with advanced SQL Cloud or classical data environments like Oracle, MSSQL, Teradata or Postgres.
- Strong experience in designing & developing complex relational and log data solutions.
- Knowledgeable in relational and big data solutions, data warehousing, data integration, data modelling, data optimisation and data analysis techniques.
- Experienced working on marketing data solutions (including campaign and CDPs), customer analytics, web analytics or implementing Power BI solutions is valued
- Ideally 2-4 year's experience working in a similar role
- Ability to effectively communicate with stakeholders across the business and work as part of a team is essential
- Enjoy working with a small team on solving complex problems and working on multiple priorities concurrently.
- Heavily discounted air travel for you and your loved ones (including $1000 worth of travel credits per year)
- Flexible working arrangements (including work hours and work from home)
- Discounts on travel insurance, car hire, accommodation and experiences worldwide
- Discounted Virgin Australia Lounge membership
- Hospitality, retail, technology, beauty services and wellness discounts
- Wellness support, including the Converge digital wellbeing platform
- A comprehensive Employee Assistance Program, which offers confidential coaching and support from qualified professionals for all aspects of life - physical, mental, social and financial
- Dress for Your Day - enjoy the freedom to wear whatever is appropriate for the type of work you do and the day you have ahead of you
- Flexible working arrangements and periodic work travel