
Data Engineer
- Brisbane, QLD
- Permanent
- Full-time
- Collaborate with a cross-functional team to design, build, and maintain efficient, reusable, and reliable data pipeline
- Recommend and implement ways to improve data reliability, efficiency, and quality through creating and maintaining optimal data pipeline architecture
- Assemble large, complex data sets that meet functional and technical business requirements
- Develop and fine-tune data processing workflows utilizing big data technologies and frameworks
- Build and execute complex SQL queries for database operations and data manipulation
- Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability and data discovery and onboarding, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using 'big data' technologies
- Work with JBS and partner stakeholders including project managers, business analysts, data scientists and developers to assist with data-related technical issues and support their data infrastructure needs
- A bachelor's degree in computer science, engineering, Information Technology or a related field or equivalent practical experience
- 3+ years' experience SQL, CI/CD pipelines, data integration and data delivery
- 3+ years' experience data engineering & ETL
- 3+ years data modelling and design
- 1-2 Years' Snowflake experience desired
- Qlik Replicate experience desired
- Qlik Talend/QDI
- End-to-end Software development lifecycle expertise (requirements, design, architecture, development, testing, deployment, release and support)
- Snowflake
- MS SQL Server and Management Studio
- Pentaho PDI
- MS Azure DevOps
- Languages: Python, SQL, JavaScript
- Access to novated leasing options
- Heavily discounted meat products
- Retail discounts with national partners
- Health insurance discounts on Bupa Health and Medibank Private
- Ongoing training and career development opportunities