Data Engineer | Generative AI
Deloitte
- Sydney, NSW Melbourne, VIC
- Permanent
- Full-time
- Training and development to build your skills and career - at Deloitte we believe in investing in our best assets, our people! You will have access to world class training and funding towards industry and other professional certifications
- Flexible work arrangements - work in a way that suits you best
- Rewards platform - your hard work won't go unnoticed at Deloitte
- UNIX/Linux, Docker, Kubernetes, OpenShift v3
- Ansible, Git
- Cloud technologies and platforms such as Amazon AWS and Azure
- Analytics and search platforms (ElasticSearch)
- Messaging platforms (ActiveMQ, AWS SQS and SNS)
- Java, Maven
- API and ESB platforms (e.g. MuleSoft, Redhat)
- Transition to BaU plus ongoing development of client solutions
- Data Architecture & Pipeline Development: Design, build, and manage advanced data solutions, including data lakes and databases.
- Generative AI Implementation: Utilise generative algorithms to produce synthetic data, creating realistic simulations for training and validation purposes.
- Data Governance: Ensure data quality and data governance standards are upheld through careful design and documentation. Ensure that the data pipelines and databases align with the Deloitte security protocols and industry standards.
- Team Collaboration: Partner with various stakeholders to identify business requirements and translate them into data solutions.
- Technical Leadership: Provide technical mentorship to junior team members and advise on best practices and technologies in the data engineering domain.
- Innovation and Research: Evaluate emerging technologies and methodologies in data engineering and Generative AI to ensure the organisation remains at the forefront of the industry.
- AI Enablement: Practical experience in building pipelines that enable AI / ML technologies.
- Data Governance: Understanding of data quality, data lineage, and data governance principles.
- Communication Skills: Ability to convey complex information in an accessible manner to both technical and non-technical stakeholders.
- A minimum of 5 years professional experience in Data Engineering, preferably with a focus on Generative AI
- Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, or a related field is preferrable
- Experience with platform and software development, release management in a mature managed services environment
- Cloud technologies and platforms such as Azure or Amazon AWS
- UNIX/Linux deployment and configuration management
- TCP/IP networking, databases, messaging and security
- Knowledge of and experience with DevOps tools and techniques, such as Infrastructure as Code and Immutable Infrastructure
- Experience with CI tools such as Jenkins, Hudson, Bamboo, Thoughtworks Go
- Security protocols such as OAuth, SAML or OpenID Connect
- Must have an ability to effectively communicate and work with people with a diverse range of skills and experience