
Data Engineer
- Sydney, NSW
- Contract
- Full-time
- Experience in AWS Cloud, AWS S3, AWS Glue or similar tools within the cloud environment
- Provide level 2/3 technical support for AWS, Control-M, Teradata (legacy EDW), Snowflake, and ETL tool-based data integration solutions.
- DevOps - Ability to understand DevOps process and can use DevOps tools in accordance with the process
- Programming – High level of competency in Programming, including knowledge of supplementary programming languages such as Python
- Experience in Control M or similar scheduling applications.
- Worked on File transfer tools e.g. GoAnyWhere or any other similar tools
- Version control - Ability to demonstrate knowledge of version controls and its appropriate uses
- Facilitate continuous improvement measures in delivery principles, coding standards, documentation and provide training sessions to team.
- Prioritise work items and add them to a work queue.
- Understand, analyse and size user requirements.
- Development and maintenance of SQL analytical and ETL code.
- Development and maintenance of system documentation.
- Work within a state of the art, greenfield DevOps environment.
- Collaboration with data consumers, database development, testers and IT support teams.
- Proficiency in AWS services related to data engineering, including AWS Glue, S3, Lambda, EC2 and RDS
- Data pipeline design and development using ETL/ELT frameworks
- Proficiency with Snowflake as a Cloud EDW/Teradata as On-Prem EDW
- Programming skills, ideally Python
- Control-M Orchestration / Monitoring or similar
- Strong experience in Operational Support processes and working in BAU
- Experience with infrastructure-as-code tools: Cloud Formation or Terraform
- Exposure to ETL tools, such as DBT, Talend or Informatica
- SQL skills
- SAS knowledge