Senior Data Engineer

Ruse, NSW
Permanent
Full-time

9 days ago
Apply easily

Company DescriptionTechnology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.From prototype to real-world impact - be part of a global shift by doing work that matters.Job DescriptionOur data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling data-driven decision-making and innovation through advanced analytics and predictive modeling.Responsibilities:

Develop the architecture for the data pipelines and implement it using Python
Actively involved in onboarding data sources through data pipelines - ingestion, transformations, data storing, and orchestration of the pipelines
Identify, document, and develop measures to visualize and record source data and data pipeline quality objectives
Experience with data migration projects between systems hosted in different hosting environments (on-premises, AWS, Azure, etc.)
Work closely with technical leads, PM, BA, testing and reporting team on data requirements
Contribute to agile ceremonies, size tasks and deliverables.

Qualifications

5+ years of experience designing and developing data pipelines and managing data infrastructure
Proficiency in Python (pandas, PySpark)
Background and experience with tools and technologies like Databricks, Data Lake Storage, Snowflake, Synapse, Redshift, Apache Spark, Kimball Data Mart, Azure Key Vault
Experience with various Azure services for data processing and storage, data integration and analytics with Azure Synapse Workspaces
Understanding of Extract Transform Load (ETL) processes as well as platform monitoring and CI/CD processes
Knowledge of one or more RDBMS (SQL Server, Oracle, DB2)
Experience with reporting and dashboard creation with Power BI and similar tools will be a plus
Open to working in an agile environment as part of a scrum team
Advanced English speaking and writing abilities are required.

Additional InformationDiscover some of the global benefits that empower our people to become the best version of themselves:

Finance: Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus;
Career Development: Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;
Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;
Work-Life Balance: Hybrid work and flexible working hours, employee assistance programme;
Health: Global internal wellbeing programme, access to wellbeing apps;
Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.

At Endava, we’re committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives—because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.

Endava