AWS Data Engineering Lead

The Recruitment Company (TRC)

Sydney

On-site

AUD 140,000 - 210,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

The Recruitment Company (TRC) is partnering with an award-winning organisation investing heavily in data, cloud and AI capabilities in Sydney. We are seeking a Senior AWS Data Engineer to design and build production-grade data pipelines using AWS services, Databricks, Python and SQL.

You will shape modern data platforms for analytics and AI, implement robust CI/CD and data quality practices, and collaborate across engineering teams on a major transformation program starting Jan 2027.

Qualifications

  • Strong AWS data engineering experience in production environments.
  • Proven ability to design, build and deliver production-grade data pipelines.
  • Hands-on experience with Databricks and Delta Lake.
  • CI/CD and infrastructure as code experience.

Responsibilities

  • Design and build end-to-end data pipelines across the data platform.
  • Optimize enterprise-scale data platforms and ensure reliability.
  • Collaborate with data, analytics and engineering teams during transformation.

Skills

AWS Data Engineering
Python
SQL
Spark / PySpark
Data Pipelines
CI/CD
Databricks

Tools

Databricks Unity Catalog
Delta Lake
Airflow / MWAA
Terraform
SageMaker
Kafka

Job description

Build next-generation data platforms. Work with the latest AWS and AI technologies.

We're partnering with an award-winning organisation that is making a significant investment in its data, cloud and AI capabilities.

With a major transformation programme commencing in Jan 2027 this is an exciting opportunity to join a high-profile initiative, working alongside a talented team of data and engineering specialists to build modern, scalable data platforms that will underpin the organisation's future analytics and AI capabilities.

This is not a BAU environment. You'll be working with modern technologies, solving complex engineering challenges and helping shape the next generation of the organisation's data ecosystem.

The Opportunity

We're looking for strong Senior AWS Data Engineers who enjoy getting hands-on with technology and delivering high-quality data solutions into production.

You'll be involved across the engineering lifecycle, from designing and building data pipelines through to optimising enterprise-scale platforms and establishing robust engineering practices.

What You'll Be Working With
  • AWS: S3, Glue, Lake Formation, Redshift, Athena and SageMaker.

  • Databricks: Unity Catalog, Delta Lake and Spark.

  • Development: Python, SQL and PySpark.

  • Data Engineering: Modern ETL/ELT frameworks, data lakehouse architectures and data modelling.

  • Streaming: Kafka, AWS MSK and Flink.

  • Orchestration: Airflow / MWAA.

  • DevOps: Terraform, AWS CDK and CI/CD pipelines.

You'll also be contributing to data foundations that support advanced analytics, machine learning and emerging AI initiatives, including opportunities to explore AWS Bedrock and AI-enabled workflows.

What We're Looking For
  • Strong commercial experience in AWS Data Engineering.

  • Proven experience designing, building and delivering production-grade data pipelines.

  • Strong Python, SQL and Spark / PySpark skills.

  • Experience with Databricks, ideally Delta Lake and Unity Catalog.

  • Knowledge of modern cloud data platforms and lakehouse architectures.

  • Experience with CI/CD, infrastructure as code and automated deployments.

  • A strong engineering mindset, with a passion for modern technology and continuous improvement.

  • Financial services experience will be highly regarded.

Why This Opportunity?
  • Join a major, high-profile technology transformation programme.

  • Be part of a significant investment in modern data and AI capabilities.

  • Work with the latest AWS and Databricks technologies.

  • Collaborate with a talented team of data and engineering specialists.

  • Build platforms that will support the organisation's future analytics and AI ambitions.

  • Opportunity to join on either a permanent or daily-rate contract basis.

If you're a strong AWS Data Engineer ready to take ownership of your next challenge, this is an opportunity to work on a high-impact programme where modern data engineering, cloud technology and AI innovation are firmly on the agenda.

I’d love to hear from you!

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AWS Data Engineering Lead
AWS Data Engineering Lead

The Recruitment Company • Sydney

On-site
AUD 140,000 - 180,000
AWS Data Engineering Lead
AWS Data Engineering Lead

TRC Group • Sydney

On-site
AUD 180,000 - 230,000
3 x AWS Data Engineers | Major Data Transformation | Sydney
3 x AWS Data Engineers | Major Data Transformation | Sydney

The Recruitment Company • Sydney

On-site
AUD 140,000 - 190,000
3 x AWS Data Engineers | Major Data Transformation | Sydney
3 x AWS Data Engineers | Major Data Transformation | Sydney

TRC Group • Sydney

Hybrid
AUD 150,000 - 190,000
Senior Data Engineer
Senior Data Engineer

Work Initiatives • North Sydney

On-site
AUD 150,000 - 210,000
Senior Data Engineer
Senior Data Engineer

Elysium Digital • Melbourne

On-site
AUD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Elysium Digital • Sydney

On-site
AUD 130,000 - 180,000
Senior AWS Data Engineer - Data Platform Transformation
Senior AWS Data Engineer - Data Platform Transformation

The Recruitment Company • Sydney

On-site
AUD 140,000 - 180,000
Mid-Senior Data Engineer (Multiple Vacancies)
Mid-Senior Data Engineer (Multiple Vacancies)

seek.com.au • Sydney

On-site
AUD 120,000 - 180,000
Data Engineer Aws - Real-Time Pipelines (Hybrid)
Data Engineer Aws - Real-Time Pipelines (Hybrid)

Asx • Sydney

Hybrid
AUD 140,000 - 190,000
Monthly Lifestyle Allowance: Health/wb
Novated Leasing: Pre-tax car leasing
Loyalty Leave: extra leave days
+2
Top locations