Technical Lead — Databricks Lakehouse on AWS

Sociable Tech

Sydney

On-site

AUD 168,000 - 250,000

Full time

2 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Superannuation

Job summary

Cox Purtell is hiring a Technical Lead / Principal Engineer / Hands-on Architect for Data Engineering (Platform & Infrastructure) in Sydney, NSW. You will own end-to-end Databricks Lakehouse platforms on AWS, delivering medallion architectures, batch and streaming pipelines, with real-world tradeoffs and ownership of the platform.

You'll join a 500+ strong data and AI practice, collaborate with tier-one vendors, and guide engineers through complex builds.

Qualifications

  • Proven experience building data platforms end to end, infrastructure through to data lake.
  • Deep hands-on Databricks and Delta Lake, including medallion architecture, PySpark or Scala, with AWS (Glue or Redshift).
  • Advanced SQL and performance tuning across distributed systems with real Spark and cloud troubleshooting.
  • Databricks certifications (Certified Data Engineer / Certified Professional) and AWS certifications highly regarded.

Responsibilities

  • Architect end-to-end Databricks Lakehouse platforms on AWS, including medallion architecture and batch/streaming pipelines.
  • Own distributed system performance, Spark tuning, cost control, and CI/CD improvements across the platform.
  • Set technical direction for the build and coach engineers through delivery with leadership potential.

Skills

Databricks
Delta Lake
Apache Spark
PySpark
Scala
Medallion Architecture
AWS
Glue
Redshift
Terraform
CI/CD
Data Platform
Data Lake

Tools

Databricks
Delta Lake
Apache Spark
PySpark
Scala
Medallion Architecture
AWS
Glue
Redshift
Terraform
CI/CD

Job description

Cox Purtell is hiring a Technical Lead / Principal Engineer / Hands-on Architect for Data Engineering (Platform & Infrastructure) in Sydney, NSW. You will own end-to-end Databricks Lakehouse platforms on AWS, delivering medallion architectures, batch and streaming pipelines, with real-world tradeoffs and ownership of the platform.

You'll join a 500+ strong data and AI practice, collaborate with tier-one vendors, and guide engineers through complex builds.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Data Platform Architect — Databricks & AWS (Hands-on)
Senior Data Platform Architect — Databricks & AWS (Hands-on)

Cox Purtell • Sydney

On-site
AUD 180,000 - 240,000
Wellbeing leave
Paid volunteering
Parental leave
Senior Data Engineer / Data Architect - Databricks & AWS
Senior Data Engineer / Data Architect - Databricks & AWS

Sociable Tech • Sydney

On-site
AUD 168,000 - 250,000
Superannuation
Senior Databricks Lakehouse Architect - Enterprise Data & AI
Senior Databricks Lakehouse Architect - Enterprise Data & AI

n Human Resources & Management Systems [ nHRMS ] • Sydney

On-site
AUD 170,000 - 230,000
Senior Databricks Lakehouse Architect — Sydney Hybrid
Senior Databricks Lakehouse Architect — Sydney Hybrid

luvo Talent • Sydney

Hybrid
AUD 240,000 - 320,000
Competitive salary
Hybrid work model
Databricks Data Engineer – Lakehouse & AWS (6mo Contract)
Databricks Data Engineer – Lakehouse & AWS (6mo Contract)

Talent Corp • City of Brisbane

On-site
AUD 218,000 - 232,000
Senior Data Platform Lead - Databricks & Lakehouse (Hybrid)
Senior Data Platform Lead - Databricks & Lakehouse (Hybrid)

Peoplebank • City of Brisbane

Hybrid
AUD 120,000 - 140,000
Senior Data Engineer / Data Architect – Databricks & AWS
Senior Data Engineer / Data Architect – Databricks & AWS

Cox Purtell • Sydney

On-site
AUD 180,000 - 240,000
Wellbeing leave
Paid volunteering
Parental leave
Data Platform Lead — Databricks, AI/ML & DataOps
Data Platform Lead — Databricks, AI/ML & DataOps

Medibank • Victoria

On-site
AUD 180,000 - 260,000
Senior Data Lakehouse Architect - Azure Databricks
Senior Data Lakehouse Architect - Azure Databricks

Showtime Consulting • City of Melbourne

On-site
AUD 120,000 - 180,000
Senior Data Engineer: AI-Driven Lakehouse & Cloud Pipelines
Senior Data Engineer: AI-Driven Lakehouse & Cloud Pipelines

Mantel Group Pty Ltd • Australia

On-site
AUD 140,000 - 190,000