Senior Data Platform Architect — Databricks & AWS (Hands-on)

Cox Purtell; Sydney; On-site; AUD 180,000 - 240,000; Full time

Benefits offered by this job

Wellbeing leave

Paid volunteering

Parental leave

Job summary

Cox Purtell is seeking a Technical Lead / Principal Engineer to own the design and delivery of end-to-end Databricks Lakehouse platforms for enterprise-scale data and AI programs in Sydney. You will build batch and streaming pipelines, optimize performance, and shape the platform direction in a hands-on capacity.

Membership in a 500+ data and AI practice with tier-one vendor alliances supports a scalable, high-impact environment that values ownership, training, and real delivery impact.

Qualifications

• Proven experience building data platforms end to end, infrastructure through to data lake.
• Deep hands-on Databricks and Delta Lake, medallion architecture, PySpark or Scala, with AWS (Glue or Redshift).
• Advanced SQL and performance tuning across distributed systems with Spark and cloud troubleshooting.
• Databricks certifications (Certified Data Engineer / Certified Professional) and AWS certifications highly regarded, not mandatory.
• Leadership potential for Technical Lead or hands-on Architect roles.

Responsibilities

• Architect end-to-end Databricks Lakehouse platforms on AWS (Glue/Redshift).
• Design and build batch, streaming and real-time pipelines for AI/analytics workloads.
• Tune distributed systems performance; manage cost and cluster sizing.
• Improve CI/CD and infrastructure as code practices across the platform.
• Deliver components directly as Technical Lead or coach engineers as Principal Engineer/Hands-on Architect.
• Set technical direction and mentor engineers through delivery.

Skills

Databricks

Delta Lake

Apache Spark

PySpark

Scala

Medallion Architecture

AWS

Glue

Redshift

Terraform

CI/CD

Data Engineering

Data Architecture

Data Platform

Data Lake

Sydney

Job description

Cox Purtell is seeking a Technical Lead / Principal Engineer to own the design and delivery of end-to-end Databricks Lakehouse platforms for enterprise-scale data and AI programs in Sydney. You will build batch and streaming pipelines, optimize performance, and shape the platform direction in a hands-on capacity.

Membership in a 500+ data and AI practice with tier-one vendor alliances supports a scalable, high-impact environment that values ownership, training, and real delivery impact.