Lead Data Engineer: Real-Time Analytics & AI Growth

Immutable; Sydney; Hybrid; AUD 150,000 - 210,000; Full time

Benefits offered by this job

WFH stipend

Internet & phone allowance

Health & wellbeing benefit

Education budget (Udemy)

ESOP

Job summary

Immutable is hiring a Lead Data Engineer to own end-to-end data pipelines, modelling, and real-time streaming architecture. You will shape the platform direction, ensure data quality, and collaborate with product teams to deliver scalable analytics.

You will work with SQL, Python, and modern cloud data tools to enable AI-driven insights, with a focus on cost, latency, and reliability across streaming and batch processes. Hybrid Sydney-based role with global collaboration.

Qualifications

• Strong, hands-on data engineering fundamentals: pipelines, modelling, and clear reasoning about correctness, scale, and failure modes.
• Strong SQL and Python, used daily in production.
• Experience designing, building, and scaling production data pipelines end to end (some streaming exposure is a plus).
• Depth in the modern batch stack: dbt, an orchestrator, a cloud warehouse.
• Data modelling skills, schemas that serve analytics and product use cases and hold up at scale.
• Real experience with event data at billions-of-rows scale.
• Experience with cloud infrastructure (AWS or GCP) and infra-as-code.
• A data quality and observability mindset, testing, monitoring, and alerting as habit.
• A track record of setting technical direction through architecture decisions and mentoring senior engineers.
• Clear communication, you can explain data trade-offs to non-technical stakeholders.
• Strong ownership and pragmatic judgment.
• Comfort with ambiguity, priorities shift as the product evolves and you adapt without a perfect spec.

Responsibilities

• Build a greenfield real-time event-streaming platform on Kafka, Flink, and ClickHouse, serving segmentation and targeting at scale.
• Set the technical direction for the platform as our products scale.
• Own warehouse datasets and transformations end to end in BigQuery, dbt, SQL, and Python.
• Set data quality, testing, and observability standards across streaming and batch, tuning for cost and latency as volumes scale.
• Raise the bar through code review, mentoring, and patterns the team builds on.
• Build AI into how you work and into the platform itself, from coding agents to automated quality checks.

Skills

SQL

Python

Data pipelines

Data modeling

Architecture decisions

Communication

Ownership

Ambiguity tolerance

Tools

dbt

BigQuery

Kafka

Flink

ClickHouse

Terraform

AWS

GCP

Job description

Immutable is hiring a Lead Data Engineer to own end-to-end data pipelines, modelling, and real-time streaming architecture. You will shape the platform direction, ensure data quality, and collaborate with product teams to deliver scalable analytics.

You will work with SQL, Python, and modern cloud data tools to enable AI-driven insights, with a focus on cost, latency, and reliability across streaming and batch processes. Hybrid Sydney-based role with global collaboration.