Data Platform Engineer - Build Reliable Pipelines at Scale

EatClub; Sydney; On-site; AUD 140,000 - 190,000; Full time

Benefits offered by this job

$5 voucher code for first-time users

Job summary

EatClub is seeking a Data Platform Engineer to own ingestion, orchestration, governance and cost optimization across a Databricks lakehouse. You will build production data pipelines, partner APIs, and AI-enabled tooling.

The role emphasizes fast-paced delivery, ownership, and scaling analytics for a busy hospitality platform. You will work with a small, high-leverage team to ship real pipelines and dashboards weekly, shaping a data foundation used across the business.

Qualifications

• Solid experience writing and optimising SQL for commercial-scale products.
• Strong Python proficiency and software engineering practices.
• Hands-on experience building and operating production data pipelines on a cloud data platform.
• Experience with orchestration/scheduling (Databricks Workflows, Airflow, Dagster).
• Experience working with internal APIs and third‑party tools to ingest data efficiently while maintaining data integrity.
• Knowledge of Git, CI/CD, trunk‑based development and testing practices.
• Familiarity with an AI-first working style: Claude Code and AI tooling.

Responsibilities

• Build and operate ingestion into the bronze layer with new sources, CDC feeds, and proper backfills.
• Own orchestration workflows: scheduling, dependencies, retries, and SLAs for datasets.
• Harden CI/CD with trunk-based development, PR checks, tests, and environment promotions.
• Govern platform grants, lineage, tagging, security, and safe data sharing with partners.
• Own cost/performance: right-size warehouses/clusters and optimize partitioning.
• Build data quality and observability: freshness, checks, alerting, root cause links.
• Make the platform self-serve for analysts and data scientists.

Skills

SQL

Python

Data pipelines

Databricks Workflows

Airflow

Dagster

APIs

Git

CI/CD

Trunk-based development

Tests

AI-first

Claude Code

Tools

Databricks

dbt Core

Job description

EatClub is seeking a Data Platform Engineer to own ingestion, orchestration, governance and cost optimization across a Databricks lakehouse. You will build production data pipelines, partner APIs, and AI-enabled tooling.

The role emphasizes fast-paced delivery, ownership, and scaling analytics for a busy hospitality platform. You will work with a small, high-leverage team to ship real pipelines and dashboards weekly, shaping a data foundation used across the business.