Senior Data Platform Engineer: Databricks & Pipelines

Simple Machines; Sydney; Vor Ort; AUD 150.000 - 180.000; Vollzeit

Zusammenfassung

Simple Machines, a global technology consultancy, is seeking a Senior Data Engineer to design and build modern data platforms for clients in Sydney and beyond.

You will create cloud-native pipelines, implement data mesh concepts, and work closely with clients to deliver real outcomes. The role emphasizes hands-on engineering and practical problem-solving in a small, senior-team setting.

Qualifikationen

• Strong Python and SQL skills with deep Spark experience.
• Hands-on with Spark-based data platforms such as Databricks or Snowflake.
• Cloud data services on AWS or GCP.

Aufgaben

• Design and deliver cloud-native data platforms using Databricks, Snowflake, AWS, and GCP.
• Create data mesh, data products, and data contracts.
• Integrate with client systems for scalable, consumer-oriented data access.
• Build and optimise batch and real-time pipelines.
• Process large datasets with Spark and Flink in production.
• Ensure secure, governed data solutions with privacy by design.
• Engage clients to shape solutions and advise technically.

Kenntnisse

Python & SQL

Spark / Databricks

Cloud Data Services

Tools

Terraform

Pulumi

GitHub Actions

ArgoCD

dbt

Great Expectations

Soda

Jobbeschreibung

Simple Machines, a global technology consultancy, is seeking a Senior Data Engineer to design and build modern data platforms for clients in Sydney and beyond.

You will create cloud-native pipelines, implement data mesh concepts, and work closely with clients to deliver real outcomes. The role emphasizes hands-on engineering and practical problem-solving in a small, senior-team setting.