Senior Data Platform Engineer: Real-Time Cloud-Native

Simple Machines; Sydney; On-site; AUD 150,000 - 210,000; Full time

Job summary

Simple Machines in Sydney invites a hands-on Senior Data Engineer to design and build greenfield data platforms, real-time pipelines and data products for enterprise clients. You’ll work in small, high-caliber teams close to the problem and the client.

You’ll apply data mesh concepts, data contracts, and modern architectures, using Databricks, Snowflake, AWS and GCP, to deliver scalable, production-ready solutions with strong governance and security.

Qualifications

• Strong Python and SQL
• Deep experience with Spark and modern data platforms (Databricks / Snowflake)
• Solid grasp of cloud data services (AWS or GCP)
• Built and operated large-scale data pipelines in production
• Strong data modelling capability and architectural judgement
• Comfortable with multiple storage technologies and formats
• Infrastructure-as-code experience (Terraform, Pulumi)
• CI/CD pipelines using tools like GitHub Actions, ArgoCD
• Data testing and quality frameworks (dbt, Great Expectations, Soda)
• Delivery-focused consulting mindset with stakeholder engagement

Responsibilities

• Design and build greenfield data platforms
• Develop real-time and batch data pipelines
• Work with streaming tech like Kafka, Flink, Kinesis
• Orchestrate workflows with Airflow, Dataflow, Glue
• Work with relational and NoSQL stores and optimize storage formats
• Embed governance and security by design
• Consult with clients to translate problems into engineering solutions
• Collaborate in small, high-caliber teams
• Mentor juniors and share craft with peers

Skills

Python

SQL

Spark

Databricks

Snowflake

AWS

GCP

Data mesh

Data contracts

Data pipelines

Tools

Terraform

Pulumi

Airflow

GitHub Actions

ArgoCD

dbt

Great Expectations

Soda

Job description

Simple Machines in Sydney invites a hands-on Senior Data Engineer to design and build greenfield data platforms, real-time pipelines and data products for enterprise clients. You’ll work in small, high-caliber teams close to the problem and the client.

You’ll apply data mesh concepts, data contracts, and modern architectures, using Databricks, Snowflake, AWS and GCP, to deliver scalable, production-ready solutions with strong governance and security.