Senior Data Platforms Engineer: Real‑Time Pipelines

Simple Machines 3; Sydney; On-site; AUD 140,000 - 190,000; Full time

Job summary

Simple Machines is seeking a hands-on Senior Data Platforms Engineer to design and build greenfield data platforms and real-time pipelines for clients. You’ll work in small, high-calibre teams, close to the problem and client, delivering robust data products and scalable access.

You’ll design modern architectures (data mesh, data contracts), deploy cloud-native platforms on AWS/GCP, and own storage, performance, and governance with a delivery and consulting mindset.

Qualifications

• Advanced Python and SQL engineering skills.
• Deep experience with Spark and modern data platforms (Databricks / Snowflake).
• Solid grasp of cloud data services (AWS or GCP).
• Built and operated large-scale data pipelines in production.
• Strong data modelling capability and architectural judgement.
• Comfortable with multiple storage technologies and formats.
• Infrastructure-as-code experience (Terraform, Pulumi).
• CI/CD pipelines with GitHub Actions and ArgoCD.
• Data testing and quality frameworks (dbt, Great Expectations, Soda).
• Delivery mindset with consulting experience and agile teams.

Responsibilities

• Build Modern Data Platforms using cloud-native tech and modern architectures.
• Develop high-performance batch and real-time pipelines with streaming tech.
• Work at scale transforming large datasets into production-grade systems.
• Own data storage and performance across relational and NoSQL stores.
• Implement security by design and governance without hampering velocity.
• Consult with clients, translate business needs into pragmatic engineering decisions.

Skills

Python

SQL

Spark

Databricks

Snowflake

AWS

GCP

Terraform

Pulumi

GitHub Actions

ArgoCD

dbt

Great Expectations

Soda

Spark

Kafka

Flink

Kinesis

Pub/Sub

Airflow

Dataflow

Glue

Postgres

BigQuery

Snowflake

Cassandra

MongoDB

Scala

Java

Go

Rust

Neo4j

Cassandra

Tools

Terraform

Pulumi

GitHub Actions

ArgoCD

Job description

Simple Machines is seeking a hands-on Senior Data Platforms Engineer to design and build greenfield data platforms and real-time pipelines for clients. You’ll work in small, high-calibre teams, close to the problem and client, delivering robust data products and scalable access.

You’ll design modern architectures (data mesh, data contracts), deploy cloud-native platforms on AWS/GCP, and own storage, performance, and governance with a delivery and consulting mindset.