Senior Data Engineer

Simple Machines

Town of Poland (NY)

On-site

USD 120,000 - 180,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Simple Machines seeks a hands-on Senior Data Engineer to lead platform architecture and design modern, cloud-native data platforms. You’ll own end-to-end decisions, create scalable data ecosystems, and deliver real data products for clients using Databricks, Snowflake, AWS, and GCP.

You will work in small, high-calibre teams, building real-time pipelines with Spark, Kafka, and Airflow, while ensuring secure, compliant production systems and strong data governance.

Qualifications

Hands-on senior engineering role responsible for technical direction and platform design.
Design and build greenfield data platforms, real-time pipelines, and data products for clients.
Shaping modern architectures (data mesh, data contracts) and delivering real outcomes.

Responsibilities

Lead end-to-end architecture of cloud-native data platforms.
Design scalable data ecosystems using data mesh, data products, and data contracts.
Build and optimise batch and real-time pipelines using Spark, Kafka, and related tech.
Develop high-performance pipelines and ensure secure, compliant production grade platforms.
Collaborate with clients to translate business needs into pragmatic engineering solutions.
Mentor engineers and set standards across teams.

Skills

Python

SQL

Spark

Data architecture

Data modelling

Education

Bachelor's degree in CS or related field

Tools

Databricks

Snowflake

AWS

GCP

Terraform

Pulumi

Airflow

GitHub Actions

ArgoCD

dbt

Great Expectations

Soda

Job description

Simple Machines is a global, independent technology consultancy operating across Sydney, New Zealand, London, and Poland. We design and build modern data platforms, intelligent systems, and bespoke software at the intersection ofData Engineering, Software EngineeringandAI.

We work with enterprises, scale-ups, and government to turn messy, high-value data into products, platforms, and decisions that actually move the needle.

We don't do generic. We build things that matter -We engineer data to life™.

Senior Data Engineer

Who We Are

We work with enterprises, scale-ups, and government to turn messy, high-value data into products, platforms, and decisions that actually move the needle.

We don't do generic. We build things that matter -We engineer data to life™.

Requirements

The Role

This is a hands‑on senior engineering role, not an architecture‑only seat and not a support function. You'll be responsible for technical direction, platform design and architectural decision‑making.

You'll design and buildgreenfield data platforms, real‑time pipelines, and data products for clients who are serious about using data properly. You'll work in small, high‑calibre teams and operate close to both the problem and the client.

If you enjoy solving hard data problems, shaping modern architectures (data mesh, data products, contracts), and delivering real outcomes — this is your lane.

What You’ll Be Doing

Lead Platform & Architecture Design

Own the end-to-end architecture of modern, cloud‑native data platforms
Design scalable data ecosystems usingdata mesh, data products, and data contracts
Make high‑impact architectural decisions across ingestion, storage, processing, and access layers
Ensure platforms are secure, compliant, and production‑grade by design

Build Modern Data Platforms

Design and deliver cloud‑native data platforms usingDatabricks, Snowflake, AWS, and GCP
Apply modern architectural patterns:data mesh, data products, and data contracts
Integrate deeply with client systems to enable scalable, consumer‑oriented data access

Develop High‑Performance Pipelines

Build and optimisebatch and real‑time pipelines
Work with streaming and event‑driven tech such asKafka, Flink, Kinesis, Pub/Sub
Orchestrate workflows usingAirflow, Dataflow, Glue

Work at Scale

Process and transform large datasets usingSpark and Flink
Design systems that perform in production - not just on paper

Own Data Storage & Performance

Work across relational, NoSQL, and analytical stores (Postgres, BigQuery, Snowflake, Cassandra, MongoDB)
Optimise storage formats and access patterns (Parquet, Delta, ORC, Avro)

Cloud, Security & Governance

Implement secure, compliant data solutions withsecurity by design
Embed governance without killing developer velocity

Consult and Influence

Work directly with clients to understand problems and shape solutions
Translate business needs into pragmatic engineering decisions
Act as a trusted technical advisor, not just an order taker

Technical Leadership & Quality

Set engineering standards, patterns, and best practices across teams
Review designs and code, providing clear technical direction and mentorship
Raise the bar on data quality, testing, observability, and operational excellence

What We’re Looking For

Core Engineering Strength

StrongPython and SQL
Deep experience withSparkand modern data platforms (Databricks / Snowflake)
Solid grasp of cloud data services (AWS or GCP)

Architecture & Design Judgement

Demonstrated ownership of large‑scale data platform architectures
Strong data modelling skills and architectural decision‑making ability
Comfortable balancing trade‑offs between performance, cost, and complexity

Data Platform Experience

Built and operatedlarge‑scale data pipelinesin production
Strong data modelling capability and architectural judgement
Comfortable with multiple storage technologies and formats

Engineering Discipline

Infrastructure‑as‑code experience (Terraform, Pulumi)
CI/CD pipelines using tools likeGitHub Actions, ArgoCD
Data testing and quality frameworks (dbt, Great Expectations, Soda)

Delivery & Consulting Mindset

Experience in consulting or professional services environments
Strong consulting instincts — able to challenge assumptions and guide clients toward better outcomes
Comfortable mentoring senior engineers and influencing technical culture

Why Simple Machines