Senior Data Engineer - Build Modern Data Platforms

Simple Machines; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

Simple Machines is seeking a Senior Data Engineer to lead hands-on architecture and delivery of modern, cloud-native data platforms. You’ll design and build real-time pipelines, data products, and data contracts for high-value client projects, working in small, high-calibre teams close to problems and clients.

You’ll influence architectural decisions across ingestion, storage, processing, and access layers, ensuring secure, production-grade platforms and scalable data access across client

Qualifications

• Proven experience designing and delivering modern data platforms.
• Strong track record of building data pipelines and data platforms in production.
• Ability to translate business needs into pragmatic engineering solutions.

Responsibilities

• Own end-to-end architecture of cloud-native data platforms.
• Design scalable data ecosystems with data mesh, data products, and data contracts.
• Make architectural decisions across ingestion, storage, processing and access layers.
• Ensure platforms are secure, compliant, and production-grade by design.
• Design and deliver cloud-native data platforms with Databricks, Snowflake, AWS, and GCP.
• Apply modern patterns like data mesh and data contracts.
• Integrate with client systems for scalable data access.
• Build and optimize batch and real-time pipelines.
• Work with streaming tech: Kafka, Flink, Kinesis, Pub/Sub.
• Orchestrate with Airflow, Dataflow, Glue.
• Process large datasets with Spark and Flink.
• Design production-grade storage across Postgres, BigQuery, Snowflake, Cassandra, MongoDB.
• Optimize storage formats: Parquet, Delta, ORC, Avro.
• Implement security by design and governance.
• Guide clients with trusted technical advice.
• Set engineering standards and review designs.

Skills

Python

SQL

Spark

Databricks

Snowflake

AWS

GCP

Data mesh

Data contracts

Data modelling

Cloud architectures

Tools

Terraform

Pulumi

GitHub Actions

ArgoCD

dbt

Great Expectations

Soda

Airflow

Kubernetes

Kafka

Job description

Simple Machines is seeking a Senior Data Engineer to lead hands-on architecture and delivery of modern, cloud-native data platforms. You’ll design and build real-time pipelines, data products, and data contracts for high-value client projects, working in small, high-calibre teams close to problems and clients.

You’ll influence architectural decisions across ingestion, storage, processing, and access layers, ensuring secure, production-grade platforms and scalable data access across client