Cloud Data Platform Engineer for ML & Analytics

Harnham; Amsterdam; On-site; EUR 90,000 - 120,000; Full time

Benefits offered by this job

Competitive salary

Modern data & ML technologies

Autonomy & ownership

Job summary

Harnham is seeking a Senior Data Engineer to shape a modern data platform powering analytics and ML at scale. You will build and maintain scalable data pipelines, enabling data-driven decisions across the business.

Working with Databricks, AWS and modern data storage formats, you will collaborate with data scientists and engineers to deliver robust data products and services. You’ll own reliability and governance while advancing automation.

Qualifications

• Extensive experience in data engineering and distributed data systems.
• Strong Python, PySpark, Spark and SQL capabilities.
• Experience with cloud-native data applications on AWS.
• Familiarity with Delta Lake and Parquet formats.
• Knowledge of data governance, quality frameworks and monitoring.

Responsibilities

• Build and enhance a self-service data platform for analytics and ML workloads.
• Design scalable batch and real-time data pipelines.
• Improve platform reliability, performance and efficiency.
• Develop cloud-native data solutions at scale.
• Implement data quality, governance, monitoring and schema management.
• Collaborate with Data Engineers, Software Engineers and Data Scientists.
• Support data collection, processing, storage and distribution.
• Contribute to infrastructure automation and platform engineering.

Skills

Data Engineering

Python

PySpark

SQL

Spark

Cloud

Streaming

Kafka

Airflow

Docker

Kubernetes

Terraform

Delta Lake

Parquet

Tools

Databricks

AWS

Databricks Lakehouse

MLflow

Unity Catalog

Mosaic AI

Model serving

Job description

Harnham is seeking a Senior Data Engineer to shape a modern data platform powering analytics and ML at scale. You will build and maintain scalable data pipelines, enabling data-driven decisions across the business.

Working with Databricks, AWS and modern data storage formats, you will collaborate with data scientists and engineers to deliver robust data products and services. You’ll own reliability and governance while advancing automation.