Remote Senior Data Engineer - ML Platform & MLOps Lead

Overt Minds; Job; Sur place; EUR 90 000 - 130 000; Plein temps

Résumé du poste

Overt Minds is seeking a Senior Data Engineer to design scalable, cloud-native data platforms and enable end-to-end MLOps workflows. You will build ETL/ELT pipelines, manage data lakes/warehouses/feature stores, and ensure high-performance, secure, and cost-efficient pipelines for AI/ML and analytics.

The role emphasizes collaboration with Data Scientists and ML Engineers to productionize models across AWS, GCP, and Azure, leveraging tools like Kafka, Spark, and Terraform, with strong focus on

Qualifications

• 5+ years hands-on experience in Data Engineering, Big Data, or Cloud Data Platform roles.
• Strong Python and SQL to build and optimize ETL/ELT pipelines.
• Experience with distributed data systems (Spark, Hive, Presto, Dask) for batch and real-time processing.
• Proven track record with cloud platforms across AWS, GCP, or Azure (BigQuery, Redshift, EMR, Databricks).
• Experience designing event-driven and streaming architectures (Kafka, Pub/Sub, Flink).
• Background in data modeling (star schema, OLAP cubes, graph databases).
• Exposure to data security, encryption, and compliance frameworks (GDPR, HIPAA).

Responsabilités

• Design & optimize batch/streaming ETL/ELT pipelines at scale.
• Build/manage data lakes, warehouses, feature stores for ML/BI workloads.
• Enable MLOps workflows including model training, deployment, CI/CD, monitoring.
• Implement real-time pipelines with Kafka, Spark Streaming, Kinesis, Pub/Sub, Event Hubs.
• Apply IaC & scaling with Terraform, CloudFormation, ARM, Kubernetes.
• Ensure data lineage, observability, security, cost efficiency.
• Collaborate with Data Scientists & ML Engineers to productionize ML models.

Connaissances

Python

SQL

Distributed data processing

Data security & compliance

DevOps / MLOps mindset

Collaboration with Data Scientists

Outils

AWS

GCP

Azure

BigQuery

Redshift

EMR

Databricks

Kafka

Pub/Sub

Spark

Hive

Flink

Dask

Clickhouse

Apache Pinot

Kubernetes

Terraform

CloudFormation

Description du poste

Overt Minds is seeking a Senior Data Engineer to design scalable, cloud-native data platforms and enable end-to-end MLOps workflows. You will build ETL/ELT pipelines, manage data lakes/warehouses/feature stores, and ensure high-performance, secure, and cost-efficient pipelines for AI/ML and analytics.

The role emphasizes collaboration with Data Scientists and ML Engineers to productionize models across AWS, GCP, and Azure, leveraging tools like Kafka, Spark, and Terraform, with strong focus on