Senior Data Engineer: ML Pipelines & AI Platforms

QuantumBlack, AI by McKinsey; Madrid; On-site; EUR 70,000 - 110,000; Full time

Job summary

QuantumBlack, AI by McKinsey is hiring in Madrid or Lisbon to design scalable data pipelines and lead analytics workstreams. You will mentor junior colleagues while collaborating with cross-functional teams and clients on AI solutions across industries.

The role emphasizes data engineering excellence, secure data environments, and contributing to R&D while growing technically and as a leader within a global community.

Qualifications

• Degree in Computer Science, Engineering, Mathematics, or equivalent experience.
• Proficient in a programming language (Python/Java/Scala).
• Experience building data pipelines in production environments.
• Comfort with distributed computing (Spark, Dask) and cloud platforms.
• Strong knowledge of SQL, Pandas/Numpy and data analysis libraries.
• Experience with Docker/Kubernetes and Airflow or similar tools.
• Exposure to Databricks, Kedro, and open-source data tooling.
• Ability to work with structured, semi-structured and unstructured data.
• Excellent time management and willingness to travel.
• Fluent in English and Spanish or Portuguese.

Responsibilities

• Design scalable data pipelines for ML and analytics.
• Manage secure data environments and data quality checks.
• Lead technical workstreams and mentor junior colleagues.
• Collaborate with data scientists, engineers, and clients.
• Deliver advanced analytics solutions across industries.

Skills

Programming

Distributed computing

Cloud

Containerization

Data libraries

Data pipelines

Data types

Python

PySpark

SQL

Airflow

Databricks

Kedro

Docker

Kubernetes

AWS

GCP

Azure

Education

Degree in Computer Science, Engineering, Mathematics, or equivalent

Job description

QuantumBlack, AI by McKinsey is hiring in Madrid or Lisbon to design scalable data pipelines and lead analytics workstreams. You will mentor junior colleagues while collaborating with cross-functional teams and clients on AI solutions across industries.

The role emphasizes data engineering excellence, secure data environments, and contributing to R&D while growing technically and as a leader within a global community.