Lead Data Engineer, AI & ML Platform Architect

McKinsey; San Francisco (CA); On-site; USD 217,000 - 220,000; Full time

Job summary

McKinsey—QuantumBlack, AI by McKinsey—seeks a senior data engineer to lead technical teams, own data/AI platforms, and architect scalable ML pipelines. You will mentor colleagues, collaborate with clients, and contribute to R&D across industries in North America.

You will work within a cross-functional Agile setup, ensuring security standards and robust, reproducible data workflows while driving innovation with the Data Engineering community.

Qualifications

• Experience architecting enterprise data & AI platforms.
• Ability to mentor junior colleagues.
• Experience with DevOps/DataOps/MLOps.
• Strong stakeholder management with clients.
• Willingness to travel.
• Proficiency in Python/Scala/Java.

Responsibilities

• Lead technical teams and own the technology stack for enterprise data and AI platforms.
• Architect scalable data pipelines for machine learning in production.
• Mentor junior colleagues and collaborate with clients across levels.
• Drive R&D initiatives and innovation within the Data Engineering community.

Skills

Data platform architecture

Mentoring

DevOps/DataOps/MLOps

Spark/Dask

Cloud platforms

Docker/Kubernetes

Python/Scala/Java

Stakeholder management

Agile planning

Cross-functional leadership

Communication across levels

Willingness to travel

Education

Degree in Computer Science/Engineering/Math

Tools

Databricks

Airflow

SQL

PySpark

Kedro

RAPIDS

Docker

Kubernetes

Job description

McKinsey—QuantumBlack, AI by McKinsey—seeks a senior data engineer to lead technical teams, own data/AI platforms, and architect scalable ML pipelines. You will mentor colleagues, collaborate with clients, and contribute to R&D across industries in North America.

You will work within a cross-functional Agile setup, ensuring security standards and robust, reproducible data workflows while driving innovation with the Data Engineering community.