Lead AI Data Engineer - Scalable ML Pipelines (Remote)

3M; Saint Paul (MN); Remote; USD 188,000 - 230,000; Full time

Benefits offered by this job

Medical

Dental & Vision

Health Savings Accounts

Health Care & Dependent Care FSAs

Disability Benefits

Life Insurance

Voluntary Benefits

Paid Absences and Retirement Benefits

Job summary

3M seeks a Lead Data Engineer to design, build, and optimize data platforms powering advanced analytics and AI/ML workloads. You will lead scalable data pipelines and collaborate with data scientists and ML engineers to shape model features and deployment.

Ideal candidates bring 7+ years in data engineering, a computer science degree, and hands-on Python, SQL, Spark, and cloud experience (Azure preferred). This is a remote US role with up to 5% travel and strong benefits.

Qualifications

• Bachelor's degree or higher in computer science.
• Seven (7) years of data engineering experience, including leading technical initiatives.

Responsibilities

• Lead the architecture and development of scalable, secure data pipelines supporting AI/ML workloads.
• Own end to end data engineering processes: ingestion, transformation, storage, quality, and monitoring.
• Collaborate with data scientists and ML engineers on model features, training pipelines, and deployment.
• Drive best practices in data modeling, orchestration, versioning, and performance optimization.
• Mentor and guide junior engineers; contribute to technical roadmaps and solution patterns.
• Ensure data governance, lineage, and compliance standards are met across platforms.
• Support real time and batch processing frameworks in production environments.

Skills

AI/ML data pipelines

Feature engineering

Distributed data systems

Cloud platforms

Python

SQL

Airflow

Education

Bachelor's degree or higher in computer science

Tools

Spark

Databricks

Synapse

Azure

Data Factory

Cosmos DB

Airflow

Job description

3M seeks a Lead Data Engineer to design, build, and optimize data platforms powering advanced analytics and AI/ML workloads. You will lead scalable data pipelines and collaborate with data scientists and ML engineers to shape model features and deployment.

Ideal candidates bring 7+ years in data engineering, a computer science degree, and hands-on Python, SQL, Spark, and cloud experience (Azure preferred). This is a remote US role with up to 5% travel and strong benefits.