Lead Data Engineer - Scalable AI Pipelines

Socket.dev

O’Fallon (MO)

On-site

USD 122,000 - 207,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Health insurance
401k with company match
Paid time off
On-site fitness facilities

Job summary

Mastercard is seeking a Lead Data Engineer to join our Architecture & Analytics team in the US. You will shape our innovation roadmap by exploring new technologies and building scalable, data-driven prototypes and products.

The role demands hands-on leadership, deep experience with Spark, Hadoop, and cloud platforms, and the ability to guide engineers, scientists, and product stakeholders through complex data initiatives.

Qualifications

  • 8–12+ years in data or backend engineering, including senior/lead roles.
  • Strong Python and/or Java/Scala with hands-on cloud and big data tech.
  • Experience building scalable data architectures for AI/ML workloads.
  • Proven leadership, mentoring, and collaboration across teams.

Responsibilities

  • Own data architecture and modeling strategy for AI projects.
  • Lead ETL/ELT pipelines for large datasets with low latency.
  • Oversee data governance, quality, and compliance.
  • Provide hands-on technical leadership across projects.

Skills

8–12+ years in data engineering
Big Data & Cloud
AI/ML data lifecycle
Leadership & mentorship
Problem-solving mindset

Tools

Spark
Hadoop
Hive/Impala
Airflow
AWS/GCP/Azure

Job description

Mastercard is seeking a Lead Data Engineer to join our Architecture & Analytics team in the US. You will shape our innovation roadmap by exploring new technologies and building scalable, data-driven prototypes and products.

The role demands hands-on leadership, deep experience with Spark, Hadoop, and cloud platforms, and the ability to guide engineers, scientists, and product stakeholders through complex data initiatives.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Data Engineer: Scalable Data Platforms & Pipelines
Senior Data Engineer: Scalable Data Platforms & Pipelines

MasterCard • O’Fallon (MO)

On-site
USD 115,000 - 184,000
Insurance and benefits
401k with company match
Paid time off
Senior Cloud Data Engineer for AI-Driven Analytics
Senior Cloud Data Engineer for AI-Driven Analytics

MasterCard • Atlanta (GA)

On-site
USD 115,000 - 184,000
Insurance and benefits package
401k match
Paid time off and holidays
+3
Lead Data Scientist - Cloud ML & Generative AI
Lead Data Scientist - Cloud ML & Generative AI

Ellenco Estágios e Treinamentos • Town of Mexico (NY)

On-site
USD 120,000 - 210,000
Lead Data Engineer, AI/ML Pipelines & Data Platform
Lead Data Engineer, AI/ML Pipelines & Data Platform

3M • Minnesota

On-site
USD 188,000 - 231,000
Medical insurance
Dental insurance
Vision insurance
+2
Senior Data Scientist & ML Platform Engineer
Senior Data Scientist & ML Platform Engineer

Mastercard • New York (NY)

On-site
USD 138,000 - 221,000
Health insurance
Flexible Spending Account
Paid time off
Senior Data Scientist: ML & Data Pipelines
Senior Data Scientist: ML & Data Pipelines

Mastercard • San Francisco (CA)

On-site
USD 138,000 - 221,000
Health insurance
401(k) with company match
Paid time off and holidays
Lead Data Engineer — Scalable Pipelines & ML Integration
Lead Data Engineer — Scalable Pipelines & ML Integration

Macy's • Duluth (GA)

On-site
USD 120,000 - 170,000
Merchandise discounts
Performance‑based incentives
Annual merit review
+2
Platform Lead Developer: Commercial Data Integration
Platform Lead Developer: Commercial Data Integration

Mastercard • O’Fallon (MO)

On-site
USD 140,000 - 231,000
Senior Software Architect & AI-Driven Systems Lead
Senior Software Architect & AI-Driven Systems Lead

Mastercard • O’Fallon (MO)

On-site
USD 140,000 - 231,000
Medical Insurance
401(k) Match
Paid Leave
+1
Lead Data Engineer: Cloud, Spark & GenAI Innovator
Lead Data Engineer: Cloud, Spark & GenAI Innovator

Capital One • New York (NY)

On-site
USD 215,200 - 245,600