Lead Data Engineer – Cloud Data Platforms & ML

Capital One Group; McLean (VA); Hybrid; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking a Data Engineer 5 in Enterprise Risk Management to drive a major transformation by designing, building and deploying cloud-first data solutions. You will collaborate with agile teams and mentor other engineers, influencing platform choices and data outcomes.

You’ll work with SQL, Python, Spark, Snowflake and Databricks to deliver scalable pipelines and robust data platforms, balancing hands‑on contribution with strategic design to empower millions of customers.

Qualifications

• Bachelor's degree or higher in Computer Science or related quantitative field.
• 6+ years of experience in application development.
• 4+ years of experience in distributed data.
• 4+ years of experience with SQL.
• 4+ years of experience programming with Python/Java/Scala.
• 4+ years of experience designing and developing data pipelines.
• 2+ years of experience in data modeling and end-to-end data solutions.

Responsibilities

• Collaborate with Agile teams to design, test, and support data solutions.
• Influence a team of developers, data analysts and data scientists with cloud-first data solutions.
• Architect and enforce data engineering design patterns for scalable pipelines.
• Lead end-to-end data initiatives and evaluate platform choices (Snowflake vs Databricks).
• Mentor junior engineers and communicate technical concepts to stakeholders.

Skills

SQL

Python

Distributed data

Data pipelines

Cloud data solutions

Education

Bachelor's Degree in Computer Science or related field

Master's Degree (preferred)

Tools

Snowflake

Databricks

Spark

EMR

Airflow

Dagster

MongoDB

DynamoDB

Job description

Capital One is seeking a Data Engineer 5 in Enterprise Risk Management to drive a major transformation by designing, building and deploying cloud-first data solutions. You will collaborate with agile teams and mentor other engineers, influencing platform choices and data outcomes.

You’ll work with SQL, Python, Spark, Snowflake and Databricks to deliver scalable pipelines and robust data platforms, balancing hands‑on contribution with strategic design to empower millions of customers.