Lead Data Engineer: Cloud, ML & Big Data Lead

Capital One National Association; McLean (VA); Hybrid; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking a Lead Data Engineer in McLean, VA to drive data and cloud-centric solutions. You will collaborate with Agile teams to design, develop, test, and support full-stack data pipelines, ML workloads, and distributed systems using Java, Scala, Python, and modern data stores.

You will mentor teammates and lead high-impact data initiatives in a fast-paced environment. You will work with AWS/Azure/GCP, Redshift and Snowflake, and real-time streaming tools to power financial

Qualifications

• Bachelor's Degree required.
• 4+ years of experience in application development.
• 2+ years of experience in big data technologies.
• At least 1 year experience with cloud computing (AWS, Azure, GCP).
• 7+ years of experience in application development including Python, SQL, Scala, or Java.
• 4+ years of experience with a public cloud (AWS, Azure, Google Cloud).
• 4+ years experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL).
• 4+ years of data warehousing experience (Redshift or Snowflake).
• 4+ years of experience with UNIX/Linux including basic commands and shell scripting.
• 2+ years of experience with Agile engineering practices.
• Experience leveraging interactive AI tooling to accelerate productivity.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support technical solutions.
• Work with developers skilled in ML, distributed microservices, and full-stack systems.
• Utilize Java, Scala, Python and RDBMS/NoSQL databases; work with Redshift/Snowflake.
• Mentor engineers and participate in tech communities to stay current.
• Deliver cloud-based solutions that empower millions of Capital Ones customers.
• Perform unit tests and code reviews to ensure high quality and performance.

Skills

Python

Java

Scala

SQL

Microservices

Education

Bachelor's Degree

Tools

AWS

Azure

GCP

Redshift

Snowflake

Hadoop

Kafka

Spark

MySQL

UNIX/Linux

Shell scripting

EMR

Job description

Capital One is seeking a Lead Data Engineer in McLean, VA to drive data and cloud-centric solutions. You will collaborate with Agile teams to design, develop, test, and support full-stack data pipelines, ML workloads, and distributed systems using Java, Scala, Python, and modern data stores.

You will mentor teammates and lead high-impact data initiatives in a fast-paced environment. You will work with AWS/Azure/GCP, Redshift and Snowflake, and real-time streaming tools to power financial