Lead Data Engineer: Cloud Data & Real-Time Pipelines

Capital One Group; McLean (VA); Hybrid; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking a Lead Data Engineer in McLean, VA to design, build, test and support data-driven solutions in a fast-paced Agile environment. You will work with ML-friendly teams using Python, Spark, and cloud data warehouses like Redshift or Snowflake.

The role requires 4+ years of app development, 2+ years in big data, and 1+ year in cloud computing (AWS/Azure/GCP). Strong collaboration and mentoring are expected.

Qualifications

• Bachelor’s Degree required.
• 4+ years of application development experience.
• 2+ years of big data technologies experience.
• 1+ year of cloud computing experience (AWS, Azure or Google Cloud).
• Experience with Python, SQL, Scala or Java is preferred.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support technical solutions.
• Work with developers experienced in ML, distributed microservices, and full-stack systems.
• Utilize Python, SQL, Scala or Java and cloud data warehousing services such as Redshift or Snowflake.
• Perform unit tests and code reviews to ensure clean, well-tuned, high-performance code.
• Mentor other engineers and collaborate with product managers to deliver cloud-based solutions.

Skills

Python

SQL

Scala

Java

Spark

Cloud computing

Streaming data

Education

Bachelor's Degree

Tools

AWS

Azure

GCP

Redshift

Snowflake

Hadoop

Hive

EMR

Kafka

Spark

Unix/Linux

MySQL

Job description

Capital One is seeking a Lead Data Engineer in McLean, VA to design, build, test and support data-driven solutions in a fast-paced Agile environment. You will work with ML-friendly teams using Python, Spark, and cloud data warehouses like Redshift or Snowflake.

The role requires 4+ years of app development, 2+ years in big data, and 1+ year in cloud computing (AWS/Azure/GCP). Strong collaboration and mentoring are expected.