Lead Data Engineer — Python, AWS, Spark, Snowflake, GenAI

Capital One; McLean (VA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking a Lead Data Engineer to join Enterprise Platforms Technology in McLean, VA. You will design, develop, test, and support full-stack data solutions, collaborating with agile teams on ML-powered and distributed systems.

You’ll work with Java, Scala, Python and NoSQL/SQL ecosystems, leveraging AWS/Azure/Google Cloud and cloud data warehousing such as Redshift or Snowflake to drive financial empowerment for millions of Americans.

Qualifications

• Bachelor’s Degree in a related field.
• 4+ years in application development and 2+ years in big data.
• 1 year cloud experience (AWS/Azure/Google).

Responsibilities

• Design, develop, test, implement and support full-stack data solutions.
• Collaborate with teams on ML, microservices, and data systems.
• Use Java, Scala, Python and cloud data warehousing.
• Mentor engineers and stay current with tech trends.
• Deliver cloud-based solutions to empower customers.
• Perform unit tests and code reviews for performance.

Skills

Java

Python

Scala

SQL

Education

Bachelor’s Degree

Tools

AWS

Azure

Google Cloud

Hadoop

Kafka

Spark

MongoDB

Cassandra

Redshift

Snowflake

Unix/Linux

Shell scripting

Job description

Capital One is seeking a Lead Data Engineer to join Enterprise Platforms Technology in McLean, VA. You will design, develop, test, and support full-stack data solutions, collaborating with agile teams on ML-powered and distributed systems.

You’ll work with Java, Scala, Python and NoSQL/SQL ecosystems, leveraging AWS/Azure/Google Cloud and cloud data warehousing such as Redshift or Snowflake to drive financial empowerment for millions of Americans.