Lead Data Engineer — Real-Time AI & Cloud Foundations

Capital One; Richmond (VA); On-site; USD 179,400 - 204,700; Full time

Job summary

Capital One is seeking a Lead Data Engineer for the Intelligent Foundations & Experiences group. The role focuses on real-time data, cloud-based solutions, and full stack data engineering across agile teams in order to empower millions of Capital One customers with powerful, secure data-driven experiences.

The position requires extensive experience in Java/Scala/Python, big data tools, and cloud platforms, with a strong emphasis on performance, scalability, and mentorship within the engineering

Qualifications

• Bachelor's degree required.
• 4+ years in application development (internship excluded).
• 2+ years in big data technologies.
• 1+ year cloud experience (AWS, Azure or Google Cloud).
• 7+ years in application development including Python, SQL, Scala or Java.
• 4+ years in public cloud experience (AWS, Azure or Google Cloud).
• 4+ years in distributed data tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark).
• 4+ years in real-time data and streaming applications.
• 4+ years in NoSQL (Mongo, Cassandra).
• 4+ years in data warehousing (Redshift or Snowflake).
• 4+ years UNIX/Linux and shell scripting.
• 2+ years Agile engineering practices.
• Experience with interactive AI tooling to accelerate productivity.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions.
• Work with developers experienced in ML, distributed microservices, and full stack systems.
• Utilize Java, Scala, Python and SQL/NoSQL databases plus cloud data warehousing like Redshift and Snowflake.
• Mentor other engineering team members and stay current with tech trends.
• Partner with product managers to deliver cloud-based solutions for millions of users.
• Perform unit testing and code reviews for performance-tuned implementations.

Tools

Java

Scala

Python

RDBMS

NoSQL

Redshift

Snowflake

AWS

Azure

Google Cloud

Big Data

Hadoop

Kafka

Spark

Mongo

Cassandra

Unix/Linux

Shell scripting

MapReduce

Agile

AI tooling

Job description

Capital One is seeking a Lead Data Engineer for the Intelligent Foundations & Experiences group. The role focuses on real-time data, cloud-based solutions, and full stack data engineering across agile teams in order to empower millions of Capital One customers with powerful, secure data-driven experiences.

The position requires extensive experience in Java/Scala/Python, big data tools, and cloud platforms, with a strong emphasis on performance, scalability, and mentorship within the engineering