Lead Data Engineer - Cloud Pipelines & Real-Time Analytics

Capital One; Richmond (VA); On-site; USD 179,000 - 205,000; Full time

Benefits offered by this job

Health benefits

Job summary

Capital One is seeking a Lead Data Engineer to design and build scalable data pipelines and governance-enabled data platforms. You will collaborate with agile teams, mentor peers, and deliver cloud-based solutions leveraging Snowflake and Databricks.

The role emphasizes data quality, modeling, and usable data for financial empowerment across audiences. The position requires strong Python/SQL skills, experience with big data technologies, and a focus on performance and reliability in a fast-paced

Qualifications

• Bachelor’s degree required.
• 4+ years in application development, internships not counted.
• 2+ years in big data technologies.
• 1+ year in cloud computing (AWS, Azure, or Google Cloud).
• Preferred: 7+ years in development with Python/SQL/Spark and ETL tools.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support data movement solutions.
• Lead a team of developers in data movement, distributed computing, and full-stack systems.
• Use Python, SQL, Snowflake, and Databricks to build cloud data pipelines.
• Optimize information systems for end-users and downstream consumers.
• Mentor engineers and stay current with tech trends and communities.
• Partner with product managers to deliver cloud-based solutions for customers.

Skills

Python

SQL

Data modeling

Data governance

Cloud computing

Agile engineering

Data warehousing

NoSQL

Education

Bachelor's Degree

Tools

Snowflake

Databricks

AWS

Azure

Google Cloud

Hadoop

Kafka

Redshift

MongoDB

Cassandra

Unix/Linux

Job description

Capital One is seeking a Lead Data Engineer to design and build scalable data pipelines and governance-enabled data platforms. You will collaborate with agile teams, mentor peers, and deliver cloud-based solutions leveraging Snowflake and Databricks.

The role emphasizes data quality, modeling, and usable data for financial empowerment across audiences. The position requires strong Python/SQL skills, experience with big data technologies, and a focus on performance and reliability in a fast-paced