Data Engineer Lead — Cloud Data & Real-Time Pipelines

Capital One; Virginia; On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking a Data Engineer 4 (Manager, IC) to lead and contribute across data engineering initiatives. You will design and deliver cloud-first data solutions, mentor others, and collaborate with product managers and software engineers to enable scalable, secure data pipelines across the organization.

The role emphasizes independent delivery, architecture of common data patterns, and clear communication with stakeholders to align data outcomes with business goals.

Qualifications

• Bachelor's Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• At least 4 years of experience in application development
• At least 2 years of experience in distributed data
• At least 2 years of experience with SQL
• At least 2 years of experience with one programming language (Python, Java, or Scala)
• At least 2 years of experience in data pipeline design and development
• At least 1 year of experience in data modeling and designing end-to-end data solutions using relational and non-relational databases

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions
• Influence a team of developers, data analysts and data scientists with ML, microservices, lakehouse architecture
• Utilize Python and Spark with SQL/NoSQL databases and Databricks/Snowflake
• Mentor data community members and stay current with data trends
• Deliver cloud-first data solutions that empower customers
• Design, build and deliver cloud data solutions independently
• Architect data engineering patterns for quality and reusability
• Communicate technical concepts clearly to stakeholders
• Design data pipelines with scalability, resilience and efficiency
• Implement data security standards and privacy compliance

Skills

Python

SQL

Spark

Java

Scala

Data pipelines

NoSQL

Education

Bachelor's degree or higher in CS or related field

Tools

Databricks

Snowflake

Redshift

EMR

Airflow

Dagster

Glue

MongoDB

Cassandra

DynamoDB

Job description

Capital One is seeking a Data Engineer 4 (Manager, IC) to lead and contribute across data engineering initiatives. You will design and deliver cloud-first data solutions, mentor others, and collaborate with product managers and software engineers to enable scalable, secure data pipelines across the organization.

The role emphasizes independent delivery, architecture of common data patterns, and clear communication with stakeholders to align data outcomes with business goals.