Lead Data Engineer: Cloud Pipelines & ML Impact

Capital One; McLean (VA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking experienced Data Engineers in the McLean, VA area to join a fast-paced, cloud-first data engineering team. You will design, build, and optimize data pipelines and platforms, collaborating with product managers, developers, and data scientists to deliver scalable data solutions that empower millions of customers.

A strong foundation in Python, SQL and distributed data systems is essential, with experience in cloud data warehousing and real-time data processing highly

Qualifications

• Bachelor's Degree or higher in Computer Science or related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• At least 4 years of experience in application development (Internship experience does not apply)
• At least 2 years of experience in distributed data
• At least 2 years of experience with SQL
• At least 2 years of experience with one programming language (Python, Java, or Scala)
• At least 2 years of experience in data pipeline design and development
• At least 1 year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support data solutions
• Influence a team of developers, data analysts and data scientists
• Utilize Python and Spark with cloud data warehousing platforms like Databricks and Snowflake
• Design and deliver cloud data solutions with minimal supervision
• Architect and enforce data engineering design patterns for quality and reuse
• Communicate technical data concepts clearly to stakeholders
• Build scalable, resilient data pipelines with emphasis on performance
• Implement data security standards including encryption and access control

Skills

Python

SQL

Spark

Data pipelines

Data modeling

Distributed systems

Education

Bachelor's degree or higher in CS or quantitative field

Tools

Databricks

Snowflake

EMR

Spark

Dagster/Airflow

Job description

Capital One is seeking experienced Data Engineers in the McLean, VA area to join a fast-paced, cloud-first data engineering team. You will design, build, and optimize data pipelines and platforms, collaborating with product managers, developers, and data scientists to deliver scalable data solutions that empower millions of customers.

A strong foundation in Python, SQL and distributed data systems is essential, with experience in cloud data warehousing and real-time data processing highly