Senior Data Engineer - Python, PySpark & AWS

Capital One National Association; McLean (VA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is hiring a Data Engineer 4 in McLean, VA. You will collaborate with Agile teams to design and implement cloud-first data solutions, using Python, Spark, and platforms like Databricks and Snowflake to support business insights and customer experiences.

You’ll mentor peers, influence data architecture, and deliver scalable pipelines while ensuring security and reliability across data platforms.

Qualifications

• Bachelor's degree or higher in Computer Science or related quantitative field.
• At least 4 years of application development experience.
• At least 2 years of distributed data experience.
• At least 2 years of SQL experience.
• At least 2 years of experience in one programming language (Python, Java, or Scala).
• At least 2 years of experience in data pipeline design and development.
• At least 1 year of experience in data modeling and end-to-end data solutions.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support technical solutions.
• Influence a team with experience in ML, distributed microservices, lakehouse architecture, and full-stack systems.
• Use Python and Spark with databases and cloud-based data warehousing (Databricks, Snowflake).
• Share knowledge, stay current with data trends, and mentor others in the data community.
• Partner with product managers and software engineers to deliver cloud-first data solutions.
• Independently design and deliver data solutions with minimal supervision.
• Architect data engineering patterns to ensure quality, maintainability, and reusability.
• Communicate data outcomes clearly to stakeholders to drive alignment.
• Build scalable, resilient data pipelines with strong operational efficiency.

Skills

Python

Spark

SQL

Distributed data systems

Data modeling

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Snowflake

EMR

Glue

Dagster

MongoDB

DynamoDB

Redshift

Job description

Capital One is hiring a Data Engineer 4 in McLean, VA. You will collaborate with Agile teams to design and implement cloud-first data solutions, using Python, Spark, and platforms like Databricks and Snowflake to support business insights and customer experiences.

You’ll mentor peers, influence data architecture, and deliver scalable pipelines while ensuring security and reliability across data platforms.