Senior Data Engineer Python, AWS, Spark & Databricks

Capital One; McLean (VA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One in McLean, VA is seeking a Data Engineer 4 to design and build scalable, cloud-first data solutions that power hyper-personalized marketing and adtech platforms. You will work with Python, SQL, Scala, Spark, Databricks and Snowflake, delivering real-time data pipelines and lakehouse architectures.

You’ll champion governance, security, and data quality, mentor teams, and partner with product managers to deliver trusted data products and measurable business impact.

Qualifications

• Bachelor’s degree or higher in CS or related quantitative field.
• 4+ years of application development experience; 2+ years in distributed data.
• 2+ years SQL; 2+ years in one programming language (Python/Java/Scala).

Responsibilities

• Architect and build cloud-first data solutions, lakehouse architectures, and real-time pipelines.
• Lead cross-functional Agile teams, enforce data engineering design patterns, ensure quality.
• Leverage Python, SQL, Scala, Spark, and platforms like Databricks and Snowflake.
• Uphold data governance, security, and permissible use standards.
• Collaborate with product managers and software engineers to deliver robust data products.

Skills

Python

SQL

Scala

Spark

Agile

Data governance

Education

Bachelor's degree or higher in Computer Science or related field

Master’s degree (preferred)

Tools

Databricks

Snowflake

Kafka

Airflow

Job description

Capital One in McLean, VA is seeking a Data Engineer 4 to design and build scalable, cloud-first data solutions that power hyper-personalized marketing and adtech platforms. You will work with Python, SQL, Scala, Spark, Databricks and Snowflake, delivering real-time data pipelines and lakehouse architectures.

You’ll champion governance, security, and data quality, mentor teams, and partner with product managers to deliver trusted data products and measurable business impact.