Data Engineer 5 (Python, SQL, Databricks, Snowflake)

DataJobs; Richmond (VA); On-site; USD 209,000 - 239,000; Full time

Job summary

Capital One’s Capital One Enterprise Platforms Technology team is building an AI-enabling data ecosystem that can support modern machine learning and Large Language Model workloads. As a Data Engineer 5, you will help design and deliver resilient, scalable batch and real-time pipelines and streaming architectures that turn executive data needs into production-ready systems.

This role is based in Richmond, VA (onsite).

Qualifications

• Bachelor’s Degree or higher in Computer Science or related quantitative field.
• 6+ years of experience in application development.
• 4+ years of experience in distributed data.
• 4+ years of experience with SQL.
• 4+ years programming with Python, Java, or Scala.
• 4+ years designing and developing data pipelines.
• 2+ years in data modeling and end-to-end data solutions using relational and non-relational databases.

Responsibilities

• Architect, build, and scale latency-optimized data pipelines for batch and real-time use cases.
• Design pipelines for structured, semi-structured, and unstructured data for AI/ML applications and LLMs.
• Help define the architectural blueprint for the Top of House AI data layer.
• Act as hands-on tech lead mentoring junior and mid-level engineers on coding standards.
• Collaborate with Enterprise Security and Data Governance on data classification, privacy safeguards, and automated lineage tracking.
• Build and maintain scalable feature stores for real-time inferencing and offline training.
• Audit and optimize cross-cloud data pipelines, query performance, and storage infrastructure for efficiency and reliability.
• Work with TPMs, DSs, Top of House leads, and C-suite stakeholders to translate executive data requirements into production-ready solutions.

Skills

Python

SQL

Databricks

Snowflake

Java

Scala

AWS

Microsoft Azure

Google Cloud

Education

Bachelor’s Degree or higher

Master’s Degree

Tools

Python

SQL

Databricks

Snowflake

Java

Scala

AWS

Microsoft Azure

Google Cloud

Job description

Capital One’s Enterprise Platforms Technology team is building an AI-enabling data ecosystem that can support modern machine learning and Large Language Model workloads. As a Data Engineer 5, you will help design and deliver resilient, scalable batch and real-time pipelines and streaming architectures that turn executive data needs into production-ready systems.

This role is based in Richmond, VA (onsite). The salary range for this location is USD 209,000 - 238,500 per year, with additional eligibility for performance-based incentive compensation that may include cash bonuses and/or long-term incentives (LTI).

What you will do

• Architect, build, and scale clean, reliable, and latency-optimized data pipelines for both batch and real-time use cases.
• Design pipelines to deliver structured, semi-structured, and unstructured data for AI/ML applications and LLMs.
• Help define the architectural blueprint for the Top of House AI data layer.
• Act as a hands-on technical lead, mentoring junior and mid-level engineers on coding standards, design patterns, and engineering excellence.
• Collaborate with Enterprise Security and Data Governance to implement data classification, privacy safeguards, and automated lineage tracking for AI models and training datasets.
• Build and maintain scalable feature stores for both real-time inferencing and offline model training.
• Audit and optimize cross-cloud data pipelines, query performance, and storage infrastructure to improve efficiency, cost management, and reliability.
• Work with Technical Program Managers, Data Scientists, Top of House leads, and C-suite stakeholders to translate executive data requirements into production-ready solutions.

Minimum qualifications

• Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• 6+ years of experience in application development (internship experience does not apply)
• 4+ years of experience in distributed data
• 4+ years of experience with SQL
• 4+ years programming with at least one of: Python, Java, or Scala
• 4+ years designing and developing data pipelines
• 2+ years in data modeling and designing end-to-end data solutions using both relational and non-relational database systems

Technologies

• Python, SQL, Databricks, Snowflake
• Java, Scala
• AWS, Microsoft Azure, Google Cloud

Preferred qualifications

• Master’s Degree in a related field
• 9+ years of application development experience including Python, SQL, Scala, or Java
• 5+ years experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
• 5+ years working on real-time data and streaming applications
• 5+ years of data warehousing experience (for example, Snowflake)
• Experience using interactive AI tooling to improve productivity, leveraging capabilities beyond basic code completion (Claude, Gemini)

Additional details

• This role expects to accept applications for a minimum of 5 business days.
• No agencies please.
• Capital One is an equal opportunity employer committed to non-discrimination under applicable federal, state, and local laws.
• Capital One promotes a drug-free workplace.
• Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits to support total well-being.

If you need accommodations, contact Capital One Recruiting at 1-800-304-9102 or email [e-mail]. For technical support or questions about the recruiting process, email [e-mail].