Senior Data Engineer – AI Pipelines & Real-Time Data

Capital One; Chicago (IL); On-site; USD 209,000 - 239,000; Full time

Job summary

Capital One is seeking a Data Engineer 5 to design and implement AI-enabled data pipelines and real-time streaming architectures that power LLM workflows and ML models. You will guide architecture, governance, and cross-functional collaboration with data scientists and analysts.

The role emphasizes scalable data foundations, cross-cloud pipelines, and cost-aware performance optimization, with opportunities to mentor junior engineers and shape enterprise data products.

Qualifications

• Bachelor's degree or higher in a quantitative field or related discipline.
• At least 6 years in application development.
• At least 4 years in distributed data and in SQL.
• Proficiency in Python, Java or Scala for data engineering tasks.
• Experience designing data pipelines and data modeling across systems.

Responsibilities

• Architect, build, and scale data pipelines for AI/ML workloads and LLMs.
• Lead architecture and guide junior engineers on standards.
• Partner with security and governance for data lineage and privacy.
• Build scalable feature stores for real-time and offline training.
• Audit cross-cloud pipelines for performance and cost efficiency.
• Collaborate with data scientists, analysts, and executives to deliver data products.

Skills

Python

SQL

Java

Scala

Distributed data

Data pipelines

Data modeling

Education

Bachelor's Degree in Computer Science or related field

Tools

Databricks

Snowflake

Cloud platforms (AWS/Azure/GCP)

Job description

Capital One is seeking a Data Engineer 5 to design and implement AI-enabled data pipelines and real-time streaming architectures that power LLM workflows and ML models. You will guide architecture, governance, and cross-functional collaboration with data scientists and analysts.

The role emphasizes scalable data foundations, cross-cloud pipelines, and cost-aware performance optimization, with opportunities to mentor junior engineers and shape enterprise data products.