Senior AI Engineer: Foundations & LLM Systems

Capital One; McLean (VA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 to help build responsible and scalable AI systems, including foundation model training, LLM inference, and agent workflows. You will collaborate with engineers, researchers, PMs, and product teams to deliver AI-powered banking experiences.

The role emphasizes cutting‑edge AI techniques, performance optimization, and governance, with opportunities to influence the architectural direction and long‑term roadmap.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies, OR a Master's degree plus at least 2 years of experience
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java
• Experience leading development AI systems with tradeoff decisions around cost, latency, throughput and accuracy

Responsibilities

• Partner with cross‑functional teams to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components (foundation model training, LLM inference, agents, similarity search, guardrails)
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, PyTorch)
• Invent state‑of‑the‑art foundation model optimization techniques for performance and cost
• Contribute to the technical vision and long‑term roadmap of foundational AI systems
• Own end‑to‑end architecture for complex AI systems with maintainability and ethics in mind
• Define and maintain service‑level objectives for AI reliability and performance
• Collaborate with infra to optimize GPU/TPU utilization and model inference pipelines
• Lead cross‑functional technical reviews to ensure security and governance
• Mentor senior engineers on scalable design and production translation

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 4 to help build responsible and scalable AI systems, including foundation model training, LLM inference, and agent workflows. You will collaborate with engineers, researchers, PMs, and product teams to deliver AI-powered banking experiences.

The role emphasizes cutting‑edge AI techniques, performance optimization, and governance, with opportunities to influence the architectural direction and long‑term roadmap.