Senior AI Engineer: LLM & Foundation Model Ops

Capital One; McLean (VA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 to help build responsible AI systems and scalable infrastructure. You will partner with engineers, scientists, PMs, and product teams to design, develop, and deploy AI software components including foundation model training, inference, and governance.

The role emphasizes innovation, cross-team collaboration, and cost-performance optimization across AI systems, with a strong focus on reliability and scalability for banking products.

Qualifications

• Bachelor-/Master-level degree plus multiple years of AI/ML experience.
• At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.
• Experience leading AI systems and scaling AI/ML workflows in production.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model work.
• Leverage Open Source and SaaS AI tech like AWS Ultraclusters, HuggingFace, PyTorch, and VectorDBs.
• Architect multi-model orchestration pipelines and governance for AI systems.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS

Google Cloud

Azure

PyTorch

HuggingFace

VectorDBs

Job description

Capital One is seeking an AI Engineer 5 to help build responsible AI systems and scalable infrastructure. You will partner with engineers, scientists, PMs, and product teams to design, develop, and deploy AI software components including foundation model training, inference, and governance.

The role emphasizes innovation, cross-team collaboration, and cost-performance optimization across AI systems, with a strong focus on reliability and scalability for banking products.