Senior AI Foundations Engineer - LLM & Agents

Capital One; McLean (VA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 to advance AI foundations, including LLM customization, finetuning, and RL workflows, in McLean, VA. You will design, implement, and optimize production-grade AI systems across a broad tech stack, from model training to inference, with observability and governance built in.

Collaborating with engineers, researchers, PMs, and designers, you will push for scalable, cost-efficient AI solutions that raise the bar for customer experiences while upholding

Qualifications

• Bachelors with 6+ years or Masters with 4+ years in AI/ML development.
• Experience programming with Python, Go, Scala, CUDA or Java.

Responsibilities

• Deliver AI-powered products with cross-functional teams.
• Design, develop, test, deploy and support AI software components.
• Leverage Open Source and SaaS AI tech like HuggingFace and PyTorch.
• Optimize foundation model performance, cost, latency and throughput.
• Contribute to long-term AI system roadmaps.
• Lead multi-model orchestration pipelines and governance.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master’s degree in Computer Science, AI, Electrical Engineering, or related fields

Tools

Huggingface

PyTorch

VectorDBs

AWS Ultraclusters

Job description

Capital One is seeking an AI Engineer 5 to advance AI foundations, including LLM customization, finetuning, and RL workflows, in McLean, VA. You will design, implement, and optimize production-grade AI systems across a broad tech stack, from model training to inference, with observability and governance built in.

Collaborating with engineers, researchers, PMs, and designers, you will push for scalable, cost-efficient AI solutions that raise the bar for customer experiences while upholding