AI Foundations Engineer: LLMs, VectorDBs, Production AI

Capital One; McLean (VA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 to build responsible AI systems and scalable AI infrastructure. You will collaborate with engineers, researchers, PMs, and product managers to deliver AI-powered banking experiences.

Expect to work with a broad stack including AWS, HuggingFace, PyTorch, and vector databases to optimize model performance and costs. You will mentor senior engineers and help shape the long-term AI strategy while delivering production-ready, compliant AI solutions across

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field with 6+ years AI/ML experience or Master's with 4+ years.
• 6+ years of Python, Go, Scala, CUDA, or Java experience.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, and orchestration pipelines.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, PyTorch, and VectorDBs.
• Invent and optimize foundation model techniques to improve performance, cost, latency, throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
• Lead multi-model orchestration pipelines integrating LLMs, vector search, and domain models.
• Establish cost-performance governance reviews, tracking GPU usage, model throughput, and inference cost efficiency.
• Lead design councils to ensure technical consistency with AI standards.
• Mentor senior engineers, fostering cross-domain learning and maturity.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI

Tools

AWS

Huggingface

PyTorch

VectorDBs

Job description

Capital One is seeking an AI Engineer 5 to build responsible AI systems and scalable AI infrastructure. You will collaborate with engineers, researchers, PMs, and product managers to deliver AI-powered banking experiences.

Expect to work with a broad stack including AWS, HuggingFace, PyTorch, and vector databases to optimize model performance and costs. You will mentor senior engineers and help shape the long-term AI strategy while delivering production-ready, compliant AI solutions across