Senior AI Engineer - LLM Inference & Scalable AI Systems

Capital One National Association; McLean (VA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 to help build and scale responsible AI systems. You will collaborate with cross-functional teams on foundation models, LLM inference, and multi-model orchestration within a scalable AI infrastructure. The role emphasizes performance, cost, governance, and responsible deployment.

You will mentor engineers and contribute to the long-term AI strategy, with a focus on safeguarding reliability and customer impact across Capital One’s platforms.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 6+ years of AI/ML experience, or Master's plus 4+ years.
• 6+ years of experience programming in Python, Go, Scala, CUDA, or Java.

Responsibilities

• Collaborate with engineers, researchers, PMs, and product managers to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including LLM inference and multi-agent workflows.
• Leverage Open Source and SaaS AI tech like HuggingFace, PyTorch, VectorDBs for production.
• Optimize foundation model performance, latency, and cost in large-scale systems.
• Contribute to long-term AI systems roadmap and governance.

Skills

Python

Go

Scala

CUDA

Java

LLM Inference

VectorDBs

HuggingFace

PyTorch

AWS Ultraclusters

Education

Bachelor's degree in CS/AI/EE/CE or related field

Master's degree in CS/AI/EE/CE or related field

Tools

AWS Ultraclusters

HuggingFace

PyTorch

VectorDBs

Job description

Capital One is seeking an AI Engineer 5 to help build and scale responsible AI systems. You will collaborate with cross-functional teams on foundation models, LLM inference, and multi-model orchestration within a scalable AI infrastructure. The role emphasizes performance, cost, governance, and responsible deployment.

You will mentor engineers and contribute to the long-term AI strategy, with a focus on safeguarding reliability and customer impact across Capital One’s platforms.