Senior Gen AI Platform Engineer: LLM & Orchestration

Capital One; McLean (VA); On-site; USD 140,000 - 200,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 to join the Gen AI Platform Services. You will design and deploy AI systems, work with foundation models, and help scale production-grade AI across banking products.

You will collaborate with engineers, researchers, and product managers to drive end-to-end AI capabilities, optimize performance, latency, and cost, and mentor senior engineers while shaping Capital One's AI roadmap.

Qualifications

• Bachelor’s or Master’s degree with required years in AI/ML.
• Strong programming skills in Python, Go, Scala, CUDA, or Java.
• Experience leading AI systems and cost/performance tradeoffs.
• Experience deploying scalable AI on cloud platforms.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Invent foundation model optimization techniques for performance and cost.
• Contribute to the technical vision and long-term roadmap.
• Lead multi-model orchestration pipelines integrating LLMs and vector search.
• Establish cost-performance governance reviews and monitor GPU usage.
• Mentor engineers to raise technical maturity.

Skills

Python

Go

Scala

CUDA

Java

Machine Learning

Education

Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields + 6+ years experience

Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields + 4+ years experience

Tools

AWS Ultraclusters

HuggingFace

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 5 to join the Gen AI Platform Services. You will design and deploy AI systems, work with foundation models, and help scale production-grade AI across banking products.

You will collaborate with engineers, researchers, and product managers to drive end-to-end AI capabilities, optimize performance, latency, and cost, and mentor senior engineers while shaping Capital One's AI roadmap.