Senior AI Engineer: Scalable LLM & Foundation Models

Capital One National Association

New York (NY)

On-site

USD 251,000 - 286,000

Full time

7 days ago

Be an early applicant

Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Capital One is building responsible AI systems to transform banking with real-time, personalized experiences. The IFX team drives AI engineering across the company, delivering foundation models, inference, and scalable AI platforms.

You will mentor senior engineers and shape technical strategy while delivering working AI products for customers and associates. The role partners with engineers, researchers, and product managers to push the boundaries of AI in production, focusing on performance,

Qualifications

Bachelor's degree in CS/AI/EE/CE with 6+ years AI/ML experience OR Master’s with 4+ years AI/ML experience.
6+ years of experience programming with Python, Go, Scala, CUDA, or Java.

Responsibilities

Partner with cross-functional teams to deliver AI-powered products.
Design, develop, test, deploy, and support AI software components including training and inference.
Leverage OSS/SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, PyTorch).
Invent and optimize foundation model techniques for better performance, cost, latency, and throughput.
Contribute to the long-term roadmap of foundational AI systems at Capital One.
Design and optimize multi-model orchestration pipelines.
Establish cost-performance governance across AI systems.
Lead design reviews to maintain engineering standards.
Mentor Principal and Manager-level AI engineers.