Senior AI Foundations Engineer – LLM Core & Agentic AI

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One's Intelligent Foundations and Experiences (IFX) team is seeking a seasoned AI/ML engineer to build and deploy AI-powered products that transform how our associates work and how customers interact with Capital One.

You will design, develop, test, and deploy AI components, including foundation models, inference, and multi-agent workflows, using a broad stack of Open Source and SaaS AI technologies.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, or related fields.
• 4+ years of experience developing AI/ML algorithms or technologies.
• Proficiency in Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI technologies (e.g., AWS Ultraclusters, Huggingface, VectorDBs, PyTorch).
• Invent and apply foundation model optimization techniques for performance and cost.
• Own end-to-end architecture for complex AI systems with observability and governance.
• Define and maintain SLOs for AI reliability including latency and drift.
• Collaborate with infrastructure to optimize GPU/TPU usage and inference pipelines.
• Lead technical reviews for new AI deployments focusing on security and data governance.
• Mentor senior engineers on scalable design and production translation.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science

Job description

Capital One's Intelligent Foundations and Experiences (IFX) team is seeking a seasoned AI/ML engineer to build and deploy AI-powered products that transform how our associates work and how customers interact with Capital One.

You will design, develop, test, and deploy AI components, including foundation models, inference, and multi-agent workflows, using a broad stack of Open Source and SaaS AI technologies.