Senior AI Engineer — LLMs, Agents & Scalable AI

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One seeks an AI Engineer 5 to help build responsible, scalable AI systems across foundations, LLM core, and agentic AI. You will collaborate with engineers, researchers, PMs, and product teams to deliver AI-powered products and platforms that impact millions of customers.

The role requires deep expertise in Python, ML architectures, and state‑of‑the‑art optimization, with leadership responsibilities to mentor senior engineers and help shape Capital One’s AI roadmap.

Qualifications

• Bachelor's or higher in a relevant field with AI/ML experience.
• Experience with Python, Go, Scala, CUDA, or Java for AI systems.
• Strong communication and ability to explain complex AI concepts.

Responsibilities

• Partner with cross‑functional teams to deliver AI‑powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage OSS and SaaS AI tech such as AWS Ultraclusters, Huggingface, PyTorch.
• Invent optimization techniques to improve performance, latency, and cost.
• Contribute to the technical vision and long-term AI roadmaps.
• Design and optimize multi‑model orchestration pipelines.
• Establish and lead governance reviews for GPU utilization and throughput.
• Mentor Principal/Manager level AI engineers to raise maturity.

Skills

Python

Go

Scala

CUDA

Java

Communication skills

Education

Bachelor's degree (CS/AI/EE/CE)

Master's degree (CS/AI/EE/CE)

Tools

AWS

HuggingFace

VectorDBs

PyTorch

Open Source / SaaS AI tech

Job description

Capital One seeks an AI Engineer 5 to help build responsible, scalable AI systems across foundations, LLM core, and agentic AI. You will collaborate with engineers, researchers, PMs, and product teams to deliver AI-powered products and platforms that impact millions of customers.

The role requires deep expertise in Python, ML architectures, and state‑of‑the‑art optimization, with leadership responsibilities to mentor senior engineers and help shape Capital One’s AI roadmap.