Senior AI Foundations Engineer (LLM & RL)

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 to design and deliver large-scale AI systems. You will lead foundation model training, inference, and multi-agent workflows while partnering with engineers, researchers, and product teams.

The role emphasizes responsible AI, observability, and governance to ensure secure, scalable, and ethical deployments. You will optimize AI pipelines on GPU/TPU resources, collaborate on roadmaps, and mentor senior engineers.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies.
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with a cross-functional team to deliver AI-powered products for associates and customers.
• Design, develop, test, deploy, and support AI software components including foundation model training and inference.
• Leverage Open Source and SaaS AI technologies to optimize performance and scalability.
• Define and maintain service-level objectives for AI reliability and governance.

Skills

Python

Go

Scala

CUDA

Java

LLM Inference

VectorDBs

Guardrails

Education

Bachelor's degree in CS/EE/related

Master's degree in CS/AI/related

Tools

AWS

HuggingFace

PyTorch

VectorDBs

Job description

Capital One is seeking an AI Engineer 4 to design and deliver large-scale AI systems. You will lead foundation model training, inference, and multi-agent workflows while partnering with engineers, researchers, and product teams.

The role emphasizes responsible AI, observability, and governance to ensure secure, scalable, and ethical deployments. You will optimize AI pipelines on GPU/TPU resources, collaborate on roadmaps, and mentor senior engineers.