Senior AI Engineer - Scalable ML & LLM Systems

Capital One; New York (NY); On-site; USD 250,800 - 286,200; Full time

Job summary

Capital One is seeking a Sr Lead AI Engineer in New York, NY to collaborate with engineers, researchers, PMs, and stakeholders on AI-powered products. You will design, train, deploy, and optimize scalable AI systems and contribute to a responsible AI strategy.

Lead efforts in LLM inference, guardrails, vector databases, and performance optimization, using PyTorch, HuggingFace, and AWS across locations including New York.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI/ML algorithms or a Master's with at least 4 years.
• Experience programming in Python, Go, Scala, or Java (6+ years).
• Experience deploying scalable AI/ML systems on cloud platforms and leading teams.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, and observability.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, and PyTorch.
• Invent state-of-the-art LLM optimization techniques to improve performance, scalability, latency, throughput and cost.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Skills

Python

Go

Scala

Java

Engineering

Mathematics

Education

Bachelor's degree in CS/AI/EE or related

Master's degree in CS/AI/EE or related

Tools

AWS

HuggingFace

PyTorch

VectorDBs

Nemo Guardrails

Job description

Capital One is seeking a Sr Lead AI Engineer in New York, NY to collaborate with engineers, researchers, PMs, and stakeholders on AI-powered products. You will design, train, deploy, and optimize scalable AI systems and contribute to a responsible AI strategy.

Lead efforts in LLM inference, guardrails, vector databases, and performance optimization, using PyTorch, HuggingFace, and AWS across locations including New York.