Senior AI Foundations Engineer — Lead Scalable AI

Energy Jobline ZR; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One in New York is seeking a Sr. Lead AI Engineer (AI Foundations) to design and deploy scalable AI systems across the enterprise, partnering with engineers, researchers, and product teams to deliver AI-powered experiences.

You will work with a broad stack including AWS ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, PyTorch, and advanced LLM optimization techniques to improve latency, throughput, and cost.

Qualifications

• Bachelor's or Master's degree with required AI/ML experience
• 6+ years Python/Go/Scala/Java experience
• Experience deploying scalable AI/ML solutions on cloud platforms

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components including foundation model training/inference
• Invent and apply state-of-the-art LLM optimization techniques to improve performance, latency, throughput and cost
• Contribute to the technical vision and long-term roadmap of foundational AI systems

Skills

Python

Go

Scala

Java

ML algorithms

LLM optimization

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

HuggingFace

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One in New York is seeking a Sr. Lead AI Engineer (AI Foundations) to design and deploy scalable AI systems across the enterprise, partnering with engineers, researchers, and product teams to deliver AI-powered experiences.

You will work with a broad stack including AWS ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, PyTorch, and advanced LLM optimization techniques to improve latency, throughput, and cost.