Senior Lead AI Engineer — Foundational AI & LLM Platforms

Information Technology Senior Management Forum; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking a Senior Lead AI Engineer to drive AI foundations, training, inference, and optimization at scale. You will partner with engineers, researchers, and product teams to deliver responsible AI capabilities that enhance customer experiences.

The role requires strong Python/Java, cloud experience, and expertise in LLMs, VectorDBs, and guardrails to advance our AI roadmap. Location: New York area with competitive compensation.

Qualifications

• Bachelor's degree in CS/AI/EE/CE or related field with 6+ years in AI/ML development.
• 6+ years programming with Python, Go, Scala, or Java.
• Experience deploying scalable and responsible AI on cloud platforms (AWS, GCP, Azure).

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI tech like AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch.
• Invent state-of-the-art LLM optimization techniques for production systems.
• Contribute to the long-term roadmap of foundational AI systems.

Skills

Python

Go

Scala

Java

Cloud platforms

LLM Inference

Similarity Search

VectorDBs

Guardrails

Memory

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Huggingface

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a Senior Lead AI Engineer to drive AI foundations, training, inference, and optimization at scale. You will partner with engineers, researchers, and product teams to deliver responsible AI capabilities that enhance customer experiences.

The role requires strong Python/Java, cloud experience, and expertise in LLMs, VectorDBs, and guardrails to advance our AI roadmap. Location: New York area with competitive compensation.