Senior AI Engineer, Remote Platform & LLM Systems

Capital One; New York (NY); On-site; USD 294,000 - 335,000; Full time

Job summary

Capital One is seeking a highly technical AI engineer to help build an enterprise AI platform. You will partner with engineers, researchers, PMs to deliver AI-powered products that change how associates work and how customers interact with Capital One.

You will design and deploy AI software components, work with Open Source tools like HuggingFace, PyTorch, and VectorDBs, and push state-of-the-art optimization techniques.

Qualifications

• Bachelor's degree in CS/Engineering/AI with 8+ years AI/ML experience
• 8+ years programming in Python/Go/Scala/Java
• 8 years deploying AI on cloud (AWS/GCP/Azure)
• Experience leading engineering teams up to VP level
• Experience with LLM inference, VectorDBs, Guardrails
• Master's degree in CS/CE or related field
• Experience optimizing training/inference for performance and cost
• Strong communication skills

Responsibilities

• Deliver AI-powered products with cross-functional teams
• Design, develop, test, deploy AI software components
• Leverage open source and SaaS AI technologies
• Invent LLM optimization techniques for performance and cost
• Contribute to long-term AI systems roadmap

Skills

Python

Go

Scala

Java

AI/ML

Cloud platforms

Education

Bachelor's degree in Computer Science, Engineering, or AI

Master's degree in Computer Science, Computer Engineering, or relevant field

Tools

AWS Ultraclusters

HuggingFace

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a highly technical AI engineer to help build an enterprise AI platform. You will partner with engineers, researchers, PMs to deliver AI-powered products that change how associates work and how customers interact with Capital One.

You will design and deploy AI software components, work with Open Source tools like HuggingFace, PyTorch, and VectorDBs, and push state-of-the-art optimization techniques.