Senior AI Engineer - LLMs, Pipelines & Scale

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 in New York, NY to help build responsible AI systems. You will design, develop, and optimize AI software components, including foundation models, inference, agents, and vector search, while collaborating with engineers, researchers, PMs, and data scientists.

You will leverage a broad stack (PyTorch, Huggingface, VectorDBs) and focus on scalable, cost-efficient production AI systems, contributing to the long-term roadmap and governance of AI initiatives.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with at least 6 years of AI/ML experience, or Master's with at least 4 years of AI/ML experience
• 6+ years of programming experience in Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, PyTorch)
• Develop foundation model optimization techniques to improve performance and cost
• Lead governance reviews and ensure AI engineering standards

Skills

Python

Go

Scala

CUDA

Java

AI/ML algorithms

Education

Bachelor's degree or higher in CS/AI/EE/CE or related fields

Master's degree in CS/AI/EE/CE or related fields + 4+ years

Tools

Huggingface

PyTorch

AWS Ultraclusters

VectorDBs

Job description

Capital One is seeking an AI Engineer 5 in New York, NY to help build responsible AI systems. You will design, develop, and optimize AI software components, including foundation models, inference, agents, and vector search, while collaborating with engineers, researchers, PMs, and data scientists.

You will leverage a broad stack (PyTorch, Huggingface, VectorDBs) and focus on scalable, cost-efficient production AI systems, contributing to the long-term roadmap and governance of AI initiatives.