Senior AI Systems Engineer - Foundation Models

Capital One Group; Northern, New York (KY, NY); Hybrid; USD 197,000 - 245,000; Full time

Job summary

Capital One is building responsible AI systems to transform banking, with a focus on scalable AI infrastructure and high-performance model deployment. You will work with engineers, researchers, and PMs to deliver AI-powered products and services.

The role emphasizes foundation model training, LLM inference, guardrails, governance, and observability, across a mature, ethical AI platform at scale.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with 4+ years of AI/ML experience, or Master's with 2+ years.
• 4+ years of programming experience in Python, Go, Scala, CUDA, or Java.
• 6+ years deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, etc).
• Experience designing, delivering, and supporting AI services and distributed systems at large scale.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including model training and inference.
• Lead reviews for new AI system deployments ensuring security, governance, and compliance.
• Mentor associates on scalable design, performance optimization, and production translation.

Skills

Python

Go

Scala

CUDA

Java

LLM Inference

VectorDBs

Guardrails

Distributed systems

Cloud platforms

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

HuggingFace

PyTorch

AWS Ultraclusters

VectorDBs

Job description

Capital One is building responsible AI systems to transform banking, with a focus on scalable AI infrastructure and high-performance model deployment. You will work with engineers, researchers, and PMs to deliver AI-powered products and services.

The role emphasizes foundation model training, LLM inference, guardrails, governance, and observability, across a mature, ethical AI platform at scale.