Senior AI Engineer: Scalable AI & LLM Systems

Capital One; Illinois; On-site; USD 230,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer to design, develop, test, and deploy AI software components including foundation models, LLM inference, and multi-agent workflows. You will collaborate with engineers, researchers, PMs, and product managers to deliver AI-powered products that enhance how associates work and how customers interact with Capital One.

You should have strong programming in Python, Java, and CUDA, plus experience with PyTorch, vector databases, and guardrails.

Qualifications

• Bachelor's degree in CS/AI/EE/CE with 6+ years of AI/ML development experience, or Master's with 4+ years.
• 6+ years of programming experience in Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that change how associates work and customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents, and multi-agent workflows.
• Invent and apply state-of-the-art foundation model optimization techniques to improve performance, latency, throughput, and cost.
• Contribute to the technical vision and long-term roadmap of foundational AI systems.
• Lead multi-model orchestration pipelines and cost-performance governance reviews.

Skills

Python

Go

Scala

CUDA

Java

ML algorithms

Cloud platforms

Education

Bachelor's degree in Computer Science / AI / Electrical Engineering / Computer Engineering or related fields

Master's degree in Computer Science / AI / Electrical Engineering / Computer Engineering or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer to design, develop, test, and deploy AI software components including foundation models, LLM inference, and multi-agent workflows. You will collaborate with engineers, researchers, PMs, and product managers to deliver AI-powered products that enhance how associates work and how customers interact with Capital One.

You should have strong programming in Python, Java, and CUDA, plus experience with PyTorch, vector databases, and guardrails.