Senior AI Platform Engineer – Agentic Systems

Capital One National Association; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 to help build responsible, scalable AI systems within Gen AI Platform Services: Agentic Systems. You will design, develop, test, and deploy AI software components, including foundation model training, LLM inference, and multi-model orchestration.

The role requires deep Python and Java expertise, cloud platforms, and a track record delivering production AI systems. You will mentor engineers and contribute to governance, observability, and cost-performance

Qualifications

• Bachelor's degree or Master's with required years in CS/AI/EE/CE or related field and relevant experience.
• 6+ years programming experience in Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
• Invent and introduce state-of-the-art foundation model optimization techniques to improve the performance - scalability, cost, latency, throughput - of large scale production AI systems.
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.
• Design, implement and optimize multi-model orchestration pipelines - integrating LLMs, vector search, and domain-specific models into unified systems
• Establish and lead cost-performance governance reviews across AI systems, tracking GPU utilization, model throughput, and inference cost efficiency
• Lead team design councils or design review boards to ensure technical consistency and compliance with AI engineering standards
• Mentor Principal and Manager-level AI engineers, fostering cross-domain learning and elevating organizational technical maturity

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's Degree in CS/AI/EE/CE or related fields + 6+ years experience

Master's Degree in CS/AI/EE/CE or related fields + 4+ years experience

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 5 to help build responsible, scalable AI systems within Gen AI Platform Services: Agentic Systems. You will design, develop, test, and deploy AI software components, including foundation model training, LLM inference, and multi-model orchestration.

The role requires deep Python and Java expertise, cloud platforms, and a track record delivering production AI systems. You will mentor engineers and contribute to governance, observability, and cost-performance