Senior AI Engineer, Foundations & LLM Customization

Capital One Group; San Jose (CA); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One Group seeks an AI Engineer 5 to advance AI foundations, customization of LLMs, finite tuning, and reinforcement learning for scalable production systems. You will work with cross‑functional teams to deliver AI‑powered banking experiences and maintain responsible AI practices.

The role emphasizes building robust AI infrastructure, optimizing performance, and translating research into production solutions that impact millions of customers.

Qualifications

• Bachelor's or Master's with required years of AI/ML experience as stated in Basic Qualifications.
• 6+ years of programming experience in Python, Go, Scala, CUDA, or Java.
• Experience leading AI systems with cost, latency, throughput and accuracy tradeoffs.
• 7+ years deploying scalable AI on cloud platforms (AWS, GCP, Azure or private cloud).
• Experience designing and supporting complex AI systems and techniques (LLM Inference, VectorDBs, Guardrails, memory).
• Experience building agentic AI systems and workflows; strong communication skills.
• Ability to balance model performance and operational cost via dynamic inference strategies.

Responsibilities

• Partner with cross‑functional teams to deliver AI-powered products for associates and customers.
• Design, develop, test, deploy and support AI software components (foundation model training, LLM inference, agents, governance).
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, HuggingFace, PyTorch).
• Develop state‑of‑the‑art optimization techniques to improve performance and cost-efficiency.
• Contribute to technical vision and long‑term roadmap of foundational AI systems at Capital One.
• Design and optimize multi‑model orchestration pipelines integrating LLMs, vector search, and domain models.
• Lead cost‑per‑formance governance reviews; monitor GPU usage and inference costs.
• Lead design reviews to ensure technical consistency and AI ethics standards.
• Mentor Principal and Manager‑level AI engineers to raise organizational maturity.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

HuggingFace

VectorDBs

PyTorch

Job description

Capital One Group seeks an AI Engineer 5 to advance AI foundations, customization of LLMs, finite tuning, and reinforcement learning for scalable production systems. You will work with cross‑functional teams to deliver AI‑powered banking experiences and maintain responsible AI practices.

The role emphasizes building robust AI infrastructure, optimizing performance, and translating research into production solutions that impact millions of customers.