AI Engineer 5

Capital One Group; San Jose (CA); On-site; USD 170,000 - 210,000; Full time

Job summary

Capital One Group is seeking a senior AI/ML engineer to design, deploy, and optimize large-scale AI and ML systems in production. You will balance performance, cost, latency, and throughput while driving responsible AI practices across production pipelines.

You will work with Python, Go, Scala, CUDA, Java and cloud platforms (AWS/GCP/Azure) to build agentic workflows, memory and vector search components, and robust guardrails. Excellent communication and collaboration are essential.

Qualifications

• Degree requirements: Bachelor or Master in CS/AI/EE/CE or related fields with relevant AI/ML experience.
• 6+ years developing AI/ML systems; 4+ years with a Master's degree.
• Experience deploying scalable AI on cloud platforms and optimizing for cost, latency, and throughput.

Skills

Python

Go

Scala

CUDA

Java

ML systems

LLM Inference

VectorDBs

Cloud platforms

Performance tuning

Agentic AI

Explainability

Model compression

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS

Google Cloud

Azure

Kubernetes

Docker

Job description

* You love to build systems, take pride in the quality of your work, and also share our passion to do the right thing. You want to work on problems that will help change banking for good* Passion for staying abreast of the latest research, and an ability to intuitively understand scientific publications and judiciously apply novel techniques in production* You adapt quickly and thrive on bringing clarity to big, undefined problems. You love asking questions and digging deep to uncover the root of problems and can articulate your findings concisely with clarity. You have the courage to share new ideas even when they are unproven* You are deeply Technical. You possess a strong foundation in engineering and mathematics, and your expertise in hardware, software, and AI enables you to see and exploit optimization opportunities that others miss* You are a resilient trailblazer who can forge new paths to achieve business goals when the route is unknown* Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies* At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java* Experience leading development AI systems with tradeoff decisions around cost, latency, throughput and accuracy* 7+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud)* Experience designing, developing, delivering, and supporting complex AI systems* Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, CUDA, or Golang* Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost* Experience in building agentic AI systems and agentic workflows* Passion for staying abreast of the latest AI research and AI systems, and judiciously apply novel techniques in production* Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers* Experience architecting and integrating heterogeneous AI systems - including rule-based, retrieval-augmented, and generative components - into unified production pipelines* Experience defining and enforcing standards for ethical AI deployment, including explainability, fairness, and human-in-the-loop review processes* Demonstrated ability to balance model performance and operational cost through dynamic inference strategies and model compression* Experience right-sizing models, instance counts, and hardware types given requirements (e.g., context length, token inputs, token outputs)Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.