Senior AI Engineer: Scalable, Production-Grade AI

Capital One Group; San Jose (CA); On-site; USD 170,000 - 210,000; Full time

Job summary

Capital One Group is seeking a senior AI/ML engineer to design, deploy, and optimize large-scale AI and ML systems in production. You will balance performance, cost, latency, and throughput while driving responsible AI practices across production pipelines.

You will work with Python, Go, Scala, CUDA, Java and cloud platforms (AWS/GCP/Azure) to build agentic workflows, memory and vector search components, and robust guardrails. Excellent communication and collaboration are essential.

Qualifications

• Degree requirements: Bachelor or Master in CS/AI/EE/CE or related fields with relevant AI/ML experience.
• 6+ years developing AI/ML systems; 4+ years with a Master's degree.
• Experience deploying scalable AI on cloud platforms and optimizing for cost, latency, and throughput.

Skills

Python

Go

Scala

CUDA

Java

ML systems

LLM Inference

VectorDBs

Cloud platforms

Performance tuning

Agentic AI

Explainability

Model compression

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS

Google Cloud

Azure

Kubernetes

Docker

Job description

Capital One Group is seeking a senior AI/ML engineer to design, deploy, and optimize large-scale AI and ML systems in production. You will balance performance, cost, latency, and throughput while driving responsible AI practices across production pipelines.

You will work with Python, Go, Scala, CUDA, Java and cloud platforms (AWS/GCP/Azure) to build agentic workflows, memory and vector search components, and robust guardrails. Excellent communication and collaboration are essential.