Senior AI Engineer — Foundations & LLM Ops

Capital One National Association; San Jose (CA); On-site; USD 177,000 - 201,000; Full time

Job summary

Capital One seeks an AI Engineer 3 in San Jose, CA to design, develop, test, and deploy AI software components across foundation models, agents, and multi-agent workflows. You will work with Open Source and SaaS AI tech such as Huggingface, PyTorch, VectorDBs, and AWS services to optimize performance, latency, and cost.

You will collaborate with research, data engineering, and product teams to build responsible, scalable AI infrastructure while mentoring junior engineers and advancing governance

Qualifications

• Bachelor's or Master's in CS/AI or related field with relevant AI/ML experience
• 3+ years (Bachelor) or 1+ year (Master) of AI/ML algorithm development
• 3+ years of Python/Go/Scala/CUDA/Java programming

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
• Invent optimization techniques to improve performance, cost, latency, and throughput
• Contribute to the technical vision and long-term roadmap for foundational AI systems
• Lead development and benchmarking of multi-turn conversational and tool-using agent workflows
• Implement scalable pipelines for training, fine-tuning, and deployment of models
• Collaborate with research and data engineering teams to curate datasets
• Contribute to governance and security for model traceability and versioning
• Mentor junior AI engineers and promote engineering excellence

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One seeks an AI Engineer 3 in San Jose, CA to design, develop, test, and deploy AI software components across foundation models, agents, and multi-agent workflows. You will work with Open Source and SaaS AI tech such as Huggingface, PyTorch, VectorDBs, and AWS services to optimize performance, latency, and cost.

You will collaborate with research, data engineering, and product teams to build responsible, scalable AI infrastructure while mentoring junior engineers and advancing governance