Senior AI Foundations Engineer (LLM & Production)

Capital One National Association; San Jose (CA); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One seeks an AI Engineer 4 to help build responsible, scalable AI systems. You will work on AI foundations, VLM customization, and end-to-end architectures for production-grade AI solutions in a cross-functional team.

You will design, train, deploy, and monitor AI components, optimize inference, and drive governance, security, and observability. This role emphasizes collaboration and leadership within the IFX team.

Qualifications

• Bachelor's degree with 4+ years in AI/ML or Master's with 2+ years in AI/ML.
• Proficient in Python, Go, Scala, CUDA, or Java for AI/ML work.
• Experience with LLM inference, vector databases, and memory techniques.
• Experience deploying scalable AI on cloud platforms like AWS/GCP/Azure.
• Familiar with AI governance, security, and reliability considerations.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products and experiences.
• Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference.
• Leverage Open Source and SaaS AI tech such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch.
• Invent foundation model optimization techniques to improve performance, latency, and cost.
• Contribute to the technical vision and long-term roadmap of foundational AI systems.
• Own end-to-end architecture for complex AI systems with maintainability and observability.
• Define and maintain SLOs for AI reliability including latency and uptime.
• Collaborate with infrastructure to optimize GPU/TPU utilization and inference pipelines.
• Lead cross-functional technical reviews for deployments ensuring security and governance.
• Mentor Principal and Senior Associates on scalable design and production translation.

Skills

Python

Go

Scala

CUDA

Java

LLM Inference

VectorDBs

Huggingface

PyTorch

Guardrails

Memory

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

CUDA

Golang

Job description

Capital One seeks an AI Engineer 4 to help build responsible, scalable AI systems. You will work on AI foundations, VLM customization, and end-to-end architectures for production-grade AI solutions in a cross-functional team.

You will design, train, deploy, and monitor AI components, optimize inference, and drive governance, security, and observability. This role emphasizes collaboration and leadership within the IFX team.