Senior AI Engineer: LLMs, Fine-Tuning & RL Architect

Capital One; San Jose (CA); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 to advance AI foundations with a focus on LLM customization, finetuning, and reinforcement learning. You will collaborate with engineers, researchers, TPMs, and product managers to ship AI-powered products that transform how associates and customers interact with Capital One's services.

You will design and deploy AI components, optimize performance and cost, and mentor senior engineers while contributing to the long-term AI strategy.

Qualifications

• Bachelor's or Master's degree with relevant AI/ML experience.
• 6+ years of experience developing AI and ML algorithms.
• 6+ years of experience programming Python/Go/Scala/CUDA/Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, PyTorch).
• Invent optimization techniques to improve performance, cost, latency, and throughput in large-scale AI systems.
• Contribute to long-term roadmap of foundational AI systems at Capital One.
• Design and optimize multi-model orchestration pipelines across LLMs and vector search.
• Lead governance reviews on GPU utilization, model throughput, and cost efficiency.
• Mentor engineers to raise technical maturity across teams.

Skills

Python

Go

Scala

CUDA

Java

AI/ML algorithms

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

LLM Inference

Guardrails

Memory

Job description

Capital One is seeking an AI Engineer 5 to advance AI foundations with a focus on LLM customization, finetuning, and reinforcement learning. You will collaborate with engineers, researchers, TPMs, and product managers to ship AI-powered products that transform how associates and customers interact with Capital One's services.

You will design and deploy AI components, optimize performance and cost, and mentor senior engineers while contributing to the long-term AI strategy.