Senior AI Platform Engineer: LLM Foundations & Finetuning

Capital One; San Jose (CA); On-site; USD 140,000 - 180,000; Full time

Job summary

Capital One seeks an AI Engineer 4 to build responsible, scalable AI systems that power real-time customer experiences in banking. You will work with engineers, researchers, and product managers to deploy foundation models, multi-agent workflows, and efficient inference pipelines across cloud and on-prem environments.

You will emphasize governance, security, and observability while driving innovations in model optimization and end-to-end system design.

Qualifications

• Bachelor's or Master's in CS/AI/EE with 4+ years of AI/ML experience
• 4+ years of experience programming with Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with a cross-functional team of engineers, researchers, PMs, and APMs to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, and observability.
• Leverage OSS and SaaS AI technologies such as AWS Ultraclusters, HuggingFace, VectorDBs, PyTorch, etc.
• Invent state-of-the-art foundation model optimization techniques to improve performance, scalability, cost, latency, throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems.
• Own end-to-end architecture for complex AI systems with maintainability, observability, and ethical alignment.
• Define and maintain SLOs for AI reliability including latency, uptime, and model drift.
• Collaborate with infrastructure to optimize GPU/TPU utilization and accelerate inference pipelines.
• Lead cross-functional technical reviews for new AI deployments ensuring security, governance, and compliance.
• Mentor Principal and Senior Associates on scalable design and production translation.

Skills

Cross-functional collaboration

Mentoring

System design

Problem solving

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

Python

Go

Scala

CUDA

Java

PyTorch

HuggingFace

AWS

Google Cloud

Azure

VectorDBs

Ultraclusters

Job description

Capital One seeks an AI Engineer 4 to build responsible, scalable AI systems that power real-time customer experiences in banking. You will work with engineers, researchers, and product managers to deploy foundation models, multi-agent workflows, and efficient inference pipelines across cloud and on-prem environments.

You will emphasize governance, security, and observability while driving innovations in model optimization and end-to-end system design.