Senior Gen AI Platform Engineer

Capital One; San Francisco (CA); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 to help build and scale AI-powered products. You will partner with cross-functional teams to deliver foundation model training, large language model inference, agents, and multi-agent workflows, while ensuring governance and observability across platforms.

You will work with a broad stack including AWS, HuggingFace, PyTorch, and VectorDBs to optimize latency, throughput, and cost in production AI systems, contributing to Capital One's responsible AI

Qualifications

• Bachelor's or master's degree in a related field with experience in AI/ML.
• Strong programming skills in Python and at least one other language.
• Experience deploying scalable AI systems on cloud platforms.

Responsibilities

• Design, develop, test, deploy, and support AI software components.
• Work on foundation model training, inference, and agent workflows.
• Optimize performance, latency, and cost for production AI systems.
• Collaborate on governance, security, and data compliance.

Skills

Python

Go

Scala

CUDA

Java

LLM Inference

VectorDBs

Guardrails

Memory

AWS

GCP

Azure

Education

Bachelor's degree in Computer Science or related fields

Master's degree in Computer Science or related fields

Tools

PyTorch

HuggingFace

Open Source AI stacks

Job description

Capital One is seeking an AI Engineer 4 to help build and scale AI-powered products. You will partner with cross-functional teams to deliver foundation model training, large language model inference, agents, and multi-agent workflows, while ensuring governance and observability across platforms.

You will work with a broad stack including AWS, HuggingFace, PyTorch, and VectorDBs to optimize latency, throughput, and cost in production AI systems, contributing to Capital One's responsible AI