Senior Gen AI Platform Engineer

Capital One; San Francisco (CA); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 to join the IFX team in San Francisco to design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents, and multi‑agent workflows.

You will work with cross‑functional teams to optimize performance, latency, cost, and observability while ensuring security, governance, and ethical alignment.

Qualifications

• Bachelor’s Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI/ML algorithms or a Master’s with 2+ years of experience.
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with a cross‑functional team of engineers, researchers, PMs, and product managers to deliver AI‑powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference.
• Invent and introduce foundation model optimization techniques to improve performance, scalability, latency, and cost.
• Define and maintain SLOs for AI reliability including latency, uptime, and model drift.
• Lead reviews for new AI deployments ensuring security, data governance and compliance.

Skills

Python

Go

Scala

CUDA

Java

LLM Inference

Agents

Education

Bachelor's Degree in CS/EE/CE or related field

Master's Degree in CS/AI/EE/CE or related field

Tools

AWS

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 4 to join the IFX team in San Francisco to design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents, and multi‑agent workflows.

You will work with cross‑functional teams to optimize performance, latency, cost, and observability while ensuring security, governance, and ethical alignment.