Senior AI Foundations Engineer — LLM & RL

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 focused on AI Foundations: LLM customization, finetuning, and reinforcement learning. You will join the Intelligent Foundations and Experiences (IFX) team to deliver responsible, scalable AI systems that power banking experiences for millions of customers.

Design, implement, test, and deploy AI software components, optimize model training and inference pipelines on modern accelerators, define SLOs, ensure data governance and security, and mentor junior

Qualifications

• Bachelor's degree in CS/AI/EE/CE or related field plus relevant AI/ML development experience.
• Master's degree in CS/AI/EE/CE or related field plus relevant AI/ML development experience.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products and services.
• Design, develop, test, deploy, and support AI software components including training and inference pipelines.
• Leverage Open Source and SaaS AI tech to optimize performance, cost, latency, and throughput.
• Define and maintain architecture, SLOs, and governance for AI systems; ensure security and compliance.

Skills

Python

C++

C#

Java

CUDA

Golang

LLM Inference

Similarity Search

VectorDBs

Guardrails

Memory

Distributed Systems

Model Training

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Huggingface

PyTorch

Job description

Capital One is seeking an AI Engineer 4 focused on AI Foundations: LLM customization, finetuning, and reinforcement learning. You will join the Intelligent Foundations and Experiences (IFX) team to deliver responsible, scalable AI systems that power banking experiences for millions of customers.

Design, implement, test, and deploy AI software components, optimize model training and inference pipelines on modern accelerators, define SLOs, ensure data governance and security, and mentor junior