Senior Gen AI Platform Engineer – LLM & Orchestration

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One seeks an AI Engineer 5 for Gen AI Platform Services in New York, NY. You will partner with cross-functional teams to build and scale responsible AI systems that touch millions of customers daily.

You will work on foundation model training, inference, and multi-model orchestration, leveraging PyTorch, HuggingFace, AWS, and VectorDBs to deliver scalable, compliant AI solutions.

Qualifications

• Bachelor's or Master's in CS/AI/EE/CE or related field with years of AI/ML experience.
• Strong Python/Go/Scala/CUDA/Java and ML framework proficiency.
• Experience building production AI systems with scalable architectures.

Responsibilities

• Deliver AI-powered products with cross-functional teams.
• Design, develop, test, deploy, and support AI software components.
• Implement foundation model training, LLM inference, and agents.
• Leverage OSS and SaaS tools like AWS, HuggingFace, PyTorch.
• Lead optimization for performance, cost, latency, and throughput.
• Mentor engineers and contribute to the AI platform roadmap.

Skills

Python

Go

Scala

CUDA

Java

MLOps

System design

Education

Bachelor's degree in CS/AI/EE/CE or related field

Master's degree in CS/AI/EE/CE or related field

Tools

AWS

Google Cloud

Azure

HuggingFace

PyTorch

VectorDBs

Job description

Capital One seeks an AI Engineer 5 for Gen AI Platform Services in New York, NY. You will partner with cross-functional teams to build and scale responsible AI systems that touch millions of customers daily.

You will work on foundation model training, inference, and multi-model orchestration, leveraging PyTorch, HuggingFace, AWS, and VectorDBs to deliver scalable, compliant AI solutions.