Senior Gen AI Platform Engineer

Capital One National Association; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 for Gen AI Platform Services in New York, NY. You will partner with engineers, scientists, PMs, and managers to build AI-powered products and scalable AI infrastructure.

Responsibilities include training foundations models, LLM inference, and multi-model orchestration with governance and observability. You should have 6+ years in AI/ML, strong Python/Java/CUDA skills, and experience deploying scalable AI on cloud platforms.

Qualifications

• Bachelor's or Master's degree in a relevant field plus years of AI/ML experience.
• Experience with Python, Go, Scala, CUDA, or Java.
• Experience designing and deploying AI systems at scale.
• Ability to lead and collaborate with cross-functional teams.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI technologies.
• Optimize foundation model performance for cost, latency, throughput.
• Contribute to the technical vision and long-term roadmap.
• Design and optimize multi-model orchestration pipelines.
• Establish cost-performance governance for AI systems.
• Mentor other AI engineers and elevate technical maturity.

Skills

Foundation models

LLM inference

Agent workflows

VectorDBs

Guardrails

Model evaluation

Observability

Open Source

PyTorch

HuggingFace

AWS Ultraclusters

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS

Google Cloud

Azure

HuggingFace

PyTorch

VectorDBs

Job description

Capital One is seeking an AI Engineer 5 for Gen AI Platform Services in New York, NY. You will partner with engineers, scientists, PMs, and managers to build AI-powered products and scalable AI infrastructure.

Responsibilities include training foundations models, LLM inference, and multi-model orchestration with governance and observability. You should have 6+ years in AI/ML, strong Python/Java/CUDA skills, and experience deploying scalable AI on cloud platforms.