Senior AI Engineer – Gen AI Platform & Guardrails

Capital One Group; Northern, New York (KY, NY); Hybrid; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 for Gen AI Platform Services: Agentic AI, Guardrails, Evaluation. You will design, build, test, deploy, and support AI software components including foundation model training, large language model inference, agents, and observability.

The IFX team partners across the company to deliver scalable AI systems, optimize performance and cost, and enforce responsible AI standards.

Qualifications

• Bachelor's or Master's in CS/AI/EE with relevant experience.
• 6+ years in AI/ML software development.
• 6+ years Python/Go/Scala/CUDA/Java experience.
• Experience deploying scalable AI systems on cloud platforms.

Responsibilities

• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Lead multi-model orchestration pipelines - integrating LLMs, vector search, and domain-specific models into unified systems.
• Collaborate with cross-functional teams to deliver AI-powered products that change how our associates work and how customers interact with Capital One.

Skills

Python

LLM Inference

VectorDBs

Guardrails

CUDA

Cross-functional

Education

Bachelor's in CS/AI/EE

Master's in CS/AI/EE

Tools

AWS

HuggingFace

PyTorch

VectorDBs

CUDA

Job description

Capital One is seeking an AI Engineer 5 for Gen AI Platform Services: Agentic AI, Guardrails, Evaluation. You will design, build, test, deploy, and support AI software components including foundation model training, large language model inference, agents, and observability.

The IFX team partners across the company to deliver scalable AI systems, optimize performance and cost, and enforce responsible AI standards.