Senior AI Foundations & LLM Architect (Agentic AI)

Capital One Group; Northern, New York (KY, NY); Hybrid; USD 197,000 - 246,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 to help build responsible AI foundations and agentic architectures. You will design and deploy AI software components, including foundation model training, large language model inference, and multi-agent workflows.

Join a cross-functional team working with AWS, HuggingFace, VectorDBs, PyTorch, and more to optimize performance, cost, and reliability. You will mentor junior staff, help define SLOs, and ensure governance and ethics are embedded in scalable AI

Qualifications

• Bachelor's or Master's in a relevant field and strong AI/ML fundamentals.
• Experience with Python and at least a couple of programming languages listed.
• Experience deploying scalable AI solutions in cloud environments.

Responsibilities

• Design, develop, test, deploy, and support AI software components.
• Lead cross-functional reviews for new AI system deployments.
• Mentor engineers on scalable design and production translation.
• Collaborate to optimize GPU/TPU utilization and model inference pipelines.

Skills

Python

Go

Scala

CUDA

Java

C++

C#

Golang

LLM Inference

VectorDBs

Guardrails

Memory

Huggingface

AWS

GPU/TPU optimization

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS

Google Cloud

Azure

HuggingFace

CUDA

Distributed systems

Job description

Capital One is seeking an AI Engineer 4 to help build responsible AI foundations and agentic architectures. You will design and deploy AI software components, including foundation model training, large language model inference, and multi-agent workflows.

Join a cross-functional team working with AWS, HuggingFace, VectorDBs, PyTorch, and more to optimize performance, cost, and reliability. You will mentor junior staff, help define SLOs, and ensure governance and ethics are embedded in scalable AI