Senior AI Foundations & LLM Core Engineer

Capital One National Association; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One National Association is seeking an AI Engineer 4 in New York to build responsible AI systems, including foundation model training, inference, and agentic workflows. You will work with engineers, researchers, PMs, and product leaders to deliver scalable AI experiences for customers and associates.

You will optimize performance, latency, and cost using a broad stack of AI tools, while ensuring security, governance, and observability across deployments.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with at least 4 years of AI/ML experience, or a Master's with at least 2 years of experience.
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with a cross-functional team of engineers, researchers, program managers, and product managers to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents, and workflows.
• Leverage a broad stack of Open Source and SaaS AI technologies (AWS Ultraclusters, HuggingFace, VectorDBs, PyTorch).
• Invent and introduce foundation model optimization techniques for performance, latency, and cost.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
• Own end-to-end architecture for complex AI systems with maintainability and observability.
• Define and maintain SLOs for AI reliability including latency and model performance drift.
• Collaborate with infrastructure to optimize GPU/TPU usage and accelerate model inference.
• Lead cross-functional reviews for new AI deployments ensuring security and governance.
• Mentor senior associates on scalable design and research-to-production translation.

Skills

Python

Go

Scala

CUDA

Java

LLM Inference

VectorDBs

Guardrails

GPU/TPU optimization

Machine Learning

Distributed Systems

Education

Bachelor's degree

Master's degree

Tools

AWS Ultraclusters

HuggingFace

VectorDBs

PyTorch

Guardrails

Model Evaluation

Observability

Job description

Capital One National Association is seeking an AI Engineer 4 in New York to build responsible AI systems, including foundation model training, inference, and agentic workflows. You will work with engineers, researchers, PMs, and product leaders to deliver scalable AI experiences for customers and associates.

You will optimize performance, latency, and cost using a broad stack of AI tools, while ensuring security, governance, and observability across deployments.