Senior AI Foundations Engineer — LLM & VLM

Capital One Group; Northern, New York (KY, NY); Hybrid; USD 197,000 - 225,000; Full time

Benefits offered by this job

Performance-based incentives

Job summary

Capital One is seeking an AI Engineer 4 to design, develop, test, and deploy AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.

You will work with Open Source and SaaS AI technologies such as AWS Ultraclusters, HuggingFace, VectorDBs, PyTorch, and more, optimizing performance, latency, and cost while ensuring security and

Qualifications

• Bachelor's degree or higher in CS/AI/EE/CE with 2+ years of AI/ML development experience.
• Experience designing and deploying scalable AI systems and services.
• Proficiency with Python and modern ML/DL frameworks.

Responsibilities

• Design, develop, test, deploy, and support AI software components including foundation models and LLM inference.
• Lead optimization of performance, latency, and cost in production AI systems.
• Mentor junior engineers and contribute to long-term AI platform roadmap.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS

GCP

Azure

PyTorch

HuggingFace

VectorDBs

Job description

Capital One is seeking an AI Engineer 4 to design, develop, test, and deploy AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.

You will work with Open Source and SaaS AI technologies such as AWS Ultraclusters, HuggingFace, VectorDBs, PyTorch, and more, optimizing performance, latency, and cost while ensuring security and