Lead AI Engineer – GenAI, Agentic Workflows

Capital One Group; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 to advance responsible AI systems, including foundation models, agents, and large-scale inference pipelines. You will work with a cross-functional team to deliver AI-powered products and ensure governance, observability, and high performance.

The role emphasizes optimization across latency, throughput, and cost, with opportunities to influence the AI roadmap and collaborate with infrastructure for GPU/TPU utilization.

Qualifications

• Bachelor's degree in CS/AI/EE/CE plus 4+ years of AI/ML experience OR Master's in CS/AI/EE/CE plus 2+ years of AI/ML experience.
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with a cross‑functional team to deliver AI‑powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training and inference, agents, and workflows.
• Leverage a broad stack of Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, PyTorch).
• Invent and implement foundation model optimization techniques for performance and cost.
• Contribute to technical vision and long-term roadmap of foundational AI systems.
• Own end‑to‑end architecture for complex AI systems—maintainability, observability, and ethics.
• Define and maintain SLOs for AI reliability (latency, uptime, performance drift).
• Collaborate with infra to optimize GPU/TPU utilization and accelerate inference pipelines.
• Lead cross‑functional reviews for new AI deployments with security and governance.

Skills

Python

ML algorithms

Distributed systems

GPU optimization

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 4 to advance responsible AI systems, including foundation models, agents, and large-scale inference pipelines. You will work with a cross-functional team to deliver AI-powered products and ensure governance, observability, and high performance.

The role emphasizes optimization across latency, throughput, and cost, with opportunities to influence the AI roadmap and collaborate with infrastructure for GPU/TPU utilization.