Senior AI Architect for Scalable Systems

Capital One Financial Corporation; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking a Senior Lead AI Engineer to help design, build, and scale responsible AI systems across the enterprise. You will work with cross-functional teams to deploy foundation model training, LLM inference, and observability, using Open Source and SaaS tools like AWS, Huggingface, and PyTorch.

You will mentor engineers, influence the technical roadmap, and drive best practices for model governance, evaluation, and safety across multiple business domains in New York and other hub

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies; or a Master's degree plus at least 4 years of experience.
• At least 6 years of experience programming with Python, Go, Scala, or Java.
• Experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent).
• Experience leading and mentoring an engineering team and influencing cross-functional stakeholders.
• Experience developing AI and ML algorithms or technologies (e.g., LLM Inference, Similarity Search, VectorDBs, Guardrails, Memory).
• Excellent communication and presentation skills to convey complex AI concepts.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, and throughput of large-scale production AI systems.
• Contribute to the technical vision and the long-term roadmap of foundational AI systems at Capital One.

Skills

Python

Go

Scala

Java

Leadership

Cloud platforms

LLM Inference

VectorDBs

Guardrails

PyTorch

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a Senior Lead AI Engineer to help design, build, and scale responsible AI systems across the enterprise. You will work with cross-functional teams to deploy foundation model training, LLM inference, and observability, using Open Source and SaaS tools like AWS, Huggingface, and PyTorch.

You will mentor engineers, influence the technical roadmap, and drive best practices for model governance, evaluation, and safety across multiple business domains in New York and other hub