Senior AI Architect: Production-Scale ML & LLMs

Capital One; McLean (VA); On-site; USD 315,000 - 359,000; Full time

Job summary

Capital One is seeking a Sr. Distinguished AI Engineer in McLean, VA to design, deploy, and optimize AI software components, including foundation model training, LLM inference, and vector databases. You will work with a cross-functional team to deliver AI-powered products and drive responsible AI practices.

The ideal candidate brings 10+ years of AI/ML experience, advanced Python/Java/Scala skills, and a proven track record mentoring engineers and influencing stakeholders up to the SVP level.

Qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 10 years of experience developing AI and ML algorithms or technologies, or a Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies
• At least 10 years of experience programming with Python, Go, Scala, or Java
• Preferred: 9 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud)
• Experience architecting, designing, developing, integrating, delivering, and supporting complex enterprise AI systems
• Demonstrated ability to lead and mentor an engineering organization and influence cross-functional stakeholders up to the SVP level
• Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C, C#, Java, or Golang
• Experience developing and applying state-of-the-advanced techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
• Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems.
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.

Skills

Python

Java/Scala

ML Systems

Distributed Systems

LLM Inference

Guardrails

Performance optimization

Leadership

Research comprehension

Education

Bachelor's in CS/AI/EE

Master's in CS/AI/EE

Tools

AWS

GCP

Azure

HuggingFace

PyTorch

VectorDBs

Job description

Capital One is seeking a Sr. Distinguished AI Engineer in McLean, VA to design, deploy, and optimize AI software components, including foundation model training, LLM inference, and vector databases. You will work with a cross-functional team to deliver AI-powered products and drive responsible AI practices.

The ideal candidate brings 10+ years of AI/ML experience, advanced Python/Java/Scala skills, and a proven track record mentoring engineers and influencing stakeholders up to the SVP level.