Lead AI Engineer – Gen AI Platform Services

Jobtailor; California (MO); On-site; USD 140,000 - 210,000; Full time

Job summary

Capital One is seeking an experienced AI/ML software engineer to partner with cross-functional teams to build AI-powered products. You will design, train, deploy, and support foundation models, inference services, and related AI components using AWS/GCP/Azure and open-source tools.

The role emphasizes scalable AI systems, governance, and experimentation to drive production readiness and cost efficiency across platforms.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical/Computer Engineering or related field with 4+ years of AI/ML experience.
• Alternative: Master's degree with 2+ years of AI/ML experience.
• 4+ years of Python/Go/Scala/Java programming.
• Experience deploying AI services on cloud platforms (AWS, GCP, Azure).
• Experience with LLM inference, vector databases, guardrails, and model training.

Responsibilities

• Partner with cross-functional engineers, researchers, and product managers to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training and inference.
• Leverage open-source and SaaS AI tech such as Hugging Face, PyTorch, and cloud platforms.
• Invent state-of-the-art LLM optimization techniques to improve scale, latency, and cost.
• Contribute to Capital One's technical vision and long-term AI systems roadmap.

Skills

Python programming

Go/Scala/Java

Cloud deployment

AI/ML algorithms

LLM inference

Vector databases

Guardrails

Foundation model training

Experimentation

Education

Bachelor's degree in CS

Master's degree in AI or related fields

Tools

AWS Ultraclusters

Hugging Face

NeMo Guardrails

PyTorch

Google Cloud

Azure

Job description

• Partner with cross-functional engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, and PyTorch
• Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput of large-scale production AI systems
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies; or a Master's degree in these fields plus at least 2 years of such experience
• At least 4 years of experience programming with Python, Go, Scala, or Java
• Experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud
• Experience designing, developing, delivering, and supporting AI services
• Experience developing AI and ML algorithms or technologies, including LLM Inference, Similarity Search and VectorDBs, Guardrails, and Memory
• Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
• Passion for staying abreast of the latest AI research and AI systems and applying novel techniques in production
• Capital One will consider sponsoring a new qualified applicant for employment authorization

Core Competencies

Demonstrates expertise in developing and deploying AI and ML algorithms, with a strong focus on large language model optimization and scalable AI solutions. Proficient in leveraging cloud platforms and open-source technologies to enhance AI system performance and governance.

Highest-signal resume keywords

• AI And ML Algorithm Development
• Large Language Model Inference
• Python Programming
• AWS Cloud Deployment
• AI Service Design And Support

Hard Skills

• AI Software Development
• Machine Learning Algorithms
• Model Evaluation
• Optimization Techniques
• Similarity Search
• VectorDBs
• Guardrails
• Foundation Model Training
• Experimentation
• Governance

Soft Skills

• Collaboration
• Passion For AI Research

Certifications & Qualifications

• Bachelor's Degree In Computer Science
• Master's Degree In AI Or Related Fields

Industry Keywords

• AI-Powered Products
• Scalable AI Solutions
• Cloud Platforms
• Production AI Systems

Tools & Technologies

• AWS Ultraclusters
• Hugging Face
• NeMo Guardrails
• PyTorch
• Google Cloud
• Azure