Staff AI Engineer

Jobtailor; California (MO); On-site; USD 180,000 - 240,000; Full time

Job summary

Capital One is seeking an experienced AI/ML leader to partner with engineers, researchers, and product managers to deliver AI-powered products. Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, and observability.

You will lead scalable AI systems, optimize training and inference for cost, latency, and throughput, and contribute to the long-term technical vision and roadmap.

Qualifications

• Bachelor's degree in CS/AI or related field with extensive AI/ML experience.
• Proficiency in Python and additional languages (Go/Scala/Java).
• Experience deploying scalable AI on cloud platforms (AWS/GCP/Azure).
• Ability to lead multiple engineering teams and influence stakeholders.

Responsibilities

• Partner with engineers, research scientists, and product managers to deliver AI-powered products.
• Design, develop, test, deploy, and support AI components including training, inference, and observability.
• Leverage open-source and SaaS AI technologies (AWS Ultraclusters, Hugging Face, PyTorch).
• Contribute to the technical vision and long-term roadmap of foundational AI systems.

Skills

Python

Go

Scala

Java

Leadership

Mentoring

Cloud Deployment

LLM Optimization

AI Systems

Education

Bachelor's in CS/AI or related

Master's in AI or related

Tools

AWS

Google Cloud

Azure

Hugging Face

PyTorch

VectorDBs

NeMo Guardrails

AWS Ultraclusters

Job description

• Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Leverage open-source and SaaS AI technologies including AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, and PyTorch
• Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput of production AI systems
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies, OR a Master's degree in one of these fields plus at least 6 years of such experience
• At least 8 years of programming experience with Python, Go, Scala, or Java
• Preferred: 8 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud
• Preferred: Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems
• Preferred: Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level
• Preferred: Experience developing AI and ML algorithms or technologies using Python, C++, C#, Java, or Golang
• Preferred: Experience applying state-of-the-art techniques to optimize training and inference software for hardware utilization, latency, throughput, and cost
• Preferred: Passion for current AI research and AI systems, and ability to apply novel techniques in production
• Preferred: Excellent communication and presentation skills for articulating complex AI concepts

Core Competencies

Demonstrates expertise in developing and deploying AI and ML algorithms, with a strong focus on optimizing performance and scalability in production environments. Proficient in leveraging cloud platforms and open-source technologies to deliver innovative AI solutions.

Highest-signal resume keywords

• AI And ML Algorithm Development
• Python Programming
• AWS Cloud Deployment
• LLM Optimization Techniques
• Cross-Functional Leadership

Hard Skills

• AI Software Development
• Machine Learning Algorithms
• Foundation Model Training
• LLM Inference
• Similarity Search
• Model Evaluation
• Experimentation
• Governance
• Observability
• Programming Languages

Soft Skills

• Excellent Communication
• Presentation Skills
• Mentoring

Certifications & Qualifications

• Bachelor's Degree in Computer Science
• Master's Degree in AI or Related Fields

Industry Keywords

• AI-Powered Products
• Scalable AI Solutions
• Complex AI Systems
• Technical Vision
• Long-Term Roadmap

Tools & Technologies

• AWS Ultraclusters
• Hugging Face
• VectorDBs
• NeMo Guardrails
• PyTorch
• Google Cloud
• Azure