Senior AI Engineer: Scalable LLM Systems

Socket.dev; California (MO); On-site; USD 176,000 - 201,000; Full time

Benefits offered by this job

Health benefits

Competitive compensation

Incentives

Job summary

Capital One is seeking an AI Engineer to help build responsible, scalable AI systems for banking applications. You will collaborate across engineering, research, and product teams to deploy AI components, including model training, inference, and guardrails.

You will work with Open Source and SaaS tools to optimize performance and cost. The role emphasizes strong engineering fundamentals, learning latest research, and applying techniques in production to deliver measurable impact for customers

Qualifications

• Bachelor's or Master's in CS/AI/EE with applicable AI/ML experience.
• 3+ years of experience programming in Python/Go/Scala/Java.
• 4 years of experience deploying scalable AI solutions on cloud platforms.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI technologies (AWS, HuggingFace, PyTorch).
• Invent and apply LLM optimization techniques for production AI systems.
• Contribute to the technical vision and roadmap for foundational AI systems.

Skills

Python programming

Machine learning

System design

Optimization

Education

Bachelor's degree in CS/AI/EE

Master's in CS/AI/EE

Tools

AWS

PyTorch

Hugging Face

VectorDBs

Nemo Guardrails

Job description

Capital One is seeking an AI Engineer to help build responsible, scalable AI systems for banking applications. You will collaborate across engineering, research, and product teams to deploy AI components, including model training, inference, and guardrails.

You will work with Open Source and SaaS tools to optimize performance and cost. The role emphasizes strong engineering fundamentals, learning latest research, and applying techniques in production to deliver measurable impact for customers