Senior AI Engineer: LLM Inference & Foundational Systems

Capital One; McLean (VA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 to help build responsible, scalable AI systems and real-time customer experiences. You will work with a cross-functional team of engineers, scientists and product managers to advance foundation models, multi-model orchestration, and governance while leveraging AWS, Huggingface, and PyTorch in production.

The role focuses on designing and optimizing AI software components, driving performance, cost-efficiency, and robust observability across large-scale

Qualifications

• Bachelor's degree or Master's in CS/AI/EE/CE or related fields with relevant AI/ML experience.
• Proficient in Python and at least one of Go/Scala/CUDA/Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products and platforms.
• Design, develop, test, deploy, and support AI software components including LLM inference and multi-model workflows.
• Leverage Open Source and SaaS AI technologies (AWS, Huggingface, VectorDBs, PyTorch) for production systems.
• Lead optimization of foundation models for cost, latency, and throughput.
• Contribute to technical vision and long-term roadmap of AI systems at Capital One.
• Mentor engineers and foster technical maturity across teams.

Job description

Capital One is seeking an AI Engineer 5 to help build responsible, scalable AI systems and real-time customer experiences. You will work with a cross-functional team of engineers, scientists and product managers to advance foundation models, multi-model orchestration, and governance while leveraging AWS, Huggingface, and PyTorch in production.

The role focuses on designing and optimizing AI software components, driving performance, cost-efficiency, and robust observability across large-scale