Senior AI Engineer – Foundation Models & Production Systems

Capital One; United States; Remote; USD 197,000 - 246,000; Full time

Benefits offered by this job

Performance-based incentives

Job summary

Capital One is actively building responsible AI systems and scalable AI infrastructure. We seek engineers who can design, implement, and operate AI software across a broad stack, from foundation model training to production deployment and governance.

Join a team that collaborates with research scientists and engineers to push the state of the art while ensuring reliability, security, and ethical standards in production AI solutions.

Qualifications

• Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years experience developing AI/ML algorithms or technologies; or a Master's degree plus at least 2 years experience.
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with cross-functional team to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Invent and introduce state-of-the-art foundation model optimization techniques to improve performance, scalability, cost, latency, and throughput of large-scale AI systems.
• Own end-to-end architecture for complex AI systems, ensuring maintainability, observability, and ethical alignment.
• Define and maintain SLOs for AI reliability including latency and uptime.
• Collaborate with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines.
• Lead cross-functional technical reviews for new AI deployments with security and governance considerations.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE or related, with 4+ years experience

Master's degree in CS/AI/EE or related, with 2+ years experience

Tools

AWS

Google Cloud

Azure

PyTorch

Job description

Capital One is actively building responsible AI systems and scalable AI infrastructure. We seek engineers who can design, implement, and operate AI software across a broad stack, from foundation model training to production deployment and governance.

Join a team that collaborates with research scientists and engineers to push the state of the art while ensuring reliability, security, and ethical standards in production AI solutions.