Staff AI Engineer: Foundation Models & Scalable AI

Energy Jobline ZR; New York (NY); On-site; USD 294,000 - 335,000; Full time

Job summary

Capital One is hiring a Staff AI Engineer in New York, NY to build AI systems that power banking experiences. You will design and deploy foundation models, multi-model workloads, and governance pipelines, partnering with engineers, scientists, and PMs to ship impactful AI products.

The role emphasizes responsible AI, observability, and scalable AI infrastructure with a broad stack including PyTorch, HuggingFace, VectorDBs, and cloud platforms. Strong leadership and communication are required.

Qualifications

• Experience designing AI systems with cost, latency, throughput and accuracy tradeoffs.
• 8 years deploying scalable and responsible AI on cloud platforms (AWS/GCP/Azure).
• Experience architecting and supporting complex AI systems.
• Proven ability to lead multiple engineering teams and influence stakeholders up to VP level.
• Experience with LLM inference, similarity search, VectorDBs, guardrails, and evaluation.
• Experience optimizing training and inference for hardware utilization and latency.
• Experience building agentic AI systems and workflows.
• Strong communication and presentation skills for senior audiences.
• Track record defining enterprise AI architecture standards and governance.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that impact customers and associates.
• Design, develop, test, deploy, and support AI software components including model training and inference.
• Leverage Open Source and SaaS AI tech such as AWS Ultraclusters, HuggingFace, VectorDBs, and PyTorch.
• Innovate foundation model optimization techniques to improve scalability and cost.
• Contribute to technical vision and long-term roadmap of foundational AI systems.
• Set enterprise-wide AI architecture standards, tooling, observability, and deployment practices.
• Own design and integration of model routing, caching, and orchestration for hybrid workloads.
• Champion responsible AI with transparency and fairness-by-design.

Skills

Python

Go

Scala

CUDA

Java

PyTorch

HuggingFace

VectorDBs

Education

Bachelor's degree in CS/AI/EE/CE or related

Master's degree in CS/AI/EE/CE or related

Tools

AWS Ultraclusters

VectorDBs

HuggingFace

PyTorch

Job description

Capital One is hiring a Staff AI Engineer in New York, NY to build AI systems that power banking experiences. You will design and deploy foundation models, multi-model workloads, and governance pipelines, partnering with engineers, scientists, and PMs to ship impactful AI products.

The role emphasizes responsible AI, observability, and scalable AI infrastructure with a broad stack including PyTorch, HuggingFace, VectorDBs, and cloud platforms. Strong leadership and communication are required.