Senior AI Engineer - Vision & LLM Systems

Energy Jobline ZR; New York (NY); On-site; USD 215,000 - 246,000; Full time

Benefits offered by this job

Health benefits

Performance incentives

Job summary

Capital One is seeking a Lead AI Engineer to advance vision model customization and VLM workflows. You will partner with engineers, researchers, PMs to ship AI-powered products and build scalable AI services.

You'll design, train, evaluate, and deploy components from foundation models to inference, leveraging PyTorch, HuggingFace, and vector databases, with emphasis on safety and observability in production systems. This role offers opportunity to influence enterprise-scale AI platforms.

Qualifications

• Bachelor's or Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering or related fields with relevant experience.
• 4+ years of experience developing AI and ML algorithms or technologies.
• 4+ years of experience programming with Python, Go, Scala, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products and improve customer experiences.
• Design, develop, test, deploy, and support AI software components including model training, inference, guardrails, and observability.
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, PyTorch) to build scalable AI systems.
• Invent and implement state-of-the-art LLM optimization techniques to improve performance, cost, latency, and throughput.

Skills

Python

Java

Go

Scala

Machine learning

AI systems

Education

Bachelor's degree in CS/AI/EE

Master's degree in CS/AI/EE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a Lead AI Engineer to advance vision model customization and VLM workflows. You will partner with engineers, researchers, PMs to ship AI-powered products and build scalable AI services.

You'll design, train, evaluate, and deploy components from foundation models to inference, leveraging PyTorch, HuggingFace, and vector databases, with emphasis on safety and observability in production systems. This role offers opportunity to influence enterprise-scale AI platforms.