Remote AI Systems Engineer — LLM & Scalable AI

Socket.dev; San Francisco (CA); Remote; USD 294,000 - 335,000; Full time

Benefits offered by this job

Performance-based incentives

Health benefits

Job summary

Capital One is hiring a Distinguished AI Engineer to design, develop and deploy AI software components including foundation model training, large language model inference, and guardrails. You will work with engineers, researchers, PMs, and technical program managers to deliver AI-enabled products across the enterprise.

The role emphasizes scalable, high-performance AI infrastructure, observability, governance, and cost optimization, with remote eligibility.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or AI with 8+ years of AI/ML experience, or a Master's with 6+ years of experience.
• 8+ years of experience programming with Python, Go, Scala, or Java.

Responsibilities

• Partner with a cross-functional team to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including model training, inference, search, guardrails, evaluation, experimentation, governance, and observability.
• Leverage Open Source and SaaS AI tech such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch.
• Invent state-of-the-art LLM optimization techniques to improve performance, latency, and cost of large-scale AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Skills

Python

Go

Scala

Java

AI/ML basics

Communication

Education

Bachelor's in CS/Engineering/AI

Master's in CS/Engineering/AI

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is hiring a Distinguished AI Engineer to design, develop and deploy AI software components including foundation model training, large language model inference, and guardrails. You will work with engineers, researchers, PMs, and technical program managers to deliver AI-enabled products across the enterprise.

The role emphasizes scalable, high-performance AI infrastructure, observability, governance, and cost optimization, with remote eligibility.