Distinguished AI Engineer

OpenTalent; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

OpenTalent is seeking a senior AI infrastructure engineer to design, develop, and deploy AI software components including foundation model training, LLM inference, and vector search systems.

You will lead optimization of scalability, cost, and latency in production AI, collaborate with cross-functional teams, and help shape the long-term roadmap for foundational AI platforms within a scalable infrastructure.

Qualifications

• 8+ years of Python programming experience with ML systems.
• Bachelor's or Master's degree in CS/AI required.
• Strong math and engineering fundamentals for AI optimization.
• Willingness to lead technical vision and drive innovation.
• Stay current with AI research and apply novel techniques in production.

Responsibilities

• Design, develop, and deploy AI software components including foundation model training and LLM inference.
• Improve scalability, cost efficiency, and latency of production AI systems.
• Collaborate with cross-functional teams to integrate AI into scalable infrastructure.
• Develop guardrails, evaluation frameworks, and observability for responsible AI.
• Contribute to long-term roadmaps for foundational AI systems.
• Leverage open-source and SaaS tech like Hugging Face, Nemo Guardrails, and vector databases.

Skills

Python programming

ML system design

Mathematics fundamentals

AI research awareness

Technical leadership

Education

Bachelor's degree in CS/AI

Master's degree in CS/AI

Tools

Hugging Face

Nemo Guardrails

Vector databases

Job description

Key Responsibilities

• Design, develop, and deploy AI software components including foundation model training, large language model inference, and similarity search systems
• Implement state-of-the-art LLM optimization techniques to improve scalability, cost efficiency, and latency of production AI systems
• Collaborate with cross-functional teams to integrate AI capabilities into scalable, high-performance infrastructure
• Develop and maintain guardrails, model evaluation frameworks, and observability systems for responsible AI deployment
• Contribute to the technical vision and long-term roadmap for foundational AI systems
• Leverage open-source and SaaS technologies such as Hugging Face, Nemo Guardrails, and vector databases

Requirements

• Bachelor's degree in Computer Science, AI, or related field plus 8+ years of AI/ML experience, or Master's degree plus 6+ years
• 8+ years of Python programming experience with deep expertise in machine learning systems
• Strong foundation in mathematics and engineering principles for AI system optimization
• Passion for staying current with AI research and applying novel techniques in production
• Ability to lead technical vision and drive innovation in large-scale AI infrastructure