Senior AI Systems Architect for Foundation Models

OpenTalent

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

OpenTalent is seeking a senior AI infrastructure engineer to design, develop, and deploy AI software components including foundation model training, LLM inference, and vector search systems.

You will lead optimization of scalability, cost, and latency in production AI, collaborate with cross-functional teams, and help shape the long-term roadmap for foundational AI platforms within a scalable infrastructure.

Qualifications

  • 8+ years of Python programming experience with ML systems.
  • Bachelor's or Master's degree in CS/AI required.
  • Strong math and engineering fundamentals for AI optimization.
  • Willingness to lead technical vision and drive innovation.
  • Stay current with AI research and apply novel techniques in production.

Responsibilities

  • Design, develop, and deploy AI software components including foundation model training and LLM inference.
  • Improve scalability, cost efficiency, and latency of production AI systems.
  • Collaborate with cross-functional teams to integrate AI into scalable infrastructure.
  • Develop guardrails, evaluation frameworks, and observability for responsible AI.
  • Contribute to long-term roadmaps for foundational AI systems.
  • Leverage open-source and SaaS tech like Hugging Face, Nemo Guardrails, and vector databases.

Skills

Python programming
ML system design
Mathematics fundamentals
AI research awareness
Technical leadership

Education

Bachelor's degree in CS/AI
Master's degree in CS/AI

Tools

Hugging Face
Nemo Guardrails
Vector databases

Job description

OpenTalent is seeking a senior AI infrastructure engineer to design, develop, and deploy AI software components including foundation model training, LLM inference, and vector search systems.

You will lead optimization of scalability, cost, and latency in production AI, collaborate with cross-functional teams, and help shape the long-term roadmap for foundational AI platforms within a scalable infrastructure.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Engineer — Foundations for Scalable AI
Senior AI Engineer — Foundations for Scalable AI

Capital One Group • New York (NY), Northern (KY)

Hybrid
USD 177,000 - 201,000
Senior AI Foundation Model Engineer — LLM + MLOps
Senior AI Foundation Model Engineer — LLM + MLOps

Creative Solutions Services, LLC • Jersey City (NJ)

On-site
USD 150,000 - 190,000
Medical, dental and vision insurance
401k with company match
Paid time off
Senior AI Engineer, Foundations & Platforms
Senior AI Engineer, Foundations & Platforms

Energy Jobline ZR • New York (NY)

On-site
USD 215,000 - 246,000
Senior Lead AI Engineer: Foundations for Scalable AI
Senior Lead AI Engineer: Foundations for Scalable AI

Capital One • San Francisco (CA)

On-site
USD 251,000 - 286,000
Senior AI Systems Lead: Foundations, LLMs & Guardrails
Senior AI Systems Lead: Foundations, LLMs & Guardrails

Capital One Group • California (MO), Northern (KY)

Hybrid
USD 230,000 - 286,000
Foundation Models AI Engineer
Foundation Models AI Engineer

Amazon Science • Houston (TX)

On-site
USD 143,000 - 193,000
Health insurance
401(k) matching
Paid time off
+1
Principal AI Infrastructure Architect for Foundation Models
Principal AI Infrastructure Architect for Foundation Models

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 183,000 - 247,000
Health insurance
401(k) matching
Paid time off
+1
Foundation Model Architect & AI Infrastructure Leader
Foundation Model Architect & AI Infrastructure Leader

Getvinci • Palo Alto (CA)

Hybrid
USD 130,000 - 200,000
High ownership opportunities
Work with Tier-1 clients
Innovative projects in AI
Lead AI Engineer – Foundations & LLM Systems
Lead AI Engineer – Foundations & LLM Systems

Capital One • New York (NY)

On-site
USD 215,000 - 246,000
Senior AI Infrastructure Engineer for Robotics Foundation Models
Senior AI Infrastructure Engineer for Robotics Foundation Models

Socket.dev • Santa Clara (CA)

On-site
USD 224,000 - 356,500
Equity
Benefits