AI Provider Operations Engineer — Lead LLM Model Launches

OpenRouter, Inc

United States

On-site

USD 110,000 - 150,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

OpenRouter seeks an AI-focused candidate to own model launches and provider onboarding, bringing new models to market and guiding provider integrations. You’ll work with labs and partners across the AI ecosystem, building tools and playbooks that accelerate onboarding and deployments.

The role emphasizes hands-on work with inference APIs, TS/JS and Python, and a bias toward shipping high-impact features for developers integrating LLMs.

Qualifications

  • Experience: 2-3 years at a startup, software engineering, product ops, or similar.
  • Technical Skills: Comfortable building with inference APIs, including Chat Completions, Responses, and/or Messages API; can read API docs and troubleshoot with logs/cURL/Postman.
  • Mindset: Ambitious owner, fast learner, bias to ship. Passionate about AI and developer experience.
  • Education: CS/Engineering degree is a plus, not required with demonstrated technical aptitude.

Responsibilities

  • Tooling for benchmarks, onboarding and internal operations (~60%)
  • Build internal tools to help speed up the model onboarding process
  • Build internal evals to quickly evaluate models and endpoints
  • Document internal processes and prime them for automation
  • Model Launches & Provider Partnerships (~40%)
  • Run end-to-end launch playbooks for various model types (text, audio, image, audio, video, embeddings, and rerankers): scoping, test plans, latency/quality checks, pricing & quotas, docs, and announcement assets.
  • Coordinate with model providers to integrate, QA, and hit ship dates.
  • Maintain clear versioning and release notes; manage deprecations and migrations.

Skills

TypeScript/JavaScript
Python
Startup experience

Education

CS/Engineering degree (a plus)

Tools

cURL
Postman
API docs reading

Job description

OpenRouter seeks an AI-focused candidate to own model launches and provider onboarding, bringing new models to market and guiding provider integrations. You’ll work with labs and partners across the AI ecosystem, building tools and playbooks that accelerate onboarding and deployments.

The role emphasizes hands-on work with inference APIs, TS/JS and Python, and a bias toward shipping high-impact features for developers integrating LLMs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Provider Operations & Support Engineer
AI Provider Operations & Support Engineer

OpenRouter • New York (NY)

On-site
USD 80,000 - 110,000
Competitive compensation
Growth into specialized roles
Collaborative work environment
AI Provider Operations & Support Engineer
AI Provider Operations & Support Engineer

OpenRouter • United States

Remote
USD 110,000 - 150,000
AI Model Launch & Provider Ops Specialist
AI Model Launch & Provider Ops Specialist

OpenRouter, Inc • United States

Remote
USD 120,000 - 170,000
AI Model Launch & Provider Ops Lead
AI Model Launch & Provider Ops Lead

OpenRouter • New York (NY)

On-site
USD 80,000 - 110,000
Competitive compensation
Growth into specialized roles
Collaborative work environment
AI Engineer / LLM Systems Engineer
AI Engineer / LLM Systems Engineer

Sphere Software • United States

Remote
USD 120,000 - 170,000
Production AI/ML Engineer for LLMs & MLOps
Production AI/ML Engineer for LLMs & MLOps

Gain America Inc. • Jersey City (NJ)

Hybrid
USD 140,000 - 190,000
Senior AI Platform Engineer – LLM & Production Systems
Senior AI Platform Engineer – LLM & Production Systems

Compunnel Inc. • Jersey City (NJ)

On-site
USD 150,000 - 230,000
Senior AI Engineer — End-to-End LLM Optimization
Senior AI Engineer — End-to-End LLM Optimization

LawPro.ai • Georgia

On-site
USD 140,000 - 200,000
AI Engineer III
AI Engineer III

Frontline Education • United States

Remote
USD 140,000 - 190,000
Staff AI Tech Lead — LLM Systems & Platform (Go/Python/TS)
Staff AI Tech Lead — LLM Systems & Platform (Go/Python/TS)

OpenLoop Health, Inc. • United States

Hybrid
USD 180,000 - 260,000
Equity
Flexible Bay Area Hybrid
M-series Macs