Staff AI Platform Engineer – Inference & RL Architect

Nscale

Seattle (WA)

On-site

USD 220,000 - 293,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Nscale seeks a Staff AI Engineer (Specialized) to drive the architecture of its inference and reinforcement learning systems at the core of the AI services platform. You will own how models are served on Nscale’s GPU cloud, and how RL workloads run, exposing clean, high-performance interfaces to customers and internal teams.

You will define standards for model efficiency, API boundaries, and platform tooling, collaborating with multiple teams to raise engineering quality and ensure scalable,

Qualifications

  • 8–12 years of engineering experience in production AI systems at scale.
  • Ability to set technical direction for an AI systems domain.
  • Deep expertise in production LLM inference and RL for LLMs.
  • APIs/SDKs designed for engineers and external customers.

Responsibilities

  • Set technical direction for inference serving architecture: routing, scheduling and batching.
  • Lead RL and post-training systems: RLHF, reward modelling, and agentic RL.
  • Define shared infrastructure for RL loops and data curation workflows.
  • Design developer-facing APIs and SDKs that are clean and versioned.
  • Coach engineers and align strategy with business direction.

Skills

Production AI systems
LLM inference
RL for LLMs
APIs & SDKs
Python & PyTorch
Transformer architectures
Cross-team influence
GPU/accelerator workloads

Tools

CUDA
Kubernetes
Triton
OpenAPI 3.x

Job description

Nscale seeks a Staff AI Engineer (Specialized) to drive the architecture of its inference and reinforcement learning systems at the core of the AI services platform. You will own how models are served on Nscale’s GPU cloud, and how RL workloads run, exposing clean, high-performance interfaces to customers and internal teams.

You will define standards for model efficiency, API boundaries, and platform tooling, collaborating with multiple teams to raise engineering quality and ensure scalable,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI Platform Architect: Inference & RL
Staff AI Platform Architect: Inference & RL

nscaleoperationsukltd • Georgia

On-site
USD 180,000 - 240,000
Principal AI Inference Architect – Post-Training
Principal AI Inference Architect – Post-Training

nscaleoperationsukltd • Georgia

On-site
USD 260,000 - 360,000
Staff AI Product Engineer
Staff AI Product Engineer

Nscale • Seattle (WA)

On-site
USD 220,000 - 293,000
Staff AI Product Engineer
Staff AI Product Engineer

nscaleoperationsukltd • Georgia

On-site
USD 180,000 - 240,000
Principal AI Product Engineer
Principal AI Product Engineer

Nscale • Houston (TX), New York (NY), San Francisco (CA), Seattle (WA)

On-site
USD 290,000 - 520,000
Medical insurance
Dental insurance
Vision insurance
+3
Staff AI Product Engineer
Staff AI Product Engineer

Nscale • New York (NY)

On-site
USD 220,000 - 330,000
Principal AI Product Engineer
Principal AI Product Engineer

nscaleoperationsukltd • Georgia

On-site
USD 260,000 - 360,000
Staff AI Platform Engineer: Scale ML Infra
Staff AI Platform Engineer: Scale ML Infra

DAT Freight Solutions • Seattle (WA)

Hybrid
USD 198,000 - 246,000
Medical Insurance
Dental Insurance
Vision Insurance
+6
Senior Staff AI/ML Inference Platform Engineer
Senior Staff AI/ML Inference Platform Engineer

ServiceNow • California

Hybrid
USD 181,000 - 317,000
Health plans
Flexible spending accounts
401(k) with company match
+4
Senior Staff AI/ML Inference Engineer
Senior Staff AI/ML Inference Engineer

ServiceNow • Washington

Hybrid
USD 201,000 - 352,000
Equity
Health plans
401(k) plan with company match
+3