Staff AI Platform Architect: Inference & RL

nscaleoperationsukltd

Georgia

On-site

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Nscale is seeking a Staff AI Engineer (Specialized) to set technical direction for inference and RL at the core of its AI services platform. You will own architecture for how models are served on Nscale's GPU cloud and expose clean interfaces to customers and internal teams.

This role drives system-wide performance, cost efficiency, and standards across 2–4 teams covering serving, post-training, and platform, while mentoring engineers and collaborating with research, product, and infrastructure

Qualifications

  • 8–12 years of engineering experience in production AI systems at scale.
  • Ability to set technical direction for an AI systems domain.
  • Deep expertise in production LLM inference and memory management.
  • Hands-on RL for LLMs including RLHF and reward modelling.
  • Experience designing developer-facing APIs and SDKs.
  • Cross-team influence and standards adoption.
  • Experience AI infrastructure with clear control/data plane separation.

Responsibilities

  • Define inference serving architecture including routing, batching, and cache management.
  • Lead RL and post-training systems design, RLHF and related methods.
  • Set standards for developer APIs, SDKs, OpenAPI specs and tooling.
  • Coach junior engineers and align with research, product, and infrastructure leadership.

Skills

AI systems leadership
LLM inference
RL for LLMs
API design

Tools

OpenAI-compatible APIs

Job description

Nscale is seeking a Staff AI Engineer (Specialized) to set technical direction for inference and RL at the core of its AI services platform. You will own architecture for how models are served on Nscale's GPU cloud and expose clean interfaces to customers and internal teams.

This role drives system-wide performance, cost efficiency, and standards across 2–4 teams covering serving, post-training, and platform, while mentoring engineers and collaborating with research, product, and infrastructure

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI Platform Engineer – Inference & RL Architect
Staff AI Platform Engineer – Inference & RL Architect

Nscale • Seattle (WA)

On-site
USD 220,000 - 293,000
Principal AI Inference Architect – Post-Training
Principal AI Inference Architect – Post-Training

nscaleoperationsukltd • Georgia

On-site
USD 260,000 - 360,000
Staff AI Product Engineer
Staff AI Product Engineer

Nscale • Seattle (WA)

On-site
USD 220,000 - 293,000
Staff AI Product Engineer
Staff AI Product Engineer

nscaleoperationsukltd • Georgia

On-site
USD 180,000 - 240,000
Staff AI Product Engineer
Staff AI Product Engineer

Nscale • New York (NY)

On-site
USD 220,000 - 330,000
Principal AI Product Engineer
Principal AI Product Engineer

Nscale • Houston (TX), New York (NY), San Francisco (CA), Seattle (WA)

On-site
USD 290,000 - 520,000
Medical insurance
Dental insurance
Vision insurance
+3
Staff AI Platform Engineer: Scale ML Infra
Staff AI Platform Engineer: Scale ML Infra

DAT Freight Solutions • Seattle (WA)

Hybrid
USD 198,000 - 246,000
Medical Insurance
Dental Insurance
Vision Insurance
+6
Principal AI Product Engineer
Principal AI Product Engineer

nscaleoperationsukltd • Georgia

On-site
USD 260,000 - 360,000
Foundational Platform Engineer for AI-Scale Infra
Foundational Platform Engineer for AI-Scale Infra

Scale AI, Inc. • San Francisco (CA)

On-site
USD 180,000 - 225,000
Comprehensive health, dental andVision
Retirement benefits
Learning and development stipend
+2
Senior Staff AI/ML Inference Engineer
Senior Staff AI/ML Inference Engineer

ServiceNow • Washington

Hybrid
USD 201,000 - 352,000
Equity
Health plans
401(k) plan with company match
+3