Principal AI Inference Architect – Post-Training

nscaleoperationsukltd

Georgia

On-site

USD 260,000 - 360,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Nscale is seeking a Principal AI Engineer to lead the inference and post-training pillar of our AI systems engineering group. You will shape the multi-year roadmap for how models are served, evaluated, and post-trained on Nscale's GPU cloud, including bring-your-own-model deployments.

You will mentor 20–50 engineers, set engineering standards, and drive cost, latency, and reliability targets to stay competitive with leading AI providers.

Qualifications

  • 10-15 years of engineering experience with pillar-level impact on production AI systems.
  • 4+ years hands-on work with LLMs in inference, GPU performance, evals, or post-training/RL.
  • Demonstrated ability to define multi-year technical strategy for large AI systems organizations.
  • Deep understanding of hardware/software boundary for AI accelerators: CUDA/ROCm, memory bandwidth, interconnects.

Responsibilities

  • Define and own the multi-year technical roadmap for inference, evals, and post-training platform.
  • Lead company-scale architectural initiatives across serving, GPU, and benchmark frameworks.
  • Establish engineering standards: API design, evals methodology, training stability norms.
  • Own cost, latency, throughput, and model quality trade-offs across the pillar.
  • Identify systemic risks early and align leadership on multi-team technical strategy.
  • Mentor Staff and Senior AI Engineers and grow the next generation of leaders.
  • Represent Nscale externally: open-source leadership, publications, conferences, partnerships.

Skills

LLM inference
GPU performance
Evals frameworks
Post-training RL
Technical leadership
Architectural design
Staff mentorship
Open source leadership

Tools

CUDA
ROCm
NVFP4

Job description

Nscale is seeking a Principal AI Engineer to lead the inference and post-training pillar of our AI systems engineering group. You will shape the multi-year roadmap for how models are served, evaluated, and post-trained on Nscale's GPU cloud, including bring-your-own-model deployments.

You will mentor 20–50 engineers, set engineering standards, and drive cost, latency, and reliability targets to stay competitive with leading AI providers.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI Platform Architect: Inference & RL
Staff AI Platform Architect: Inference & RL

nscaleoperationsukltd • Georgia

On-site
USD 180,000 - 240,000
Staff AI Platform Engineer – Inference & RL Architect
Staff AI Platform Engineer – Inference & RL Architect

Nscale • Seattle (WA)

On-site
USD 220,000 - 293,000
Principal AI Product Engineer
Principal AI Product Engineer

nscaleoperationsukltd • Georgia

On-site
USD 260,000 - 360,000
Principal AI Product Engineer
Principal AI Product Engineer

Nscale • Houston (TX), New York (NY), San Francisco (CA), Seattle (WA)

On-site
USD 290,000 - 520,000
Medical insurance
Dental insurance
Vision insurance
+3
Principal AI Inference Cloud Architect
Principal AI Inference Cloud Architect

Arm Limited • Seattle (WA)

Hybrid
USD 263,000 - 355,000
Principal AI Infrastructure Engineer — GPU Fleet
Principal AI Infrastructure Engineer — GPU Fleet

Nscale • Bellevue (WA)

On-site
USD 240,000 - 400,000
Medical, dental, vision
Flexible paid time off
Parental leave
+1
Senior Architect, Scaled AI Inference & GPU Acceleration
Senior Architect, Scaled AI Inference & GPU Acceleration

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 320,000 - 489,000
Equity
Benefits package
Principal AI Infra Architect – Scale & Validation
Principal AI Infra Architect – Scale & Validation

nscaleoperationsukltd • Georgia

On-site
USD 180,000 - 240,000
Principal Tech PM, AI Hardware & Infra Strategy
Principal Tech PM, AI Hardware & Infra Strategy

Aimlroles • Seattle (WA)

On-site
USD 180,000 - 240,000
Senior Principal AI Inference Systems Architect
Senior Principal AI Inference Systems Architect

Ampere • Santa Clara (CA)

On-site
USD 237,000 - 356,000
Health insurance
401K retirement plan
Paid holidays