Remote ML Systems Engineer: Frontier Model Architectures

Positron AI

United States

On-site

USD 160,000 - 350,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Fully company-paid medical, dental, &
Company-paid life/disability
Unlimited PTO
Remote-first culture with home setup
401(k) with company match

Job summary

Positron AI is seeking an ML Systems Engineer to run new model architectures on our hardware via simulation before RTL or silicon exists. You will collaborate with chip architects, the compiler and SDK teams, and customers to ensure simulators can execute architectures bit-exactly.

The role focuses on implementation-heavy work with attention variants, mixture-of-experts, embeddings, and quantization formats.

Qualifications

  • 4+ years of experience as an ML systems or inference engineer.
  • Strong understanding of transformer internals at the operator level (attention variants, MoE, embeddings, KV cache, quantization).
  • Experience implementing or porting model inference by hand in PyTorch, llama.cpp, vLLM, TensorRT-LLM, or a custom runtime.
  • Hands-on debugging of numerical mismatches down to the operator and the bit.
  • Ability to read a model architecture paper and implement it.
  • Strong Rust or expert C/C++ skills with Python for model/reference work.
  • Excellent communication to explain hardware needs and design gaps.

Responsibilities

  • Implement operators, numerics, and memory layouts for new model architectures in the simulator, bit-exact against a reference.
  • Extend simulator coverage along the full inference path (prefill, decode, embeddings, attention variants, MoE routing, quantized formats).
  • Maintain reference comparisons and regression coverage as the simulator/hardware evolve.
  • Evaluate new architectures before hardware exists to identify compute/memory/data movement requirements.
  • Bring customer models up in simulation and own turnaround time for bring-up, in collaboration with tooling engineers.

Skills

ML systems
Transformer internals
PyTorch porting
Rust/C++
Python

Tools

llama.cpp
vLLM
TensorRT-LLM

Job description

Positron AI is seeking an ML Systems Engineer to run new model architectures on our hardware via simulation before RTL or silicon exists. You will collaborate with chip architects, the compiler and SDK teams, and customers to ensure simulators can execute architectures bit-exactly.

The role focuses on implementation-heavy work with attention variants, mixture-of-experts, embeddings, and quantization formats.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote ML Systems Engineer: Model Architectures & Simulator
Remote ML Systems Engineer: Model Architectures & Simulator

positron.ai • United States

Remote
USD 140,000 - 210,000
Company laptop
Medical coverage
Dental coverage
+5
Remote Modeling & Simulation Engineer (AI Accelerators)
Remote Modeling & Simulation Engineer (AI Accelerators)

positron.ai • United States

Remote
USD 140,000 - 210,000
Medical coverage
Dental coverage
Vision coverage
+9
ML Systems Engineer, Model Architectures (Mid/Senior/Principal)
ML Systems Engineer, Model Architectures (Mid/Senior/Principal)

positron.ai • United States

Remote
USD 140,000 - 210,000
Company laptop
Medical coverage
Dental coverage
+5
Frontier ML Compiler & Model Bring-Up Engineer
Frontier ML Compiler & Model Bring-Up Engineer

Black.ai • New York (NY)

On-site
USD 180,000 - 260,000
Remote AI Inference Simulation Engineer
Remote AI Inference Simulation Engineer

Positron • United States

Remote
USD 200,000 - 300,000
Unlimited PTO
Remote first culture
401(k) with company matching
+1
ML Systems Engineer, Model Architectures (Mid/Senior/Principal)
ML Systems Engineer, Model Architectures (Mid/Senior/Principal)

Positron AI • United States

On-site
USD 160,000 - 350,000
Fully company-paid medical, dental, &
Company-paid life/disability
Unlimited PTO
+2
Research Engineer, RL Frontiers for Frontier AI
Research Engineer, RL Frontiers for Frontier AI

Etched.ai • San Jose (CA)

On-site
USD 360,000 - 440,000
Medical, dental, and vision packages
Housing subsidy
Relocation support
+3
Senior ML Engineer — AI Silicon & Systems
Senior ML Engineer — AI Silicon & Systems

Axiado Corporation • San Jose (CA)

On-site
USD 150,000 - 230,000
Staff ML Research Engineer - RL for Chip Design (Equity)
Staff ML Research Engineer - RL for Chip Design (Equity)

Architect Labs • Palo Alto (CA)

On-site
USD 190,000 - 260,000
Competitive salary
Meaningful equity stake
Remote AI Accelerator Architecture & Modeling Lead
Remote AI Accelerator Architecture & Modeling Lead

positron.ai • United States

Remote
USD 180,000 - 240,000
Remote-first setup
Company-provided computer
Health, dental, vision for employees &
+3