Senior AI Inference Architecture & Performance Modeling

Positron AI

United States

On-site

USD 220,000 - 350,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Positron AI is seeking a Senior Architecture & Performance Modeling Engineer to shape the architecture of next-generation AI inference accelerators. You will collaborate with chip architects, build analytical and cycle-level models, and correlate results with RTL/silicon to guide design decisions before RTL exists.

You will own primary modeling responsibility for a generation chip, supporting architectural tradeoffs across compute engines, memory, interconnects, and on-chip data movement.

Qualifications

  • 5+ years of experience in computer architecture, microarchitecture, or performance modeling for accelerators, CPUs, or GPUs.
  • Demonstrated experience using models to influence architectural decisions, such as identifying a bottleneck, comparing design alternatives, or recommending a change backed by quantitative analysis.
  • A strong understanding of pipelines, queues, parallel execution, memory hierarchies, data movement, and interconnects.
  • Hands-on experience building analytical, transaction-level, or cycle-level performance models, including first-order estimates that help validate and explain simulation results.
  • Comfort working with incomplete specifications, making assumptions explicit, and balancing modeling fidelity with speed of iteration.
  • Strong Rust skills, or expert-level C/C++ skills and a willingness to work in Rust day to day, along with proficiency in Python for workload analysis, experiments, and visualization.
  • Ability to read SystemVerilog RTL and relevant verification results, reconcile them with architectural specifications, and calibrate models as implementation details become available.
  • Excellent communication skills, with the ability to explain what drives a result, how much confidence to place in it, and what the architecture team should investigate or change next.

Responsibilities

  • Architecture Studies and Recommendations: Partner with architects to turn design questions into focused modeling studies with clear assumptions, alternatives, metrics, and recommendations.
  • Workload Analysis: Evaluate representative AI inference workloads across prefill and decode, batch sizes, context lengths, and dense and mixture-of-experts models to identify latency, throughput, and hardware utilization limits.
  • Model Development and Correlation: Develop and extend analytical, transaction-level, and cycle-level models, maintain reusable models in our native Rust simulator, and correlate predictions against RTL simulation or silicon measurements.

Skills

Architecture modeling
Performance modeling
Rust
C/C++
Python
SystemVerilog RTL
Communication

Tools

Rust simulator

Job description

Positron AI is seeking a Senior Architecture & Performance Modeling Engineer to shape the architecture of next-generation AI inference accelerators. You will collaborate with chip architects, build analytical and cycle-level models, and correlate results with RTL/silicon to guide design decisions before RTL exists.

You will own primary modeling responsibility for a generation chip, supporting architectural tradeoffs across compute engines, memory, interconnects, and on-chip data movement.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal)
Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal)

positron.ai • United States

Remote
USD 180,000 - 240,000
Remote-first setup
Company-provided computer
Health, dental, vision for employees &
+3
Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal)
Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal)

Positron AI • United States

On-site
USD 220,000 - 350,000
Remote Senior AI Inference Performance Modeling Engineer
Remote Senior AI Inference Performance Modeling Engineer

positron.ai • United States

Remote
USD 120,000 - 180,000
Remote-first
Company-provided computer
Medical, dental, and vision coverage
+4
Remote-First Senior AI Inference Hardware Architect
Remote-First Senior AI Inference Hardware Architect

Positron AI • United States

Remote
USD 200,000 - 300,000
Health, dental, vision insurance
Life and disability coverage
Unlimited paid time off
+2
Remote AI Accelerator Architecture & Modeling Lead
Remote AI Accelerator Architecture & Modeling Lead

positron.ai • United States

Remote
USD 180,000 - 240,000
Remote-first setup
Company-provided computer
Health, dental, vision for employees &
+3
Lead AI Inference Performance Architect
Lead AI Inference Performance Architect

Acceler8 Talent • San Francisco (CA)

On-site
USD 120,000 - 160,000
Opportunity to shape next-generation AI inference infrastructure
High-impact technical ownership
Work in a fast-moving engineering environment
Remote Modeling & Simulation Engineer (AI Accelerators)
Remote Modeling & Simulation Engineer (AI Accelerators)

positron.ai • United States

Remote
USD 140,000 - 210,000
Medical coverage
Dental coverage
Vision coverage
+9
Remote AI Inference Simulation Engineer
Remote AI Inference Simulation Engineer

Positron • United States

Remote
USD 200,000 - 300,000
Unlimited PTO
Remote first culture
401(k) with company matching
+1
Senior AI ASIC Design Engineer — Lead High-Perf SoCs
Senior AI ASIC Design Engineer — Lead High-Perf SoCs

Positron AI • United States

Hybrid
USD 200,000 - 300,000
Competitive salary
Equity
Flexible work environment
+1
Senior ASIC Architect: Performance & Modeling Lead
Senior ASIC Architect: Performance & Modeling Lead

Meta • Austin (TX)

On-site
USD 146,000 - 209,000
Bonus
Equity
Benefits