Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal)

Positron AI

United States

On-site

USD 220,000 - 350,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Positron AI is seeking a Senior Architecture & Performance Modeling Engineer to shape the architecture of next-generation AI inference accelerators. You will collaborate with chip architects, build analytical and cycle-level models, and correlate results with RTL/silicon to guide design decisions before RTL exists.

You will own primary modeling responsibility for a generation chip, supporting architectural tradeoffs across compute engines, memory, interconnects, and on-chip data movement.

Qualifications

  • 5+ years of experience in computer architecture, microarchitecture, or performance modeling for accelerators, CPUs, or GPUs.
  • Demonstrated experience using models to influence architectural decisions, such as identifying a bottleneck, comparing design alternatives, or recommending a change backed by quantitative analysis.
  • A strong understanding of pipelines, queues, parallel execution, memory hierarchies, data movement, and interconnects.
  • Hands-on experience building analytical, transaction-level, or cycle-level performance models, including first-order estimates that help validate and explain simulation results.
  • Comfort working with incomplete specifications, making assumptions explicit, and balancing modeling fidelity with speed of iteration.
  • Strong Rust skills, or expert-level C/C++ skills and a willingness to work in Rust day to day, along with proficiency in Python for workload analysis, experiments, and visualization.
  • Ability to read SystemVerilog RTL and relevant verification results, reconcile them with architectural specifications, and calibrate models as implementation details become available.
  • Excellent communication skills, with the ability to explain what drives a result, how much confidence to place in it, and what the architecture team should investigate or change next.

Responsibilities

  • Architecture Studies and Recommendations: Partner with architects to turn design questions into focused modeling studies with clear assumptions, alternatives, metrics, and recommendations.
  • Workload Analysis: Evaluate representative AI inference workloads across prefill and decode, batch sizes, context lengths, and dense and mixture-of-experts models to identify latency, throughput, and hardware utilization limits.
  • Model Development and Correlation: Develop and extend analytical, transaction-level, and cycle-level models, maintain reusable models in our native Rust simulator, and correlate predictions against RTL simulation or silicon measurements.

Skills

Architecture modeling
Performance modeling
Rust
C/C++
Python
SystemVerilog RTL
Communication

Tools

Rust simulator

Job description

Role Overview

As a Senior Architecture & Performance Modeling Engineer, you will help shape the architecture of our next-generation AI inference accelerators. You will work directly with chip architects to explore architectural options, quantify tradeoffs, identify bottlenecks, and turn modeling results into actionable design recommendations.

This work starts before RTL exists. You will use analytical models and our in-house simulators to answer architectural questions quickly, then refine and validate those models as the design matures. Each engineer on the team takes primary modeling responsibility for a next-generation chip while contributing to a shared modeling framework.

Key Responsibilities
Architecture Studies and Recommendations

Partner with architects to turn design questions into focused modeling studies with clear assumptions, alternatives, metrics, and recommendations.

Perform what-if analysis across compute engines, memory capacity and bandwidth, dataflow, DMA, command processing, on-chip interconnect, and chip-to-chip communication.

Compare architectural options, explain performance sensitivities, and recommend changes within the system, power, area, and implementation constraints established with the architecture team.

Workload Analysis

Evaluate representative AI inference workloads across prefill and decode, batch sizes, context lengths, and dense and mixture-of-experts models to identify what limits latency, throughput, and hardware utilization.

Provide timely feedback throughout the design cycle by communicating findings, investigating unexpected results, and updating studies as workloads and architectural choices evolve.

Model Development and Correlation

Develop and extend analytical, transaction-level, and cycle-level models, choosing the level of detail needed to answer each question with useful turnaround time.

Maintain reusable models in our native Rust simulator and correlate predictions against RTL simulation, emulation, or silicon measurements as they become available, with regression coverage and clear documentation of assumptions, limitations, and discrepancies.

Required Qualifications
  • 5+ years of experience in computer architecture, microarchitecture, or performance modeling for accelerators, CPUs, or GPUs.
  • Demonstrated experience using models to influence architectural decisions, such as identifying a bottleneck, comparing design alternatives, or recommending a change backed by quantitative analysis.
  • A strong understanding of pipelines, queues, parallel execution, memory hierarchies, data movement, and interconnects.
  • Hands-on experience building analytical, transaction-level, or cycle-level performance models, including first-order estimates that help validate and explain simulation results.
  • Comfort working with incomplete specifications, making assumptions explicit, and balancing modeling fidelity with speed of iteration.
  • Strong Rust skills, or expert-level C/C++ skills and a willingness to work in Rust day to day, along with proficiency in Python for workload analysis, experiments, and visualization.
  • Ability to read SystemVerilog RTL and relevant verification results, reconcile them with architectural specifications, and calibrate models as implementation details become available.
  • Excellent communication skills, with the ability to explain what drives a result, how much confidence to place in it, and what the architecture team should investigate or change next.
Preferred Qualifications
  • Experience with LLM inference, including attention, KV caches, quantization, mixture-of-experts workloads, and parallelism across multiple chips.
  • A track record of connecting workload behavior and software execution choices to hardware performance.
Leveling & Scope

While this role is currently posted at a specific level, we are a growth-oriented organization and are open to hiring at a more senior level for the right candidate. Please note that this job description serves as a focused but generalized overview of the role; specific responsibilities and impact expectations will be tailored to the experience and seniority of the final hire.

Why Join Us?

You will own the performance modeling for a next-generation inference chip and see your analysis shape real architectural decisions before RTL is written.

You will work side by side with the architects behind Asimov and Titan on the hardware that defines how frontier models are served at scale.

Compensation & Benefits

The base salary range for this role for Senior: $220,000 - $270,000, for Principal: $270,000-$350,000.

Please note that the figures provided represent the base salary range only and do not include other elements of our total compensation package, equity, or comprehensive benefits.

At Positron AI, we value the unique expertise each candidate brings. While the range above reflects our typical expectation for the position, we reserve the flexibility to exceed this range for candidates whose specialized skills, significant experience,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal)
Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal)

positron.ai • United States

Remote
USD 180,000 - 240,000
Remote-first setup
Company-provided computer
Health, dental, vision for employees &
+3
ASIC Architect, Principal (AI Inference)
ASIC Architect, Principal (AI Inference)

Positron AI • United States

Remote
USD 300,000 - 350,000
Health insurance
Dental insurance
Vision insurance
+3
Modeling & Simulation Engineer
Modeling & Simulation Engineer

Positron • United States

Remote
USD 200,000 - 300,000
Unlimited PTO
Remote first culture
401(k) with company matching
+1
Senior AI Inference Architecture & Performance Modeling
Senior AI Inference Architecture & Performance Modeling

Positron AI • United States

On-site
USD 220,000 - 350,000
ML Systems Engineer, Model Architectures (Mid/Senior/Principal)
ML Systems Engineer, Model Architectures (Mid/Senior/Principal)

Positron AI • United States

On-site
USD 160,000 - 350,000
Fully company-paid medical, dental, &
Company-paid life/disability
Unlimited PTO
+2
AI Silicon Performance Modeling and Analysis Engineer
AI Silicon Performance Modeling and Analysis Engineer

100 Intel Corporation • Santa Clara (CA)

Hybrid
USD 142,000 - 232,000
Performance Engineer, Hardware
Performance Engineer, Hardware

River AI Inc. • Palo Alto (CA), Austin (TX)

On-site
USD 200,000 - 420,000
Health benefits
Unlimited PTO
Relocation assistance
Performance Engineer, Hardware
Performance Engineer, Hardware

River AI • Palo Alto (CA)

On-site
USD 200,000 - 420,000
Health, dental, vision benefits
Unlimited PTO
Relocation support
Member of Technical Staff, Performance Modeling
Member of Technical Staff, Performance Modeling

Netpreme • Boston (MA)

On-site
USD 140,000 - 230,000
Health, Dental, and Vision for you and
Lunch stipend
EV charging at offices
+1
Performance & Debug Software Engineer – AI Inference
Performance & Debug Software Engineer – AI Inference

Positron AI • United States

Remote
USD 200,000 - 300,000
Fully company-paid health, dental, and
Vision insurance
Unlimited paid time off
+2