Staff AI Inference and Acceleration Engineer

Figure AI

San Jose (CA)

On-site

USD 180,000 - 275,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Figure AI, based in San Jose, CA, seeks a Staff AI Inference & Acceleration Engineer to own the on-board inference architecture for humanoid robots. You will map models to accelerators, balance latency vs. power, and drive compute budgets for real-time systems.

You will optimize toolchains end-to-end, apply quantization and pruning, profile workloads, and collaborate with AI/ML teams to ensure hardware-friendly model constraints.

Qualifications

  • M.S. or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or a related field — or equivalent industry experience.
  • At least 8 years of industry experience in hardware acceleration, ML systems, or compute architecture.
  • Deep understanding of AI/ML inference — model formats (ONNX, TFLite, etc.), inference runtimes, and deployment pipelines.
  • Hands-on experience optimizing models for edge or embedded hardware using quantization, pruning, and operator-level tuning.
  • Strong understanding of computer architecture — memory hierarchies, data movement, and heterogeneous compute.
  • Experience profiling and benchmarking inference workloads across CPU, GPU, NPU, DSP.
  • Familiarity with low-level toolchains and compilation frameworks (e.g. TVM, MLIR, TensorRT, Torch, SNPE/QNN, JAX, CUDA, ROCm).
  • Solid software engineering skills in C++ and Python.
  • Strong cross-functional communication skills — able to work effectively across hardware, software, and AI/ML teams.

Responsibilities

  • Own the on-board inference architecture — mapping models to accelerators (NPU, GPU, DSP, CPU) based on latency, power, and memory budgets.
  • Partition inference workloads across heterogeneous compute resources, balancing real-time performance with power and thermal constraints.
  • Define and maintain a system-level compute budget across all inference tasks running on the robot.
  • Evaluate next-generation acceleration hardware and contribute to the definition of future compute platform requirements.
  • Optimize inference toolchains end-to-end — from model export through runtime execution — for target hardware.
  • Apply quantization (INT8, INT4, mixed-precision), pruning, operator fusion, and other compression techniques to reduce compute, memory, and power footprint.
  • Profile inference pipelines to identify and eliminate bottlenecks in latency, memory bandwidth, and power consumption.
  • Optimize kernel scheduling, memory layout, and data movement across the compute hierarchy.
  • Partner closely with the AI/ML team to define model architecture constraints that are hardware-friendly from the outset.
  • Work with the Platform Software team on runtime integration, scheduling, and power management.
  • Engage with silicon vendors and research teams to track the accelerator landscape and influence hardware roadmaps.

Skills

C++
Python
Hardware acceleration
ML inference
Profiling & benchmarking
Cross-functional communication
Edge/embedded optimization
ONNX/TFLite formats

Education

Master's degree or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or related field

Tools

TVM
MLIR
TensorRT
Torch
SNPE/QNN
CUDA
JAX
ROCm

Job description

Figure is an AI robotics company developing autonomous general-purpose humanoid robots. The goal of the company is to ship humanoid robots with human level intelligence. Its robots are engineered to perform a variety of tasks in the home and commercial markets. Figure is headquartered in San Jose, CA.

We are looking for a Staff AI Inference & Acceleration Engineer to join the Platform Software team and own the on-board inference architecture for Figure’s humanoid robots. You will be the technical authority on how AI workloads are mapped, optimized, and executed across the robot’s compute hardware — driving down power consumption and cost while meeting the strict latency and reliability demands of a real-time autonomous system.

Responsibilities:
  • Own the on-board inference architecture — mapping models to available accelerators (NPU, GPU, DSP, CPU) based on latency, power, and memory budgets.
  • Partition inference workloads across heterogeneous compute resources, balancing real-time performance with power and thermal constraints.
  • Define and maintain a system-level compute budget across all inference tasks running on the robot.
  • Evaluate next-generation acceleration hardware and contribute to the definition of future compute platform requirements.
  • Optimize inference toolchains end-to-end — from model export through runtime execution — for target hardware.
  • Apply quantization (INT8, INT4, mixed-precision), pruning, operator fusion, and other compression techniques to reduce compute, memory, and power footprint.
  • Profile inference pipelines to identify and eliminate bottlenecks in latency, memory bandwidth, and power consumption.
  • Optimize kernel scheduling, memory layout, and data movement across the compute hierarchy.
  • Partner closely with the AI/ML team to define model architecture constraints that are hardware-friendly from the outset.
  • Work with the Platform Software team on runtime integration, scheduling, and power management.
  • Engage with silicon vendors and research teams to track the accelerator landscape and influence hardware roadmaps.
Requirements:
  • M.S. or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or a related field — or equivalent industry experience.
  • At least 8 years of industry experience in hardware acceleration, ML systems, or compute architecture.
  • Deep understanding of AI/ML inference — model formats (ONNX, TFLite, etc.), inference runtimes, and deployment pipelines.
  • Hands-on experience optimizing models for edge or embedded hardware using quantization, pruning, and operator-level tuning.
  • Strong understanding of computer architecture — memory hierarchies, data movement, and heterogeneous compute.
  • Experience profiling and benchmarking inference workloads across CPU, GPU, NPU, DSP.
  • Familiarity with low-level toolchains and compilation frameworks (e.g. TVM, MLIR, TensorRT, Torch, SNPE/QNN, JAX, CUDA, ROCm).
  • Solid software engineering skills in C++ and Python.
  • Strong cross-functional communication skills — able to work effectively across hardware, software, and AI/ML teams.
Bonus Qualifications:
  • Knowledge of real-time operating constraints and their impact on inference scheduling.
  • Track record of co-designing model architectures with ML teams to meet hardware constraints.

The US base salary range for this full-time position is $180,000 to $275,000 per year.

The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI Inference Architect for Humanoid Robotics
Staff AI Inference Architect for Humanoid Robotics

Figure AI • San Jose (CA)

On-site
USD 180,000 - 275,000
Helix AI Engineer, Data Infrastructure
Helix AI Engineer, Data Infrastructure

Figure • San Jose (CA)

On-site
USD 150,000 - 350,000
Staff + Senior Software Engineer, Inference
Staff + Senior Software Engineer, Inference

Anthropic • New York (NY)

Hybrid
USD 320,000 - 485,000
Staff+ Software Engineer, Inference Velocity
Staff+ Software Engineer, Inference Velocity

Anthropic • Seattle (WA)

On-site
USD 405,000 - 485,000
Developer Productivity Intern [Winter 2027]
Developer Productivity Intern [Winter 2027]

Figure • San Jose (CA)

On-site
USD 55,000 - 62,000
Software Engineer, Inference - Performance Optimization
Software Engineer, Inference - Performance Optimization

OpenAI, Inc. • San Francisco (CA)

On-site
USD 295,000 - 555,000
Equity
Senior AI Performance Architect
Senior AI Performance Architect

Qualcomm • Raleigh (NC)

On-site
USD 126,700 - 217,900
Competitive annual discretionary bonus
Annual RSU grants
Comprehensive benefits package
Senior Software Engineer - Model Performance
Senior Software Engineer - Model Performance

inference.net • San Francisco (CA)

Hybrid
USD 220,000 - 320,000
Equity in a high-growth startup
Comprehensive benefits
Staff+ Software Engineer, Inference Runtime
Staff+ Software Engineer, Inference Runtime

Anthropic • New York (NY)

Hybrid
USD 405,000 - 485,000
Generous vacation
Parental leave
Flexible working hours
+1
ML Engineer, Inference Optimization
ML Engineer, Inference Optimization

Build AI • San Francisco (CA)

On-site
USD 150,000 - 210,000
Competitive pay
Medical, dental, and vision packages
Housing subsidy $2k/month near SF offi
+6