Staff Engineer, AI Inference & Benchmarking

S27a; San Francisco, New York (CA, NY); Hybrid; USD 150,000 - 210,000; Full time

Job summary

SemiAnalysis LLC is hiring a Member of Technical Staff to develop training and inference benchmarks and system modelling for AI hardware. You will contribute to writing our newsletter articles with potential authorship recognition and collaborate with a global team of analysts.

We hire at all experience levels and include a paid coding challenge reflecting typical daily tasks at SemiAnalysis. This role offers opportunities to impact research, benchmarks, and industry insights across AI compute

Qualifications

• Demonstrated experience in ML frameworks such as PyTorch or JAX.
• Solid understanding of transformer architecture, LLM parallelism strategies, and/or CUDA parallel programming.
• Strong research skills and the ability to synthesize information from multiple sources.
• Undergraduate degree in CS/Engineering or related field is not required.

Responsibilities

• Conduct training and inference benchmarks across AI hardware (e.g., NVIDIA H100, AMD Mi300X, Google TPUs, AWS Trainium2).
• Author detailed technical research reports analyzing benchmark results, hardware performance, scalability, and efficiency.
• Develop system modelling using Python and NCCL for scalable AI compute clusters.
• Establish and maintain partnerships with neocloud providers and AI chip manufacturers.
• Stay current on industry trends by attending major conferences (e.g., NeurIPS, MLSys, NVIDIA GTC).

Skills

PyTorch experience

JAX experience

LLM parallelism

CUDA parallel programming

Research skills

Independent work

Job description

SemiAnalysis LLC is hiring a Member of Technical Staff to develop training and inference benchmarks and system modelling for AI hardware. You will contribute to writing our newsletter articles with potential authorship recognition and collaborate with a global team of analysts.

We hire at all experience levels and include a paid coding challenge reflecting typical daily tasks at SemiAnalysis. This role offers opportunities to impact research, benchmarks, and industry insights across AI compute