Engineering Manager: Compiler & Runtime for AI Accelerators

Normal Computing

Mountain View (NY)

On-site

USD 180,000 - 280,000

Full time

11 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Normal Computing in New York City and Silicon Valley is seeking an Engineering Manager, Compiler & Runtime to lead the team that turns PyTorch models into our hardware and the runtime that executes them.

You will hire engineers, define growth paths, and plan work against the hardware program. You will collaborate with the senior compiler architect to align designs with the roadmap, while teams test against simulators and FPGA prototypes before tapeout.

Qualifications

  • Experience managing engineers who build compilers, runtimes, or kernels for accelerators or other non-standard hardware.
  • Track record of hiring and mentoring strong systems engineers.
  • Enough depth in compilers and runtimes to review designs and weigh technical trade-offs with senior engineers.
  • Experience delivering software against a hardware schedule, from simulation through bring-up.
  • Familiarity with state of the art ML compiler stacks and with LLM inference workloads.

Responsibilities

  • Team Building: Grow the compiler and runtime team from its first engineers, set the hiring bar, and develop each engineer's growth and career.
  • Delivery: Turn the Systems Software roadmap into plans, milestones, and staffing for the compiler, runtime, and kernels, and deliver against them. Success means LLMs run end to end on our hardware through PyTorch.
  • Technical Partnership: Work with our compiler architect so that technical decisions get made, staffed, and finished. Stay close enough to the work to review designs and weigh trade-offs.
  • Cross-Team Coordination: Coordinate with the hardware team, which owns drivers and firmware, and with the serving and simulation work that depends on the compiler and runtime.
  • Simulation-to-Silicon Continuity: Keep the compiler and runtime working against simulators, FPGA prototypes, and silicon as the hardware matures, so software development never waits on tapeout.
  • Engineering Practices: Set up the testing, release, and review practices that make the stack reliable enough to ship to customers.

Skills

Engineering management
Compilers and runtimes
Hiring and mentoring
System design review
LLM inference workloads

Tools

Simulators
FPGA prototypes
PyTorch

Job description

Normal Computing in New York City and Silicon Valley is seeking an Engineering Manager, Compiler & Runtime to lead the team that turns PyTorch models into our hardware and the runtime that executes them.

You will hire engineers, define growth paths, and plan work against the hardware program. You will collaborate with the senior compiler architect to align designs with the roadmap, while teams test against simulators and FPGA prototypes before tapeout.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Engineering Manager, Compiler & Runtime for AI Accelerators
Engineering Manager, Compiler & Runtime for AI Accelerators

Normal Computing Corp. • New York (NY)

On-site
USD 210,000 - 320,000
Engineering Manager, Compiler & Runtime — AI Hardware Systems
Engineering Manager, Compiler & Runtime — AI Hardware Systems

Normal Computing Corporation • Mountain View (CA)

On-site
USD 180,000 - 260,000
Engineering Manager, AI Compiler & Runtime
Engineering Manager, AI Compiler & Runtime

Normal Computing • New York (NY)

On-site
USD 180,000 - 320,000
Engineering Manager (Compiler & Runtime)
Engineering Manager (Compiler & Runtime)

Normal Computing Corp. • New York (NY)

On-site
USD 210,000 - 320,000
Engineering Manager, Compiler & Runtime
Engineering Manager, Compiler & Runtime

Normal Computing • New York (NY)

On-site
USD 180,000 - 320,000
Engineering Manager, Compiler & Runtime
Engineering Manager, Compiler & Runtime

Normal Computing Corporation • Mountain View (CA)

On-site
USD 180,000 - 260,000
Senior AI Compiler & Runtime Architect
Senior AI Compiler & Runtime Architect

HTEC Group • Palo Alto (CA)

Hybrid
USD 200,000 - 350,000
Medical, dental and vision coverage
401(k) with Company match
Unlimited vacation
+3
Engineering Manager, Compiler & Runtime
Engineering Manager, Compiler & Runtime

Normal Computing • Mountain View (NY)

On-site
USD 180,000 - 280,000
Backend Compiler Engineer for AI Accelerators
Backend Compiler Engineer for AI Accelerators

Acceler8 • United States

On-site
USD 140,000 - 220,000
Lead AI Graph Compiler Engineer
Lead AI Graph Compiler Engineer

EnCharge AI • United States

Remote
USD 190,000 - 255,000