Engineering Manager, Compiler & Runtime

Normalcomputing

Mountain View (CA)

On-site

USD 230,000 - 340,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Normal Computing is seeking an Engineering Manager, Compiler & Runtime to build and lead the team that writes the core software for translating PyTorch models to our memory-centric hardware. You will hire and mentor engineers, set the product roadmap, and partner with the senior compiler architect to align software with hardware goals.

The role focuses on running the compiler, runtime, and kernels end-to-end, with work on simulators, FPGA prototypes, and eventual silicon, ensuring a smooth

Qualifications

  • Experience leading engineers building compilers, runtimes, or kernels for accelerators.
  • Proven track record hiring and mentoring systems engineers.
  • Hands-on familiarity with ML compiler stacks and PyTorch workflows.
  • Experience delivering software on hardware schedules from simulation to bring-up.
  • Ability to collaborate with hardware teams and review design trade-offs.

Responsibilities

  • Build and lead the compiler & runtime team and align with hardware roadmap.
  • Hire engineers, plan work, and deliver milestones.
  • Review designs with the compiler architect and trade-offs.
  • Coordinate with hardware drivers/firmware and with serving and simulation work.
  • Maintain compatibility with simulators, FPGA prototypes, and silicon as development progresses.
  • Establish testing, release, and code-review practices.

Skills

Team leadership
Compiler & runtime
Hardware-software co-design
Hiring & mentoring
PyTorch/ML workflows

Tools

FPGA
Simulators

Job description

NORMAL COMPUTING | BUILD WITH US

Normal is an applied AI company solving the hardest problems in AI and silicon. We build foundational hardware and software for the semiconductor industry, critical AI infrastructure, and the broader systems that power our world, in partnership with the world's most advanced institutions. We work as one team across New York City, Silicon Valley (Mountain View), London, Copenhagen, and Seoul.

THE ROLE

Normal's hardware runs the most memory-bound parts of large-model inference inside memory itself, rather than shuttling weights to a processor. The software that makes this programmable doesn't exist yet in any standard form. As Engineering Manager, Compiler & Runtime, you will build and lead the team that writes the core of it: the compiler that takes PyTorch models to our hardware, the runtime that executes them, and the kernels in between. This is a people-leadership role on a technical team. You will hire the team, plan its work against the hardware program, and partner with our senior compiler architect, who sets the team's technical direction. Our chip is pre-silicon, so the team builds against simulators and FPGA prototypes first.

WHAT YOU WILL OWN
  • Team Building: Grow the compiler and runtime team from its first engineers, set the hiring bar, and develop each engineer's growth and career.
  • Delivery: Turn the Systems Software roadmap into plans, milestones, and staffing for the compiler, runtime, and kernels, and deliver against them. Success means LLMs run end to end on our hardware through PyTorch.
  • Technical Partnership: Work with our compiler architect so that technical decisions get made, staffed, and finished. Stay close enough to the work to review designs and weigh trade-offs.
  • Cross-Team Coordination: Coordinate with the hardware team, which owns drivers and firmware, and with the serving and simulation work that depends on the compiler and runtime.
  • Simulation-to-Silicon Continuity: Keep the compiler and runtime working against simulators, FPGA prototypes, and silicon as the hardware matures, so software development never waits on tapeout.
  • Engineering Practices: Set up the testing, release, and review practices that make the stack reliable enough to ship to customers.
WHAT MAKES YOU A GREAT FIT
  • Experience managing engineers who build compilers, runtimes, or kernels for accelerators or other non-standard hardware
  • Track record of hiring and mentoring strong systems engineers
  • Enough depth in compilers and runtimes to review designs and weigh technical trade-offs with senior engineers
  • Experience delivering software against a hardware schedule, from simulation through bring-up
  • Familiarity with state of the art ML compiler stacks and with LLM inference workloads
BONUS POINTS
  • Experience taking an accelerator software stack from zero to production at a startup or new hardware initiative
  • Experience with in-memory compute, processing-in-memory, or analog hardware interfaces
  • Experience shipping an SDK or software product to external customers
Equal Employment Opportunity Statement

Normal Computing is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected status.

Accessibility Accommodations

Normal Computing is committed to providing reasonable accommodations to individuals with disabilities. If you need assistance or an accommodation due to a disability, please let us know at accommodations@normalcomputing.com.

Privacy Notice

By submitting your application, you agree that Normal Computing may collect, use, and store your personal information for employment-related purposes in accordance with our Applicant Privacy Notice https://normalcomputing.com/applicant-privacy-notice.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Engineering Manager, Compiler & Runtime
Engineering Manager, Compiler & Runtime

Normal Computing Corporation • Mountain View (CA)

On-site
USD 180,000 - 260,000
Compiler Backend Engineer
Compiler Backend Engineer

Normal Computing Corporation • Mountain View (CA)

On-site
USD 180,000 - 280,000
Compiler Backend Engineer
Compiler Backend Engineer

Normal Computing Corp. • Mountain View (CA)

On-site
USD 180,000 - 240,000
Compiler Backend Engineer
Compiler Backend Engineer

Normal Computing Corporation • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Compiler Frontend Engineer
Compiler Frontend Engineer

Normal Computing Corporation • Palo Alto (CA)

On-site
USD 190,000 - 250,000
Compiler Frontend Engineer
Compiler Frontend Engineer

Normal Computing Corporation • Mountain View (CA)

On-site
USD 180,000 - 260,000
Runtime Engineer
Runtime Engineer

Normal Computing Corp. • Mountain View (CA)

On-site
USD 180,000 - 260,000
Runtime Engineer
Runtime Engineer

Normal Computing Corporation • Mountain View (CA)

On-site
USD 180,000 - 320,000
Compiler Frontend Engineer
Compiler Frontend Engineer

Normal Computing Corp. • Mountain View (CA)

On-site
USD 180,000 - 280,000
Runtime Engineer
Runtime Engineer

Normal Computing Corporation • Palo Alto (CA)

On-site
USD 180,000 - 280,000