Hands-on Software Architect – AI Accelerator Runtime (Palo Alto)

Acceler8; California; On-site; USD 250,000 - 350,000; Full time

Benefits offered by this job

Equity

Bonus

Job summary

Acceler8 Talent is seeking a hands-on Software Architect for an AI accelerator startup in Palo Alto, CA, to own the accelerator runtime and guide the platform from pre-silicon development to real hardware execution.

You will collaborate with hardware engineers on pre-silicon validation, memory management, scheduling, and host-device interfaces to enable efficient LLM inference and a novel AI compute platform.

Qualifications

• Strong C/C++ and Linux systems engineering experience.
• Background in GPU, AI accelerator or HPC runtime development.
• Experience with pre-silicon development, validation or silicon bring-up.
• Deep understanding of hardware/software interaction, memory systems and execution runtimes.

Responsibilities

• Architect and build an accelerator runtime from the ground up.
• Own host-device interfaces, memory management, scheduling and asynchronous execution.
• Work directly with hardware engineers on pre-silicon validation and silicon bring-up.
• Optimize LLM inference, including prefill/decode, KV caching and batching.
• Build the software foundation for an entirely new AI compute platform.

Skills

C/C++

Linux

GPU/AI accelerator runtime

Pre-silicon development

Memory systems

Job description

Acceler8 Talent is seeking a hands-on Software Architect for an AI accelerator startup in Palo Alto, CA, to own the accelerator runtime and guide the platform from pre-silicon development to real hardware execution.

You will collaborate with hardware engineers on pre-silicon validation, memory management, scheduling, and host-device interfaces to enable efficient LLM inference and a novel AI compute platform.