AI Accelerator Runtime Engineer — Execution & Performance

Oho Group

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

5 days ago

Be an early applicant

Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Oho Group is seeking an AI Accelerator Software Engineer — Runtime & Execution to help build the software stack for a new accelerator architecture. The role focuses on turning compiled programs into efficient execution on hardware, interfacing with compiler, device-level software, and workload execution to address synchronization, memory, scheduling, and performance challenges.

You will work on core components of the runtime, manage program dispatch and asynchronous execution, and collaborate

Qualifications

Experience with runtimes, drivers, compilers or performance-sensitive infrastructure.
Understanding of concurrency, synchronization and memory management.
Strong debugging skills across software and hardware boundaries.

Responsibilities

Build core components of an accelerator runtime and execution engine.
Manage program dispatch, synchronization and asynchronous execution.
Design memory allocation, movement and lifetime-management mechanisms.
Implement interfaces between compiled programs and underlying devices.
Support multi-device execution and communication.
Profile runtime behavior and remove latency, memory and concurrency bottlenecks.
Develop debugging, tracing and performance-analysis capabilities.
Collaborate closely with compiler, architecture and framework engineers.