Runtime Engineer

Darwin Recruitment

San Jose (CA)

On-site

USD 150,000 - 210,000

Full time

45 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Stock options
Health insurance

Job summary

Darwin Recruitment is seeking an ML Runtime Engineer to design and optimize the runtime that executes ML models on our accelerator hardware. You will own memory allocation, data moves between host and device, and workload scheduling, collaborating with hardware, compiler, kernel and driver teams.

The role requires deep experience in C/C++, multithreading, and low-level systems work, with a strong emphasis on performance, reliability and portability across platforms.

Qualifications

  • Proven experience developing or maintaining a runtime, execution engine or low level systems component.
  • Strong C and C++ skills, including memory management and concurrency.
  • Linux systems programming, IPC, system calls and debugging.

Responsibilities

  • Design and build core runtime components in C/C++ for ML workloads on accelerators.
  • Manage device and context initialization, memory allocation, buffer lifetime, command submission and synchronization.
  • Optimize data movement, memory utilization, scheduling, latency and throughput.

Skills

C/C++
Linux systems
Multithreading
Runtime/engine
Performance profiling
Memory management
Device runtimes

Education

BS/MS in Computer Engineering/CS

Tools

Linux debugging tools

Job description

ML Runtime Engineer

Location: Silicon Valley, California, USA

About the company

A venture backed AI compute start up founded by a team with a track record of shipping high performance silicon. They design silicon, systems and software as one product, combining general purpose processing, AI acceleration and scalable memory in a single architecture that runs from edge devices to data centers.

The role

You will develop and optimize the runtime that executes ML models on the company’s own accelerator hardware. That means owning how memory is allocated, how data moves between host and device, and how workloads are scheduled and run efficiently, working with open standard APIs where they apply.

What you’ll do
  • Design and build core runtime components in modern C and C++ for ML and compute workloads on hardware accelerators
  • Build the mechanisms for device and context initialization, resource and memory allocation, buffer lifetime management, command submission, synchronization and asynchronous execution
  • Optimize data movement between host and device, memory utilization, execution scheduling, and end to end latency and throughput
  • Profile, diagnose and resolve bottlenecks across the runtime, driver, operating system and accelerator execution path
  • Integrate runtime services with compiler outputs, device drivers, kernel interfaces and the hardware architecture
  • Analyze representative ML workloads and benchmarks, and use measurements to guide improvements and regression testing
  • Design robust multithreaded systems with sound synchronization, concurrency control, inter process communication and error handling
  • Support portability and interoperability across hardware platforms and open standard runtime APIs
  • Work with hardware, compiler, kernel, driver, architecture and ML software teams to bring up, validate and optimize new accelerator features
  • Improve runtime observability, diagnostics, test coverage, reliability and maintainability
What you’ll bring
  • 7 to 15 years of relevant software engineering experience, with substantial hands on systems software development
  • Strong C and C++ skills, including debugging complex codebases, memory management, concurrency and performance sensitive design Page 9 of 14 Tsavorite Client Profile
  • Proven experience developing or maintaining a runtime, execution engine, device runtime, accelerator software stack or a comparable low level systems component
  • Strong Linux systems programming: processes and threads, virtual memory, system calls, IPC, synchronization primitives and Linux debugging
  • Practical grasp of multithreaded and asynchronous execution, including race conditions, deadlocks and contention
  • Experience with performance profiling and debugging tools, and the ability to isolate bottlenecks and validate improvements with measurements
  • Experience with hardware accelerators or heterogeneous compute such as GPUs, AI and ML accelerators, DSPs or other specialized processors
  • Understanding of memory hierarchy and data movement, including host and device memory, buffers, allocation strategies and resource lifetime
  • BS or MS in Computer Engineering, Electrical Engineering, Computer Science or a related field
Nice to have
  • MS degree
  • Hands on experience with open standard compute or runtime APIs
Why join

You would take real ownership of a core layer of a new AI platform, working alongside hardware, compiler, kernel and driver engineers at an early stage company where individual engineers have a lot of influence. The package includes competitive compensation, health insurance for you and eligible dependents, and stock options.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

System Runtime Engineer
System Runtime Engineer

Tsavorite Scalable Intelligence, Inc. • Milpitas (CA)

On-site
USD 180,000 - 240,000
Stock options
Health insurance
Member of Technical Staff, System Software (Runtime & Firmware)
Member of Technical Staff, System Software (Runtime & Firmware)

unconventionalinc • United States

Remote
USD 150,000 - 210,000
Health coverage
401k matching
Truly unlimited PTO
+2
Runtime Engineer
Runtime Engineer

Normal Computing • New York (NY)

On-site
USD 180,000 - 260,000
Runtime Systems Engineer for AI Accelerators
Runtime Systems Engineer for AI Accelerators

Tsavorite Scalable Intelligence, Inc. • Milpitas (CA)

On-site
USD 180,000 - 240,000
Stock options
Health insurance
Engineering Manager, Compiler & Runtime
Engineering Manager, Compiler & Runtime

Normal Computing • New York (NY)

On-site
USD 180,000 - 320,000
Sr AI Runtime Architect - Neuromorphic Computing
Sr AI Runtime Architect - Neuromorphic Computing

100 Intel Corporation • Hillsboro (OR)

Hybrid
USD 195,000 - 315,000
Stock bonuses
Hybrid work model
Health insurance
+2
Runtime Engineer
Runtime Engineer

Normal Computing Corp. • Mountain View (CA)

On-site
USD 180,000 - 260,000
Software Engineer, AI accelerator Runtime
Software Engineer, AI accelerator Runtime

OpenAI • San Francisco (CA)

On-site
USD 266,000 - 445,000
Runtime Engineer
Runtime Engineer

Normal Computing Corporation • Mountain View (CA)

On-site
USD 180,000 - 320,000
Runtime Engineer
Runtime Engineer

Normal Computing Corporation • Palo Alto (CA)

On-site
USD 180,000 - 280,000