ML Runtime Architect for AI Accelerator

Darwin Recruitment

San Jose (CA)

On-site

USD 150,000 - 210,000

Full time

45 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Stock options
Health insurance

Job summary

Darwin Recruitment is seeking an ML Runtime Engineer to design and optimize the runtime that executes ML models on our accelerator hardware. You will own memory allocation, data moves between host and device, and workload scheduling, collaborating with hardware, compiler, kernel and driver teams.

The role requires deep experience in C/C++, multithreading, and low-level systems work, with a strong emphasis on performance, reliability and portability across platforms.

Qualifications

  • Proven experience developing or maintaining a runtime, execution engine or low level systems component.
  • Strong C and C++ skills, including memory management and concurrency.
  • Linux systems programming, IPC, system calls and debugging.

Responsibilities

  • Design and build core runtime components in C/C++ for ML workloads on accelerators.
  • Manage device and context initialization, memory allocation, buffer lifetime, command submission and synchronization.
  • Optimize data movement, memory utilization, scheduling, latency and throughput.

Skills

C/C++
Linux systems
Multithreading
Runtime/engine
Performance profiling
Memory management
Device runtimes

Education

BS/MS in Computer Engineering/CS

Tools

Linux debugging tools

Job description

Darwin Recruitment is seeking an ML Runtime Engineer to design and optimize the runtime that executes ML models on our accelerator hardware. You will own memory allocation, data moves between host and device, and workload scheduling, collaborating with hardware, compiler, kernel and driver teams.

The role requires deep experience in C/C++, multithreading, and low-level systems work, with a strong emphasis on performance, reliability and portability across platforms.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Runtime Engineer
Runtime Engineer

Darwin Recruitment • San Jose (CA)

On-site
USD 150,000 - 210,000
Stock options
Health insurance
AI Accelerator Runtime Systems Engineer
AI Accelerator Runtime Systems Engineer

OpenAI, Inc. • United States

On-site
USD 180,000 - 240,000
Runtime Systems Engineer for AI Accelerators
Runtime Systems Engineer for AI Accelerators

Tsavorite Scalable Intelligence, Inc. • Milpitas (CA)

On-site
USD 180,000 - 240,000
Stock options
Health insurance
ML Accelerator Systems Software Engineer
ML Accelerator Systems Software Engineer

Annapurna Labs • Cupertino (CA)

On-site
USD 134,000 - 163,000
Systems ML Compiler & Kernel Engineer (Equity)
Systems ML Compiler & Kernel Engineer (Equity)

Meta • Santa Clara (CA)

On-site
USD 180,000 - 320,000
Bonus
Equity
Benefits
Remote Runtime Engineer — ML Optimization with Triton
Remote Runtime Engineer — ML Optimization with Triton

kernelize • United States

Remote
USD 120,000 - 190,000
Fully remote
Senior Runtime Engineer, AI Hardware
Senior Runtime Engineer, AI Hardware

Normal Computing Corporation • Mountain View (CA)

On-site
USD 180,000 - 320,000
ML Accelerator Software Engineer
ML Accelerator Software Engineer

Amazon Jobs • Cupertino (CA)

On-site
USD 134,000 - 163,000
Neuron Runtime Engineer for ML Accelerators & Profiling
Neuron Runtime Engineer for ML Accelerators & Profiling

AWS Neuron • Cupertino (CA)

On-site
USD 165,000 - 224,000
Hands-on Software Architect — AI Accelerator Runtime
Hands-on Software Architect — AI Accelerator Runtime

Acceler8 Talent • Palo Alto (CA)

On-site
USD 180,000 - 260,000