Hybrid System Software Engineer — AI Infrastructure

Delos Data; Palo Alto (CA); Hybrid; USD 140,000 - 200,000; Full time

Benefits offered by this job

Equity

401k

Benefits

Job summary

Delos Data is hiring a System Software Engineer to bridge high‑level AI frameworks with low‑level system software. You will design and implement communication and execution primitives enabling large‑scale AI models to run efficiently on thousands of GPUs.

The role emphasizes solving hard systems problems in the generative AI era, with a hybrid work setup in Palo Alto or Charlottesville, VA, and a compensation package including equity and 401(k) benefits.

Qualifications

• Bachelor's or Master's in CS/CE or a related field.
• Strong systems programming experience in Linux.
• Solid knowledge of memory management and concurrency.

Responsibilities

• Collaborate across the stack to influence the design of our foundational technology for next‑gen AI models.
• Identify and resolve performance bottlenecks in distributed training and inference workloads via deep analytical work at the software–hardware interface.
• Conduct rigorous performance benchmarking and characterization on multi‑node clusters.

Skills

C++

Python

Linux

Memory management

Concurrency

OS internals

CUDA

PyTorch

JAX

DeepSpeed

vLLM

Education

Bachelor's or Master's in CS/CE

Job description

Delos Data is hiring a System Software Engineer to bridge high‑level AI frameworks with low‑level system software. You will design and implement communication and execution primitives enabling large‑scale AI models to run efficiently on thousands of GPUs.

The role emphasizes solving hard systems problems in the generative AI era, with a hybrid work setup in Palo Alto or Charlottesville, VA, and a compensation package including equity and 401(k) benefits.