Edge AI Runtime Engineer

Insider, Inc.; United States; On-site; USD 100,000 - 140,000; Full time

Job summary

Insider, Inc. is looking for an AI Runtime Engineer in the United States. The position requires expertise in developing low-latency, high-performance runtime software for AI accelerators. Candidates should have a Bachelor’s or Master’s degree in a relevant field and at least 3 years of experience in low-level runtime software development. Responsibilities include optimizing the execution stack and collaborating with hardware teams. The role is an opportunity to work on cutting-edge AI technologies in a diverse and dynamic team.

Qualifications

• 3+ years of experience in developing low-level runtime software for AI accelerators, GPUs, or HPC systems.
• Deep understanding of task scheduling, concurrency, and memory hierarchy.
• Experience with hardware-aware optimizations and dataflow architectures.

Responsibilities

• Develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators.
• Implement task scheduling, memory management, and kernel execution strategies for efficient computation.
• Optimize data movement between host and device using PCIe, DMA, shared memory.

Skills

C/C++ programming

Low-level systems programming

Task scheduling

Memory management

Debugging and profiling

Education

Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field

Tools

ONNX Runtime

TensorRT

TVM

OpenVINO

Job description

Insider, Inc. is looking for an AI Runtime Engineer in the United States. The position requires expertise in developing low-latency, high-performance runtime software for AI accelerators. Candidates should have a Bachelor’s or Master’s degree in a relevant field and at least 3 years of experience in low-level runtime software development. Responsibilities include optimizing the execution stack and collaborating with hardware teams. The role is an opportunity to work on cutting-edge AI technologies in a diverse and dynamic team.