Systems Software Engineer (C++/Rust) - AI & HPC Infrastructure

The AES Group; United States; Remote; USD 96,000 - 152,000; Full time

Job summary

The AES Group is seeking a highly technical Systems Software Engineer (C++/Rust) to help build scalable AI and HPC infrastructure. You will work across the stack—from kernel-level components to distributed services—on hardware accelerators, networking, and storage.

This remote, long-term contract role offers the chance to collaborate with industry-leading engineers and contribute to data-center-scale systems, performance optimization, and future AI pipelines.

Qualifications

• Strong proficiency in C++ and/or Rust.
• Deep understanding of Linux operating systems and systems programming.
• Experience with multithreading, concurrency, memory management, and performance optimization.
• Strong debugging and problem-solving skills.
• Comfortable reading and understanding complex codebases.
• Curiosity and willingness to learn new technologies rapidly.
• Passion for building infrastructure and solving challenging technical problems.

Responsibilities

• Develop high-performance systems software in C++ and Rust.
• Work across Linux kernels, drivers, runtimes, operating systems, services, and applications.
• Design and optimize software for AI and HPC workloads.
• Build components that interface with GPUs, accelerators, networking, and storage systems.
• Develop distributed services that operate across large-scale compute environments.
• Investigate performance bottlenecks and optimize systems for throughput, latency, and efficiency.
• Collaborate with hardware, platform, and AI engineers to build next-generation infrastructure.
• Participate in architecture, design reviews, debugging, and performance analysis.

Skills

C++ and Rust programming

Linux systems programming

Multithreading and concurrency

Performance optimization

Debugging and troubleshooting

Reading complex codebases

Willingness to learn new tech

Infrastructure development

Tools

CUDA

OpenCL

SYCL

ROCm

InfiniBand

RDMA

Linux kernel development

Device driver development

Open-source contributions

Job description

Role:

Systems Software Engineer (C++ / Rust) AI & HPC Infrastructure

Location:

Remote

Job Type:

Long Term Contract

Job Description

Our client is building the interoperability layer for AI infrastructure. Their mission is to eliminate software and hardware incompatibility across the AI ecosystem, enabling AI applications to run on any accelerator, any server, and any data center. They are tackling one of the largest challenges in AI computing today: hardware lock-in and fragmented software ecosystems. Thier platform combines systems software, orchestration, translation technologies, and hardware acceleration to unlock the next generation of AI infrastructure.

The Opportunity

They are looking for a highly technical Systems Software Engineer who loves working across the entire technology stack from kernel-level programming and operating systems to distributed services and application layers. This role is ideal for someone who enjoys solving hard systems problems, wants to learn deeply about AI and High-Performance Computing (HPC), and is excited to help build infrastructure that operates at data-center scale. You will work alongside experienced architects and engineers who have built large-scale systems at some of the world s leading technology companies and AI infrastructure providers.

Key Responsibilitie

• Develop high-performance systems software in C++ and Rust.
• Work across Linux kernels, drivers, runtimes, operating systems, services, and applications.
• Design and optimize software for AI and HPC workloads.
• Build components that interface with GPUs, accelerators, networking, and storage systems.
• Develop distributed services that operate across large-scale compute environments.
• Investigate performance bottlenecks and optimize systems for throughput, latency, and efficiency.
• Collaborate with hardware, platform, and AI engineers to build next-generation infrastructure.
• Participate in architecture, design reviews, debugging, and performance analysis.

Required Skills

• Strong proficiency in C++ and/or Rust.
• Deep understanding of Linux operating systems and systems programming.
• Experience with multithreading, concurrency, memory management, and performance optimization.
• Strong debugging and problem-solving skills.
• Comfortable reading and understanding complex codebases.
• Curiosity and willingness to learn new technologies rapidly.
• Passion for building infrastructure and solving challenging technical problems.

Nice to Have

• Linux kernel development experience.
• Device driver development.
• Compiler, runtime, or virtualization experience.
• GPU programming (CUDA, ROCm, SYCL, OpenCL, etc.).
• HPC, distributed systems, or large-scale infrastructure experience.
• Networking, RDMA, InfiniBand, or high-performance storage experience.
• Experience contributing to open-source projects.
• Knowledge of AI training and inference infrastructure.

What You Ll Learn

• AI infrastructure at hyperscale.
• HPC architecture and optimization.
• GPU and accelerator technologies.
• Distributed computing platforms.
• Advanced systems software design.
• Data center-scale infrastructure engineering.
• Emerging AI hardware ecosystems.
• Note: Open for PhD candidates with relevant research experience