Senior Distributed AI/ML Systems Engineer

Socket.dev; Cupertino (CA); On-site; USD 193,300 - 261,500; Full time

Job summary

Socket.dev is seeking an experienced engineer to advance distributed AI/ML systems. You will work on collective operations, low-level C/C++, and Linux kernel considerations for scalable performance across clusters.

You will join Annapurna Labs within AWS, focusing on hardware/software building blocks for EC2. The role offers mentorship, cross-team collaboration, and ongoing learning in a fast-moving AI/ML landscape.

Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of C/C++ coding experience.
• 5+ years of leading design or architecture of new and existing systems.
• 5+ years of full software development life cycle, including coding standards, code reviews, source control, builds, testing, and operations.

Responsibilities

• Develop distributed AI/ML systems and collective operations across accelerators and servers.
• Collaborate with HPC/infrastructure teams and ML customers to deliver scalable solutions.

Skills

C/C++ coding

Software development

Mentoring/tech lead

Linux/kernel experience

Distributed systems

Education

Bachelor's degree in CS or equivalent

Tools

NCCL

NVSHMEM

NIXL

Job description

Socket.dev is seeking an experienced engineer to advance distributed AI/ML systems. You will work on collective operations, low-level C/C++, and Linux kernel considerations for scalable performance across clusters.

You will join Annapurna Labs within AWS, focusing on hardware/software building blocks for EC2. The role offers mentorship, cross-team collaboration, and ongoing learning in a fast-moving AI/ML landscape.