AI/ML Systems Engineer - Fleet Health & Automation

Socket.dev; Austin (TX); On-site; USD 151,000 - 205,000; Full time

Job summary

Amazon's AI/ML UltraServer team in Austin seeks a Systems Development Engineer to build automation, diagnostics, and fleet health infrastructure for GPU-accelerated compute platforms. You will own end-to-end systems, spanning hardware, firmware, kernel, and software, and design scalable tools to prevent failures at fleet scale.

You will work across PCIe topology, GPU diagnostics, Linux drivers, and telemetry pipelines, collaborating with hardware and software teams to deliver reliable, scalable

Qualifications

• 6+ years of systems design, software development, operations, automation, and process improvement experience.
• 6+ years of non-internship professional software development experience.
• 6+ years of programming with at least one modern language (C++, C#, Java, Python, Golang, PowerShell, Ruby).
• 6+ years of designing or architecting systems (reliability and scaling).
• 5+ years of Linux/Unix operating systems experience.

Responsibilities

• Build and own the automation infrastructure for accelerator fleet health at a large scale of servers, driving toward zero-touch operations.
• Design and develop test frameworks, coverage strategies, and diagnostic tooling for hardware functionality validation.
• Design predictive failure detection using telemetry, sensor data, error trending, and log correlation.

Skills

Systems design

Software development

Programming languages

Architecture design

Linux/Unix

Communication

Education

Bachelor's degree in CS/CE/EE or equivalent

Tools

CUDA kernels

Linux

Job description

Amazon's AI/ML UltraServer team in Austin seeks a Systems Development Engineer to build automation, diagnostics, and fleet health infrastructure for GPU-accelerated compute platforms. You will own end-to-end systems, spanning hardware, firmware, kernel, and software, and design scalable tools to prevent failures at fleet scale.

You will work across PCIe topology, GPU diagnostics, Linux drivers, and telemetry pipelines, collaborating with hardware and software teams to deliver reliable, scalable