Senior Systems Engineer, Amazon Special Projects

Amazon Inc.; Seattle (WA); On-site; USD 151,000 - 205,000; Full time

Benefits offered by this job

Health insurance

RSUs

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Special Projects seeks a Sr. Systems Engineer to own the on-node agent daemon, runtime sandbox, and local storage layer. You will develop detection for node availability and GPU capability to ensure low-latency ML inference at scale, across diverse hardware.

You will lead design, build, and deployment of reliable, scalable software in production; work with Linux internals, container runtimes, and GPU tooling, while aligning with security and fleet onboarding needs.

Qualifications

• 6+ years of professional software development experience.
• 6+ years designing or architecting (design patterns, reliability and scaling) of new and existing systems.
• Experience leading the design, build and deployment of complex and performant software solutions in production.
• Deep knowledge of Linux internals, including process scheduling, memory management, and storage subsystems.

Responsibilities

• Design and implement the agent daemon on Linux, including GPU discovery, availability detection, and sandboxed container execution for ML inference workloads.
• Architect the local caching system — eviction policies, versioned manifests, disk budget management, and efficient update mechanisms that minimize data transfer for large model files.
• Build VRAM management and graceful workload migration logic.
• Integrate hardware attestation with the security engineer and support diverse hardware configurations and fleet onboarding automation.

Skills

Programming languages

Systems design

Linux internals

Production software development

Tools

Docker

NVML

CUDA

Job description

Innovators wanted! Are you an entrepreneur? A builder? A dreamer? This role is part of an Amazon Special Projects team that takes the company’s Think Big leadership principle to the highest levels. We focus on creating entirely new products and services with a goal of positively impacting the lives of our customers. No industries or subject areas are out of bounds. We launched products such as Comprehend Medical, Echo Frames and Amazon Explore. If you’re interested in innovating at scale to address big challenges in the world, this is the team for you.

As the Sr. Systems Engineer, you will own the agent daemon that runs on compute nodes, the runtime sandbox that isolates workloads, and the local storage and caching layer that determines which assets are resident and ready to serve. You will build the detection logic that manages node availability, and the GPU capability reporting that tells the scheduler exactly what each node can handle. Your work directly determines whether the platform can deliver low-latency ML inference — and whether it can do so reliably at scale.

Key job responsibilities

• Design and implement the agent daemon on Linux, including GPU discovery, availability detection, and sandboxed container execution for ML inference workloads.
• Architect the local caching system — eviction policies, versioned manifests, disk budget management, and efficient update mechanisms that minimize data transfer for large model files.
• Build VRAM management and graceful workload migration logic.
• Integrate hardware attestation with the security engineer and support diverse hardware configurations and fleet onboarding automation.

About the team

Amazon Special Projects is a small, high-autonomy team building new-to-Amazon infrastructure from scratch. The systems component is where software meets hardware: you will build the on-node runtime — the agent, sandbox, GPU manager, and local storage layer — that makes a compute node reliable, secure, and performant. This is systems engineering at its most tangible — your code runs on real hardware and must be resilient to everything the real world throws at it.

Basic Qualifications

• 6+ years of programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby experience
• 6+ years of non-internship professional software development experience
• 6+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
• Experience leading the design, build and deployment of complex and performant (reliable and scalable) software solutions in production
• 6+ years of systems design, software development, operations, automation, and process improvement experience
• 7+ years of experience in systems programming (Rust, Go, or C++)
• Deep knowledge of Linux internals, including process scheduling, memory management, and storage subsystems
• Hands-on experience with container runtimes (Docker, containers, or custom sandboxes)
• Experience with GPU tooling and management (nvidia-smi, NVML, CUDA runtime)
• Demonstrated ability to build software that runs reliably on heterogeneous hardware

Preferred Qualifications

• Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
• Experience taking a leading role in building complex software or computing infrastructure that has been successfully delivered to customers
• Experience designing caching systems with constrained storage budgets (LRU, ARC, or custom policies)
• Background in edge computing, fleet management, or embedded systems engineering
• Familiarity with hardware attestation (TPM, TEE) from the device side
• Experience with storage performance profiling and optimization across hardware types
• Track record of building daemon/agent software that operates unattended for extended periods

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, Seattle - 151,200.00 - 204,600.00 USD annually