Senior ML Infra Services Engineer for Accelerators

Amazon; Cupertino, Northern (CA, KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Amazon's AWS Neuron Infra Services team is seeking a Software Engineer to lead the development of tools, pipelines, and automation for optimizing machine learning workloads on Inferentia/Trainium accelerators. You will drive architecture, delivery, and customer-facing improvements across EC2/EKS/Lambda-like services within AWS or comparable platforms.

You will work with developers, hardware engineers, and users to ensure compatibility with next generation AI accelerators, while building scalable

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
• Experience programming with at least one software programming language.
• Knowledge of system performance, memory management, and parallel computing principles.
• Experience in debugging, profiling

Responsibilities

• Lead the design and implementation of new tools, pipelines and automation, collaborating with developers, system architects, hardware engineers and users to ensure compatibility with existing and next-gen AI accelerators.
• Design, implement, and maintain CI/CD pipelines to automate the software release process.
• Collaborate with development teams to integrate new software releases.
• Infrastructure Management: Manage and automate infrastructure provisioning.
• Ensure high availability and scalability of systems through effective infrastructure management.
• Monitoring and Optimization: Implement monitoring solutions to track system performance and identify bottlenecks.
• Security and Compliance: Implement security best practices in the DevOps pipeline and conduct vulnerability assessments.

Skills

Software development

Distributed systems design

Performance analysis

Debugging & profiling

Programming languages

Tools

CI/CD pipelines

Monitoring & instrumentation

Job description

Amazon's AWS Neuron Infra Services team is seeking a Software Engineer to lead the development of tools, pipelines, and automation for optimizing machine learning workloads on Inferentia/Trainium accelerators. You will drive architecture, delivery, and customer-facing improvements across EC2/EKS/Lambda-like services within AWS or comparable platforms.

You will work with developers, hardware engineers, and users to ensure compatibility with next generation AI accelerators, while building scalable