Lead Software Engineer, Infra & ML Systems

Amazon; Cupertino (CA); On-site; USD 165,000 - 224,000; Full time

Job summary

Amazon is seeking a Software Engineer to lead the development of tools and pipelines that optimize and release ML workloads for AWS Inferentia/Trainium accelerators. You will coordinate with architects, hardware engineers, and customers to ensure compatibility with next‑gen AI accelerators.

The role requires strong background in distributed systems, optimization, resource management, and experience with AWS services. Expect a startup‑like environment and broad collaboration across teams.

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture experience for new and existing systems.
• Experience programming with at least one software programming language.
• Knowledge of system performance, memory management, and parallel computing principles.
• Experience debugging, profiling, and implementing software engineering best practices in large-scale systems.
• Experience with AWS or cloud technologies.

Responsibilities

• Design, implement, and maintain new tools, pipelines and automation; collaborate with stakeholders to ensure compatibility with AI accelerators.
• Design, implement, and maintain CI/CD pipelines to automate the software release process.
• Collaborate with development teams to integrate new software releases.
• Infrastructure management: provisioning automation, high availability, and scalability.
• Monitoring and optimization: implement monitoring solutions and identify bottlenecks.
• Security and compliance: apply security best practices in the DevOps pipeline and conduct risk assessments.

Skills

Software development

System architecture

Programming languages

Performance & memory management

Debugging & profiling

AWS / Cloud

Education

Bachelor's degree in CS

Job description

Amazon is seeking a Software Engineer to lead the development of tools and pipelines that optimize and release ML workloads for AWS Inferentia/Trainium accelerators. You will coordinate with architects, hardware engineers, and customers to ensure compatibility with next‑gen AI accelerators.

The role requires strong background in distributed systems, optimization, resource management, and experience with AWS services. Expect a startup‑like environment and broad collaboration across teams.