GenAI ML Systems Engineer

Amazon Web Services (AWS); New York (NY); On-site; USD 158,000 - 214,000; Full time

Job summary

Amazon Annapurna Labs (U.S.) Inc. in New York, NY is seeking a software/ML specialist to join a fast‑moving team building agents and tools to accelerate Neuron adoption.

You will help optimize ML workloads across Trainium/Inferentia hardware, collaborating with compiler, hardware and ML engineers to push performance and cost advantages. You will partner with internal and external customers to identify obstacles and opportunities in GenAI deployment, and contribute to scalable, reliable software

Qualifications

• 3+ years non‑internship software development experience.
• 2+ years design or architecture experience (design patterns, reliability, scaling).
• Experience in at least one programming language.
• CS core concepts: OO design, data structures, performance analysis in ≥2 languages.
• Experience in ML compilers, production coding agents, GenAI model architecture, or related math.
• 3+ years full SDLC: coding standards, reviews, SCM, builds, tests, operations.
• 2+ years ML or computational modeling environments with hosting or optimization.
• Proven track record building AI agents that optimize ML workloads.
• Experience with open-source communities in optimization or related areas.
• Knowledge of state-of-the-art ML tech and its math foundations.

Responsibilities

• Collaborate with Neuron Software teams, Science, AWS AI Services, partners and customers; drive high impact.
• Research implementations for best experiences for customers.
• Improve time and effort to port/optimize ML workloads on Neuron.
• Design, implement, test, deploy and maintain software to improve performance, durability, cost and security.
• Build high-quality, highly available, always-on products.
• Potentially contribute intellectual property through patents.
• Design and code solutions to help our team drive efficiencies; create metrics and automation; resolve root causes.
• Build high-impact solutions for our large customer base; participate in design reviews and stakeholder communication.
• Work cross-functionally with compiler, hardware and ML engineers; operate in startup-like environment.

Skills

Software development

System design/architecture

Programming languages

ML/GenAI knowledge

Open-source collaboration

Job description

Amazon Annapurna Labs (U.S.) Inc. in New York, NY is seeking a software/ML specialist to join a fast‑moving team building agents and tools to accelerate Neuron adoption.

You will help optimize ML workloads across Trainium/Inferentia hardware, collaborating with compiler, hardware and ML engineers to push performance and cost advantages. You will partner with internal and external customers to identify obstacles and opportunities in GenAI deployment, and contribute to scalable, reliable software