GenAI Software Engineer — Build AI Agents for Neuron

Amazon; New York (NY); On-site; USD 158,000 - 214,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Annapurna Labs is seeking an experienced software engineer to advance GenAI workloads on Neuron and related ML silicon. You will research, implement, test, and deploy AI agents, tools, and models that accelerate customer adoption of the Neuron stack, influencing performance, cost, and reliability.

Join a team focused on cutting-edge AI at NYC-based Annapurna Labs, building scalable systems and contributing to IP through innovative solutions for AWS ML hardware and GenAI workloads.

Qualifications

• Excellent written and verbal communication to present technical information to executives and non-technical leaders.
• 3+ years of relevant, broad engineering experience.
• CS core: object-oriented design, data structures, performance analysis with at least 2 programming languages.
• Hands-on technical experience in the Generative AI space.
• Knowledge of software engineering practices across the full SDLC: coding standards, reviews, SCM, build, test, and operations.
• Experience in ML compilers, production coding agents, GenAI model architecture, or model optimization.

Responsibilities

• Research implementations that deliver the best possible experiences for customers.
• Improve time and effort to port and optimize ML workloads on Neuron.
• Build and operate agentic evaluation frameworks, monitoring, and feedback loops for AI agents.
• Design, implement, test, deploy and maintain software to improve service performance, durability, cost, and security.
• Build high-quality, highly available, always-on products.
• Potentially contribute IP through patents.

Skills

Communication skills

Engineering experience

Object-oriented design

Data structures

Performance analysis

Generative AI experience

Software engineering practices

ML hardware knowledge

Education

Bachelor's or Master's degree in Computer Science or equivalent

Job description

Amazon Annapurna Labs is seeking an experienced software engineer to advance GenAI workloads on Neuron and related ML silicon. You will research, implement, test, and deploy AI agents, tools, and models that accelerate customer adoption of the Neuron stack, influencing performance, cost, and reliability.

Join a team focused on cutting-edge AI at NYC-based Annapurna Labs, building scalable systems and contributing to IP through innovative solutions for AWS ML hardware and GenAI workloads.