GenAI Software Engineer — AI Agents for Neuron

Socket.dev; New York (NY); On-site; USD 158,000 - 214,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Annapurna Labs in New York is seeking engineers to advance the GenAI stack, focusing on building agents, tools, and models to accelerate Neuron adoption on AWS. You will collaborate with internal and external customers to identify opportunities and reduce obstacles in migrating to AWS ML silicon.

The role emphasizes hands-on development in AI agent frameworks, model optimization, and scalable service performance, with a strong customer-experience orientation and potential patent

Qualifications

• Strong written and verbal communication to present complex technical information to executives and non-technical leaders.
• 3+ years of relevant, broad engineering experience.
• Computer Science core: object-oriented design, data structures, and performance analysis with at least 2 programming languages.
• Hands-on technical experience working in the Generative AI space.
• Knowledge of professional software engineering practices & SDLC including coding standards, reviews, source control, build, testing, and operations.
• Experience in ML compilers, production coding agents, GenAI model architecture, or model training.
• Passion for customer experience and usability, including delivery of self-service tools and automated management/optimization of services.

Responsibilities

• Research implementations that deliver the best possible experiences for customers.
• Deliver on goals to improve porting and optimization of ML workloads on Neuron.
• Build and operate agentic evaluation frameworks, monitoring, and feedback loops for AI agents.
• Design, implement, test, deploy and maintain software to improve service performance, durability, cost, and security.
• Build high-quality, highly available products.
• Potentially contribute intellectual property through patents.

Skills

Excellent communication

3+ years engineering experience

Object-oriented design

Data structures

Multiple programming languages

Hands-on Generative AI

SDLC best practices

ML compilers / GenAI model

Customer experience mindset

AWS services domain knowledge

Education

Bachelor's or Master's degree in computer science or equivalent

Job description

Amazon Annapurna Labs in New York is seeking engineers to advance the GenAI stack, focusing on building agents, tools, and models to accelerate Neuron adoption on AWS. You will collaborate with internal and external customers to identify opportunities and reduce obstacles in migrating to AWS ML silicon.

The role emphasizes hands-on development in AI agent frameworks, model optimization, and scalable service performance, with a strong customer-experience orientation and potential patent