Senior Software Engineer - AI/ML Systems & Cloud Core

Annapurna Labs

New York (NY)

On-site

USD 185,000 - 250,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
401(k)
Paid time off
Parental leave

Job summary

Annapurna Labs (U.S.) Inc. in New York, NY is seeking a Senior Software Development Engineer to design and build scalable software for ML chips and related AWS services.

You will collaborate with compiler, hardware, and ML teams to accelerate adoption of Trainium and Inferentia, delivering robust, high-performance solutions for a global customer base. The role involves software design, implementation, testing, deployment, and operating with a focus on reliability and security.

Qualifications

  • 5+ years of non-internship professional software development experience.
  • 5+ years of programming with at least one software programming language experience.
  • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
  • 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience.

Responsibilities

  • Design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security.
  • Build high-quality, highly available, always-on products.
  • Research implementations that deliver the best possible experiences for customers.
  • Create metrics, implement automation and other improvements, and resolve the root cause of software defects.
  • Collaborate with cross-functional teams and stakeholders across compiler, hardware and ML domains.

Skills

Software development
Programming languages
System design
Mentoring
Generative AI

Education

Master's degree in CS

Tools

Git
CI/CD
Linux

Job description

Annapurna Labs (U.S.) Inc. in New York, NY is seeking a Senior Software Development Engineer to design and build scalable software for ML chips and related AWS services.

You will collaborate with compiler, hardware, and ML teams to accelerate adoption of Trainium and Inferentia, delivering robust, high-performance solutions for a global customer base. The role involves software design, implementation, testing, deployment, and operating with a focus on reliability and security.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Systems Software Engineer — High-Performance AI
ML Systems Software Engineer — High-Performance AI

Talemexa • New York (NY)

On-site
USD 150,000 - 210,000
AI/ML Software Engineer II: High-Performance Inference
AI/ML Software Engineer II: High-Performance Inference

Amazon Inc. • Cupertino (CA)

On-site
USD 165,000 - 224,000
Senior Software Engineer, AI/ML Infra & Cloud Scale
Senior Software Engineer, AI/ML Infra & Cloud Scale

Amazon Inc. • New York (NY)

Hybrid
USD 185,000 - 250,000
Health insurance
401(k) matching
Parental leave
Senior AI/ML Inference Engineer (Neuron)
Senior AI/ML Inference Engineer (Neuron)

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off
Senior AI/ML Software Engineer - High-Perf Inference
Senior AI/ML Software Engineer - High-Perf Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Software Engineer I – Cloud & ML Systems
Software Engineer I – Cloud & ML Systems

Amazon Inc. • Seattle (WA)

On-site
USD 129,000 - 148,000
EAP
Mental health support
Medical advice line
+1
Senior ML Inference Engineer - Neuron Optimizations
Senior ML Inference Engineer - Neuron Optimizations

Annapurna Labs (U.S.) Inc. • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
RSUs
Paid time off
+1
Senior Software Engineer — GenAI & ML Acceleration
Senior Software Engineer — GenAI & ML Acceleration

Amazon Web Services (AWS) • New York (NY)

On-site
USD 185,000 - 250,000
Health insurance
401(k) matching
Paid time off
+2
Software Development Engineer - ML Compiler Infra
Software Development Engineer - ML Compiler Infra

Annapurna Labs (U.S.) Inc. • Seattle (WA)

On-site
USD 120,000 - 180,000
ML Systems Engineer for AI/LLM Inference on AWS Neuron
ML Systems Engineer for AI/LLM Inference on AWS Neuron

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 180,000 - 240,000