ML Engineer, Sequence Models: Scale LLMs & MLOps

Amazon Inc.; New York (NY); On-site; USD 158,000 - 214,000; Full time

Benefits offered by this job

RSUs

Health insurance

401(k) matching

Paid time off

Job summary

Amazon in New York is seeking a Machine Learning Engineer for the Sequence Models team to build scalable ML infrastructure, streamline the model lifecycle from research to production, and advance MLOps for petabyte-scale data.

You will own data pipelines, optimize GPU usage, collaborate with Applied Scientists, and ensure reliable, low-latency model serving in a high-volume cloud environment. A CS/engineering degree and strong ML/LLM background are required.

Qualifications

• 3+ years of non-internship professional software development experience.
• 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl.
• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
• Experience with Machine Learning and Large Language Model fundamentals, including architecture, training/inference lifecycles, and optimization of model execution.
• Experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware.

Responsibilities

• Build and scale ML infrastructure across data processing, distributed training, and model serving.
• Own the data pipelines that feed model training, including ingestion of structured and unstructured inputs, schema evolution, backfills, and data quality checks across upstream sources.
• Partner with Applied Scientists to shorten the time from experiment to production.
• Evolve model serving and feature delivery to support continuous experimentation.
• Establish automated, repeatable processes for large-scale data analysis, model training, validation, and deployment.
• Own operational excellence for high-volume, low-latency production systems, including monitoring, alarming, troubleshooting, and on-call.

Skills

Software development

Distributed systems

Java/C++/C#/Perl

ML fundamentals

LLM production

Education

Bachelor's degree

Tools

CUDA/GPUs

ML pipelines

MLOps tools

Job description

Amazon in New York is seeking a Machine Learning Engineer for the Sequence Models team to build scalable ML infrastructure, streamline the model lifecycle from research to production, and advance MLOps for petabyte-scale data.

You will own data pipelines, optimize GPU usage, collaborate with Applied Scientists, and ensure reliable, low-latency model serving in a high-volume cloud environment. A CS/engineering degree and strong ML/LLM background are required.