Applied Scientist - LLM, Alexa Conversational Modelling Intelligence

Amazon; Berlin; Vor Ort; EUR 110.000 - 170.000; Vollzeit

Zusammenfassung

Amazon Development Center Germany GmbH in Berlin is seeking an Applied Scientist II for the Alexa Conversational Modelling Intelligence team to advance post-training methods for Alexa+ language models.

You will own the model development cycle from data curation to deployment, apply supervised fine-tuning, RL, and knowledge distillation, and design robust evaluation procedures. You will communicate findings to stakeholders and help scale production-ready ML solutions across millions of users.

Qualifikationen

• PhD in computer science, machine learning, engineering, or related fields.
• Knowledge of at least one programming language such as Java, C#, JavaScript, Python, Ruby or Perl.
• Experience in designing experiments and statistical analysis of results.
• Hands-on experience building, training, and evaluating LLMs.

Aufgaben

• Own the full model development cycle — from data curation through training, evaluation, and deployment.
• Develop and apply post-training techniques: supervised fine-tuning, reinforcement learning, preference optimization, and knowledge distillation.
• Build evaluation methods and metrics, and diagnose model defects to target the highest-impact improvements.
• Optimize model training pipelines and iterate on recipes to move concrete quality and efficiency benchmarks.
• Write high-quality documentation on methods and experiment outcomes, and communicate findings clearly to stakeholders.

Kenntnisse

Programming languages

Experiment design

LLM evaluation

Ausbildung

PhD in computer science / ML / engineering

Jobbeschreibung

As an Applied Scientist II in the Alexa Conversational Modelling Intelligence team within Alexa AI, you will drive model post‑training for Large Language Models that power Alexa+. You’ll adopt and adapt state‑of‑the‑art techniques — including supervised fine‑tuning, reinforcement learning, preference optimization, and knowledge distillation — running rigorous experiments and translating findings into production‑ready solutions that directly improve the customer experience for millions of users worldwide.

Key job responsibilities

• Own the full model development cycle — from data curation through training, evaluation, and deployment.
• Develop and apply post‑training techniques: supervised fine‑tuning, reinforcement learning, preference optimization, and knowledge distillation.
• Build evaluation methods and metrics, and diagnose model defects to target the highest‑impact improvements.
• Optimize model training pipelines and iterate on recipes to move concrete quality and efficiency benchmarks.
• Write high‑quality documentation on methods and experiment outcomes, and communicate findings clearly to stakeholders.

A day in the life

Post‑training is one of the most active frontiers in LLMs right now. The field has moved from scaling pretraining to getting more out of models afterward through RL, reasoning recipes, and preference optimization. You’ll work on these techniques directly, on a product used by millions of customers every day. A typical day: review overnight training runs and dashboards, dig into model defects to form hypotheses, then curate data and iterate on a recipe, improving shared tooling along the way. You’ll sync with scientists and engineers to unblock the path to production, and write up your findings for stakeholders. It’s fast‑moving — a good idea can reach millions of customers within weeks.

About The Team

The Alexa Conversational Modelling Intelligence team builds industry‑leading LLM‑based conversational technologies that customers love. Our mission is to push the envelope in LLMs for Alexa to deliver the best‑possible customer experience. As an Applied Scientist, you’ll contribute directly to that mission through model development and experimentation.

Basic Qualifications

• PhD in computer science, machine learning, engineering, or related fields.
• Knowledge of at least one programming language such as Java, C#, JavaScript, Python, Ruby or Perl.
• Experience in designing experiments and statistical analysis of results.
• Hands‑on experience building, training, and evaluating LLMs.

Preferred Qualifications

• Have publications on top‑tier conferences, such as CVPR, ICCV, ECCV or NeurIPS.
• Experience working with large, complex data sets.
• Experience working effectively with science, data processing, and software engineering teams.
• Experience in written and verbal communication skills to communicate with technical and non‑technical audiences, including senior leadership.
• Experience building and deploying LLM solutions in production or at scale.
• Hands‑on experience with Large Language Models training and fine‑tuning via pre‑training, SFT, and/or RLHF/preference optimization.
• Experience with LLM evaluation — building benchmarks, LLM‑as‑a‑judge, or defect/quality analysis.
• Familiarity with modern training/inference infrastructure (e.g., distributed training, RL frameworks, model serving).

Amazon is an equal opportunities employer.

Job ID: A10462398

Company: Amazon Development Center Germany GmbH

m/w/d