AI Language Engineer II — Shopping AI & LLM Systems

Amazon; Greater London; On-site; GBP 120,000 - 180,000; Full time

Job summary

Amazon Development Centre (London) Limited is seeking an AI Language Engineer to advance scalable conversational AI for shopping, leveraging LLMs, RAG, and NLP to improve customer experiences on mobile and web apps.

You will collaborate with product managers, applied scientists, software engineers, and editors to define prompts, evaluate models, and build internal tooling prototypes, while maintaining linguistic quality and robust analytics.

Qualifications

• Master's Degree in Applied Linguistics, Computational Linguistics, NLP, or related field.
• Experience with Large Language Models, NLP, or Machine Learning.
• Experience with Python libraries for data analysis such as pandas and scikit-learn.
• Experience with Unix tools and strong analytical/communication skills.
• Experience in a fast-paced organization and handling multiple deadlines.

Responsibilities

• Develop LLM-as-a-judge systems for human-in-the-loop evaluations.
• Automate operations and analyze data using Python.
• Author, optimize, and manage system prompts for customer-facing LLMs.
• Integrate API calls into Retrieval Augmented Generation (RAG) systems.
• Evaluate model performance and annotation quality; produce stakeholder reports.
• Produce and manipulate language data; support tooling requirements via prototypes.
• Raise quality of editorial workflows through SOPs and audits.
• Onboard Editors and AI Tutors; upskill teams.
• Design and refine control metrics and methodologies for editorial quality.
• Collaborate with editors, scientists, engineers, and PMs to define workflows.
• Deliver across parallel workstreams balancing timelines and requirements.

Skills

Unix tools

Analytical skills

Attention to detail

Effective communication

Fast-paced environment

Multiple deadlines

AI/ML familiarity

Python data analysis

Education

Master's Degree in Applied Linguistics / NLP

PhD in Applied Linguistics / NLP

Tools

Python (pandas, scikit-learn)

SQL

Git

AWS Bedrock/S3/EC2

Job description

Amazon Development Centre (London) Limited is seeking an AI Language Engineer to advance scalable conversational AI for shopping, leveraging LLMs, RAG, and NLP to improve customer experiences on mobile and web apps.

You will collaborate with product managers, applied scientists, software engineers, and editors to define prompts, evaluate models, and build internal tooling prototypes, while maintaining linguistic quality and robust analytics.