Senior NLP Engineer: Prompt Design & Evaluation

Preply; Greater London; Hybrid; GBP 70,000 - 100,000; Full time

Benefits offered by this job

Lessons on Preply.com (monthly)

Learning & Development budget

Health insurance

Mental health support platforms

Equity

Job summary

Preply is seeking a Senior Computational Linguist in London. The role blends linguistic expertise with AI engineering to build and evaluate language-learning solutions powered by AI. You will formalise linguistic rules, design prompts, and create datasets for training and evaluation across languages.

You’ll work with engineers, PMs, and learning designers to scale reusable NLP solutions, stay abreast of NLP advances, and contribute to high-quality linguistic tooling and pipelines.

Qualifications

• 2–3 years of experience in Computational Linguistics, NLP, or related role.
• Hands-on experience with LLMs, including prompt design, evaluation, and model behaviour analysis.
• Proficiency in Python for data processing, evaluation, and automation.
• Strong understanding of datasets, annotation workflows, evaluation methods, and QA for AI systems.
• AI-native mindset for day-to-day problem solving and automation.
• Strong qualitative and quantitative analysis skills for linguistic data and model quality.
• Ability to collaborate effectively in cross-functional teams.
• Degree in Linguistics, Computational Linguistics, NLP, Language Technology, or related field, or equivalent practical experience.
• Excellent command of English, both spoken and written, with linguistic precision.

Responsibilities

• Formalise linguistic phenomena into rules, taxonomies, criteria, and system requirements.
• Design, evaluate, and improve prompts and AI components for language-learning use cases.
• Build datasets for training, calibration, and evaluation with guidelines and QA processes.
• Evaluate model behaviour using qualitative and quantitative methods and validate fixes.
• Use Python and tooling to process linguistic data and automate evaluation.
• Collaborate with engineers, PMs, learning designers, and linguists to scale solutions across languages.
• Stay informed of NLP and LLM research advances.

Skills

LLM prompt design

Linguistic analysis

Qualitative analysis

Quantitative analysis

Cross-functional collaboration

Education

Linguistics or NLP degree or equivalent experience

Tools

Python

Job description

Preply is seeking a Senior Computational Linguist in London. The role blends linguistic expertise with AI engineering to build and evaluate language-learning solutions powered by AI. You will formalise linguistic rules, design prompts, and create datasets for training and evaluation across languages.

You’ll work with engineers, PMs, and learning designers to scale reusable NLP solutions, stay abreast of NLP advances, and contribute to high-quality linguistic tooling and pipelines.