Member of Technical Staff (Search Quality Analyst)

Perplexity

Berlin

Hybrid

EUR 60,000 - 90,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Perplexity is seeking an experienced analyst to help build and improve core search technologies. You’ll design metrics, build data pipelines, and enhance the quality of search and answer systems.

The role is hybrid in Belgrade, London or Berlin, with responsibilities spanning data analysis and engineering. Required are 4+ years in data analysis, strong SQL and Python skills, and hands-on experience with ML/labeling pipelines or production ML training.

Qualifications

  • 4+ years of experience as a data analyst or in a related role.
  • Proficiency with SQL and Python.
  • Ability to write production-grade code at a mid-level backend engineer level.
  • Hands-on experience with labeling pipelines using LLMs or training ML models shipped to production.
  • Designing metrics from scratch and evals with known ground truth.

Responsibilities

  • Find and diagnose quality issues in the search pipeline.
  • Design metrics to track and measure search quality.
  • Build datasets for model training and labeling pipelines.
  • Improve search snippet quality and page selection algorithms.
  • Design and analyze A/B experiments to validate improvements.

Skills

Backend coding skills
4+ years data analysis
SQL proficiency
Python proficiency
LLM labeling pipelines
ML model training for prod
A/B testing design

Tools

SQL
Python
Apache Spark
Databricks

Job description

Perplexity is looking for an experienced analyst to help us build and improve our core search technologies. You'll work at the intersection of data analysis and engineering - designing metrics, building data pipelines, and improving the quality of our search and answer systems.

This role is hybrid in Belgrade, London or Berlin.

Responsibilities

  • Find and diagnose quality issues in our search pipeline
  • Design metrics from scratch to track and measure search quality
  • Build datasets for model training, including LLM-as-a-judge labeling pipelines
  • Improve search snippet quality and page selection algorithms for indexing
  • Design and analyze A/B experiments to validate improvements

Qualifications

  • 4+ years of experience as a data analyst or in a related role
  • Strong coding skills — expected to write production-grade code at a mid-level backend engineer level
  • Proficiency with SQL and Python
  • Demonstrated hands-on experience with at least one of the following:
  • Designing metrics from scratch (not just analyzing existing A/B experiments)
  • Building labeling pipelines using LLM-as-a-judge
  • Training ML models that shipped to production with measurable metric improvements
  • Designing evals with known ground truth (e.g. SimpleQA, BrowseComp) or driving meaningful improvements on such evals

Nice to have

  • Experience working on search-related products
  • Knowledge of statistics and A/B experiment design
  • Experience with Apache Spark or Databricks
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff (Search Crawler Analyst)
Member of Technical Staff (Search Crawler Analyst)

Maven Ventures • Berlin

On-site
EUR 70,000 - 110,000
Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)
Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)

Maven Ventures • Berlin

On-site
EUR 90,000 - 150,000
Member of Technical Staff (Machine Learning Engineer, Search Agent RL)
Member of Technical Staff (Machine Learning Engineer, Search Agent RL)

Perplexity • Germany

On-site
EUR 90,000 - 130,000
Machine Learning Research Engineer (Member of Technical Staff)
Machine Learning Research Engineer (Member of Technical Staff)

Perplexity AI • Berlin

On-site
EUR 90,000 - 140,000
Member of Technical Staff (Search Engine Developer, Search Core)
Member of Technical Staff (Search Engine Developer, Search Core)

Perplexity • Berlin

Hybrid
EUR 70,000 - 90,000
Comprehensive health, dental, and vision insurance
401(k) plan
Equity may be part of compensation
Member of Technical Staff (Search Core DevOps Engineer)
Member of Technical Staff (Search Core DevOps Engineer)

Perplexity • Berlin

On-site
EUR 70,000 - 110,000
Member of Technical Staff (Backend/Infrastructure Engineer, Search)
Member of Technical Staff (Backend/Infrastructure Engineer, Search)

Perplexity • Berlin

Hybrid
EUR 70,000 - 90,000
Senior AI Search Engineer
Senior AI Search Engineer

Commercetools • Berlin

Remote
EUR 90,000 - 130,000
100% covered medical, dental, vision
Generous PTO and parental leave
Monthly health stipend and phone
+2
Senior Backend Engineer - Search & Discovery (all genders)
Senior Backend Engineer - Search & Discovery (all genders)

ABOUT YOU SE & Co. KG • Hamburg, Berlin

On-site
EUR 70,000 - 85,000
Search DevOps Engineer
Search DevOps Engineer

Perplexity AI • Berlin

On-site
EUR 70,000 - 110,000