AI Safety Benchmark Engineer — Hybrid (Relocation)

whitecircle

France

Hybrid

EUR 70,000 - 95,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

White Circle is hiring a Research Engineer to build and maintain an internal benchmark suite for single and multi-turn content guardrails and agentic safety. You will work with the team on projects studying agent behaviours in the wild and help shape how AI safety is implemented in production.

You will write Python, build efficient LLM inference setups, and reproduce published benchmark results while extending evals to new features and data. Hybrid work from Paris or London may be supported.

Qualifications

  • Experience building an LLM benchmark that distinguishes model capabilities.
  • Experience creating synthetic data for post-training text or multimodal models.
  • Ability to reproduce published benchmark results and critique methodologies.
  • Proficiency in Python and writing production-ready code that can be extended by others.
  • Experience building efficient LLM inference solutions with orchestrated parallel calls and retry/rate-limit handling.

Responsibilities

  • Own and maintain the internal benchmark suite for single/multi-turn content guardrails and agentic safety.
  • Build benchmarks that differentiate model capabilities and support product evals.
  • Collaborate with product team to evaluate core functionality of flagship models.
  • Extend evals to new features and verticals, adapting to changing data.
  • Study realistic agentive and LLM failure modes and quantify them in the wild.

Skills

Python
LLM Benchmarking
Production Code
Research & Analysis

Tools

PyTorch
LangChain
Airflow

Job description

White Circle is hiring a Research Engineer to build and maintain an internal benchmark suite for single and multi-turn content guardrails and agentic safety. You will work with the team on projects studying agent behaviours in the wild and help shape how AI safety is implemented in production.

You will write Python, build efficient LLM inference setups, and reproduce published benchmark results while extending evals to new features and data. Hybrid work from Paris or London may be supported.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Engineer (Evals)
Research Engineer (Evals)

whitecircle • France

Hybrid
EUR 70,000 - 95,000
Research Scientist/Engineer (Agentic Systems)
Research Scientist/Engineer (Agentic Systems)

whitecircle • France

Hybrid
EUR 90,000 - 130,000
Paid time off
Hybrid Paris relocation package
Comprehensive medical insurance (FR)
+3
Senior AI Security Research Engineer - Hybrid Paris Equity
Senior AI Security Research Engineer - Hybrid Paris Equity

Cyber StrategiX • Paris

Hybrid
EUR 110,000 - 140,000
Significant equity (Stock Options/BSPC
Alan health insurance
Swile meal vouchers
+6
Research Scientist - Agentic Systems & AI Safety
Research Scientist - Agentic Systems & AI Safety

whitecircle • France

Hybrid
EUR 90,000 - 130,000
Paid time off
Hybrid Paris relocation package
Comprehensive medical insurance (FR)
+3
Research Scientist / Engineer
Research Scientist / Engineer

SaferAI • Paris

Hybrid
EUR 90,000 - 140,000
Health insurance
Retirement plans
50% home transportation
+2
Head of Data Labeling
Head of Data Labeling

whitecircle • France

Hybrid
EUR 80,000 - 110,000
Competitive salary + equity
Work from Paris (hybrid) with reloc.包e
Paid time off per local regulations
+3
Research Scientist: Frontier AI Risk & Evaluations
Research Scientist: Frontier AI Risk & Evaluations

SaferAI • Paris

Hybrid
EUR 90,000 - 140,000
Health insurance
Retirement plans
50% home transportation
+2
Senior ML Engineer, AI Health Orchestration & Safe LLMs
Senior ML Engineer, AI Health Orchestration & Safe LLMs

Doctolib • Paris

Hybrid
EUR 110,000 - 150,000
Health insurance for you and family
25 days paid vacation + RTT
Lunch vouchers (Swile)
AI-Native Software Engineer — AI-First Systems (Paris, Hybrid)
AI-Native Software Engineer — AI-First Systems (Paris, Hybrid)

Palo IT • Paris

Hybrid
EUR 90,000 - 120,000
Founding AI Research Engineer: Applied Coding Agents, Paris
Founding AI Research Engineer: Applied Coding Agents, Paris

Armature (YC P26) • Paris

On-site
EUR 70,000 - 120,000