AI Safety & Evaluation Engineer (Remote)

Solumn AI

Dubai

Remote

AED 300,000 - 520,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

100% Remote
6-day work week

Job summary

Solumn AI is hiring AI Engineers who combine solid engineering with research judgement. You’ll investigate frontier models, formulate hypotheses, design experiments, and build environments, benchmarks and datasets that provide reliable evidence for safety and alignment.

You’ll contribute to reproducibility, tooling, and rigorous evaluation across agentic architectures and tool-use. Strong Python and API experience are highly valued for this remote role.

Qualifications

  • Strong Python programming and practical API/pipeline experience.
  • Understanding of LLMs, transformers, inference and tool use.
  • Ability to read technical work critically and design experiments.
  • Commitment to evaluation validity, reproducibility and verifier robustness.

Responsibilities

  • Research and experimental design: turn safety questions into hypotheses and measurable criteria.
  • Evaluation environments: build agentic and tool-use environments, harnesses and workflows.
  • Benchmarks and evaluation quality: create datasets, robust graders, verifiers and QA.
  • Model behavior analysis: study safety-relevant behaviours and distinguish limits from artefacts.
  • Engineering standards: improve reproducibility, test coverage, docs and internal tooling.

Skills

Python
API development
Pipelines
LLMs & transformers
Experiment design
Evaluation & QA

Tools

Execution harnesses

Job description

Solumn AI is hiring AI Engineers who combine solid engineering with research judgement. You’ll investigate frontier models, formulate hypotheses, design experiments, and build environments, benchmarks and datasets that provide reliable evidence for safety and alignment.

You’ll contribute to reproducibility, tooling, and rigorous evaluation across agentic architectures and tool-use. Strong Python and API experience are highly valued for this remote role.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer
AI Engineer

Solumn AI • Dubai

Remote
AED 300,000 - 520,000
100% Remote
6-day work week
Senior Technical Leader, Research & Engineering (Remote)
Senior Technical Leader, Research & Engineering (Remote)

Solumn AI • Dubai

Remote
AED 180,000 - 240,000
Remote VP of AI Safety & Engineering
Remote VP of AI Safety & Engineering

Solumn AI • Dubai

Remote
AED 220,000 - 420,000
100% Remote
6-day work week
Full-time
VP, Research & Engineering
VP, Research & Engineering

Solumn AI • Dubai

Remote
AED 220,000 - 420,000
100% Remote
6-day work week
Full-time
VP Research And Engineering
VP Research And Engineering

Solumn AI • Dubai

Remote
AED 180,000 - 240,000
Remote AI Coding Agent Evaluation Engineer
Remote AI Coding Agent Evaluation Engineer

Joblet-AI • United Arab Emirates

Remote
AED 734,000 - 955,000
Equity
Health insurance
Paid time off
+2
Remote AI Evaluation Engineer for Coding Agents
Remote AI Evaluation Engineer for Coding Agents

Joblet-AI • Abu Dhabi

Remote
AED 734,000 - 955,000
Remote Software Engineer - AI Training & Review
Remote Software Engineer - AI Training & Review

Alignerr Corp. • Dubai

Remote
AED 83,000 - 165,000
AI Research Engineer (Remote)
AI Research Engineer (Remote)

Joblet-AI • Abu Dhabi

Remote
AED 734,000 - 955,000
Remote Chemical AI Safety Expert (3+ yrs)
Remote Chemical AI Safety Expert (3+ yrs)

Pasiflora AI LLC • United Arab Emirates

Remote
AED 167,000 - 238,000
Remote work
Hourly compensation
Top locations