AI Engineer

Solumn AI

Dubai

Remote

AED 300,000 - 520,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

100% Remote
6-day work week

Job summary

Solumn AI is hiring AI Engineers who combine solid engineering with research judgement. You’ll investigate frontier models, formulate hypotheses, design experiments, and build environments, benchmarks and datasets that provide reliable evidence for safety and alignment.

You’ll contribute to reproducibility, tooling, and rigorous evaluation across agentic architectures and tool-use. Strong Python and API experience are highly valued for this remote role.

Qualifications

  • Strong Python programming and practical API/pipeline experience.
  • Understanding of LLMs, transformers, inference and tool use.
  • Ability to read technical work critically and design experiments.
  • Commitment to evaluation validity, reproducibility and verifier robustness.

Responsibilities

  • Research and experimental design: turn safety questions into hypotheses and measurable criteria.
  • Evaluation environments: build agentic and tool-use environments, harnesses and workflows.
  • Benchmarks and evaluation quality: create datasets, robust graders, verifiers and QA.
  • Model behavior analysis: study safety-relevant behaviours and distinguish limits from artefacts.
  • Engineering standards: improve reproducibility, test coverage, docs and internal tooling.

Skills

Python
API development
Pipelines
LLMs & transformers
Experiment design
Evaluation & QA

Tools

Execution harnesses

Job description

About Us

Solumn AI helps frontier AI labs understand and improve how their models behave in challenging, real-world environments. We build the evaluation environments, research infrastructure and methods that test AI systems against frontier labs’ safety and alignment standards, and we turn that research into evaluations and training data that measurably improve model behaviour.

About the job

We’re looking for AI Engineers who combine solid engineering with research judgement. You’ll investigate how frontier models behave, form hypotheses, design experiments, and build the environments, benchmarks and datasets that produce reliable evidence. This goes beyond implementing existing benchmarks: you’ll help decide what to measure, how to test it rigorously, and how to turn open-ended questions into reproducible systems.

How you will contribute

  • Research and experimental design: turn safety questions into hypotheses, controlled experiments, baselines and clear measurement criteria
  • Evaluation environments: build realistic agentic and tool-use environments, execution harnesses, trajectory collection and scalable experiment workflows
  • Benchmarks and evaluation quality: create benchmark datasets, robust graders and verifiers, and QA that catches shortcuts and misleading scores
  • Model behaviour analysis: investigate safety-relevant behaviours and failure modes, and tell genuine model limitations apart from environment, rubric or verifier defects
  • Engineering standards: improve reproducibility, test coverage, documentation and internal tooling across research projects

Who you are

  • You write strong Python and have built and debugged APIs, pipelines, tools or other complex systems
  • You understand LLMs, transformers, inference, tool use and agentic architectures; post-training or RL experience is a plus
  • You can read technical work critically, design experiments and interpret results; a publication record is not required
  • You care about evaluation validity, confounders, reproducibility and verifier robustness
  • You’re comfortable with ambiguity, learn fast, work independently, and are genuinely interested in AI safety and alignment

Bonus if you’ve worked on

  • LLM evaluations, benchmark development or model behaviour analysis
  • Agentic, multi-agent or tool-use systems
  • AI safety, red teaming, adversarial testing or security research
  • ML research engineering, experiment infrastructure or automated grading
  • Dataset development, synthetic data or post-training workflows
  • Full-time · 6-day work week · 100% Remote
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Safety & Evaluation Engineer (Remote)
AI Safety & Evaluation Engineer (Remote)

Solumn AI • Dubai

Remote
AED 300,000 - 520,000
100% Remote
6-day work week
VP, Research & Engineering
VP, Research & Engineering

Solumn AI • Dubai

Remote
AED 220,000 - 420,000
100% Remote
6-day work week
Full-time
Principal Evals Engineer
Principal Evals Engineer

Client of Discovered MENA • Abu Dhabi

On-site
AED 480,000 - 720,000
VP Research And Engineering
VP Research And Engineering

Solumn AI • Dubai

Remote
AED 180,000 - 240,000
Senior AI Engineer
Senior AI Engineer

Open Innovation AI • Abu Dhabi

On-site
AED 300,000 - 600,000
Lead AI Scientist / Head of AI Solutions
Lead AI Scientist / Head of AI Solutions

EstateSight AI • Abu Dhabi

On-site
AED 450,000 - 900,000
Opportunity to lead AI innovation with societal impact
Research-driven environment
Leadership exposure across teams
QA Automation Engineer
QA Automation Engineer

GCS Recruitment • Abu Dhabi

On-site
AED 240,000 - 420,000
AI Research Engineer (Remote)
AI Research Engineer (Remote)

Joblet-AI • United Arab Emirates

Remote
AED 734,000 - 955,000
Equity
Health insurance
Paid time off
+2
AI Engineer, Generative AI and Agentic AI
AI Engineer, Generative AI and Agentic AI

TEN-XER • Dubai

On-site
AED 350,000 - 520,000
AI Evaluation Engineer
AI Evaluation Engineer

Socium - Teams Done Differently • Abu Dhabi

On-site
AED 260,000 - 520,000
Top locations