Remote Senior Software Engineer for AI Code Evaluation

Joblet-AI

Abu Dhabi

Remote

AED 506,000 - 759,000

Part time

44 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Joblet-AI is seeking a Senior Software Engineer (Remote) contractor to help evaluate and improve AI coding models. You will review AI-generated code, assess correctness, and help shape evaluation signals to improve model performance.

The role emphasizes hands-on software engineering across real-world codebases, strong code-review skills, and clear written communication. Join a distributed team working to advance AI coding tools.

Qualifications

  • 5 years of hands-on software engineering experience.
  • Strong proficiency in Python, TypeScript/JavaScript, Go, or another major production language.
  • Experience working in substantial real-world codebases.

Responsibilities

  • Design, refine and iterate on evaluation rubrics and criteria for AI model assessments.
  • Review and label data with a high quality bar.
  • Build and maintain pipelines and infrastructure for data generation, collection and evaluation workflows.
  • Synthesize findings into clear write-ups, updates and recommendations for the team.
  • Collaborate with researchers and engineers to translate qualitative judgment into scalable processes.

Skills

Hands-on software engineering
Python
TypeScript/JavaScript
Go
Code review
Written communication
AI tooling experience

Tools

LLMs
AI coding tools

Job description

Joblet-AI is seeking a Senior Software Engineer (Remote) contractor to help evaluate and improve AI coding models. You will review AI-generated code, assess correctness, and help shape evaluation signals to improve model performance.

The role emphasizes hands-on software engineering across real-world codebases, strong code-review skills, and clear written communication. Join a distributed team working to advance AI coding tools.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer (Remote)
Senior Software Engineer (Remote)

Joblet-AI • Abu Dhabi

Remote
AED 506,000 - 759,000
Remote AI Evaluation Engineer for Coding Agents
Remote AI Evaluation Engineer for Coding Agents

Joblet-AI • Abu Dhabi

Remote
AED 734,000 - 955,000
Remote Software Engineering Researcher for AI Tasks
Remote Software Engineering Researcher for AI Tasks

OpenTrain AI, Inc. • United Arab Emirates

Remote
AED 209,000 - 297,000
Junior Software Engineer (Remote)
Junior Software Engineer (Remote)

Joblet-AI • United Arab Emirates

On-site
AED 60,000 - 120,000
Remote Senior Software Engineer - AI RL Environments
Remote Senior Software Engineer - AI RL Environments

RemoteJobsOne • Dubai

Remote
AED 506,000 - 759,000
Junior AI Code Reviewer & Challenge Engineer
Junior AI Code Reviewer & Challenge Engineer

Joblet-AI • United Arab Emirates

On-site
AED 60,000 - 120,000
Remote Full-Stack Engineer (Contract) - AI Training Tasks
Remote Full-Stack Engineer (Contract) - AI Training Tasks

Joblet-AI • Abu Dhabi

Remote
AED 165,000 - 331,000
AI Quality Evaluator - Remote Contractor
AI Quality Evaluator - Remote Contractor

YO AI Labs • Dubai

Remote
AED 126,000 - 253,000
Remote AI Research Engineer - Coding Agent Evaluation
Remote AI Research Engineer - Coding Agent Evaluation

Joblet-AI • United Arab Emirates

Remote
AED 734,000 - 955,000
Equity compensation
Performance-based bonuses
Health insurance premium reimbursement
+1
AI Evaluation Specialist Remote
AI Evaluation Specialist Remote

YO AI Labs • Abu Dhabi

Remote
AED 92,000 - 147,000
Top locations