Remote Software Engineer - RL Task Benchmarking

Synthires

Brussel

Remote

EUR 63,000 - 125,000

Full time

25 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Synthires is seeking experienced Software Engineers to create RL environments that test AI models on real‑world software tasks. You will design coding challenges from real repositories and build reproducible development environments.

This role emphasizes strong hands‑on programming and software engineering fundamentals; AI background is not required, but you will shape verification systems and reference solutions.

Qualifications

  • Strong understanding of algorithms, data structures, and software engineering principles.
  • Proven ability to debug complex systems and resolve challenging software issues.
  • Experience implementing features, refactoring code, and optimizing performance.
  • Ability to build reproducible development environments and write reliable verification tests.

Responsibilities

  • Create realistic coding tasks for advanced AI models using known repositories.
  • Design problems requiring genuine engineering expertise, including subtle bug fixes, non-trivial feature implementation, and meaningful performance improvements.
  • Build reproducible environments for each coding task.
  • Develop deterministic verifiers that accept correct solutions across different valid implementations while rejecting incorrect, incomplete, or hard-coded approaches.
  • Write reference solutions showing how each task can be successfully completed.
  • Ensure tasks are technically sound, clearly defined, and independently verifiable.
  • Identify and flag tasks that are ambiguous or cannot be reliably verified rather than submitting them.
  • Document technical requirements and communicate problem specifications clearly.

Skills

Algorithms
Data structures
Debugging
Refactoring
Performance
Reinforcement learning
Repro environments
Verification tests
Documentation
Communication

Job description

Synthires is seeking experienced Software Engineers to create RL environments that test AI models on real‑world software tasks. You will design coding challenges from real repositories and build reproducible development environments.

This role emphasizes strong hands‑on programming and software engineering fundamentals; AI background is not required, but you will shape verification systems and reference solutions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer (Remote | $50–$100/hr)
Software Engineer (Remote | $50–$100/hr)

Synthires • Brussel

Remote
EUR 63,000 - 125,000
Multilingual AI Benchmark Engineer (French) — Remote
Multilingual AI Benchmark Engineer (French) — Remote

Lilt, Inc. • Belgium

Remote
EUR 83,000 - 165,000
Remote work
Flexible schedule
AI Benchmark Engineer | Native Language Specialist - French (Belgium) - Remote
AI Benchmark Engineer | Native Language Specialist - French (Belgium) - Remote

Lilt, Inc. • Belgium

Remote
EUR 83,000 - 165,000
Remote work
Flexible schedule
Remote Swift/iOS Expert - AI Training Challenge Designer
Remote Swift/iOS Expert - AI Training Challenge Designer

AfterQuery • Belgium

Remote
EUR 55,000 - 96,000
Competitive hourly compensation
YC-backed startup
Remote asynchronous
Software Engineer
Software Engineer

Xintas • Brussel Hoofdstad

On-site
EUR 70,000 - 95,000
Senior Finance & Operations Benchmark Specialist
Senior Finance & Operations Benchmark Specialist

Braintrust • Belgium

Remote
EUR 49,000 - 61,000
Remote Applied AI Engineer - Fine-Tune Open-Weight LLMs (Contractor)
Remote Applied AI Engineer - Fine-Tune Open-Weight LLMs (Contractor)

Toloka • Brussel

Remote
EUR 83,000 - 165,000
Ontop contractor platform
40 hours per week remote
Leading edge AI development
+2
Remote Software Engineer - AI Data Pipelines
Remote Software Engineer - AI Data Pipelines

Speechify Inc. • Oost-Vlaanderen

Hybrid
EUR 27,000 - 89,000
Autonomy
Asynchronous culture
Stock options
+2
Hybrid AI/ML Engineer: Lead Retrieval & Orchestration
Hybrid AI/ML Engineer: Lead Retrieval & Orchestration

Anchr • Evergem

Hybrid
EUR 90,000 - 130,000
Real R&D funding (VLAIO)
Hybrid work 2 days/week
Learning budget
+1
AI Engineer/Developer
AI Engineer/Developer

MEERAB Group • Brussel

On-site
EUR 70,000 - 110,000