R&D Engineering Manager - AI Evaluation Engine

Resaro

Singapore

On-site

SGD 150,000 - 210,000

Full time

14 hours ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Resaro is hiring a hands-on R&D engineering leader for its AI evaluation team. You will grow and manage a high-performing group of engineers and scientists while maintaining architectural depth to guide system design. You will partner with Product and drive engineering excellence across AI evaluation capabilities.

You’ll lead 8–10 engineers and scientists across Singapore and Europe, owning delivery, roadmapping, and cross-team coordination with a strong focus on impact and governance.

Qualifications

  • 7+ years of professional software engineering with leadership/managerial experience.
  • Strong depth in ML or data science to design evaluation metrics and guide R&D.
  • Proficiency in Python for backend services and data pipelines.
  • Demonstrated leadership in coordinating architecture and engineering standards.

Responsibilities

  • Own the evaluation science and determine metrics for AI systems under scrutiny.
  • Lead the technical direction of the evaluation engine across computer vision, LLM/RAG, and VLM.
  • Shape future capabilities and advise Product on 6–12 month priorities.
  • Set engineering standards, review code, and guide architecture to unblock the team.
  • Manage 8–10 engineers and scientists across Singapore and Europe; drive hiring and career development.

Skills

Python
Leadership
ML
Data Science
Architecture
Communication

Tools

Kubernetes
TypeScript
Docker

Job description

About Us

Resaro was founded on the belief that AI will change the world in ways we cannot even imagine - but every new technology needs safeguards to advance. We are an independent, third-party AI assurance company: we build the software and run the evaluations that let enterprises and public-sector bodies deploy AI they can actually trust.

Our work spans computer vision, generative AI and LLMs, vision-language models, and increasingly agentic and autonomous systems, for clients across government, defence, and commercial sectors.

Our product, the Approved Intelligence Platform (AIP), is where this becomes real software: customers upload datasets, register the AI systems they want tested, run rigorous evaluations, and produce defensible evidence and reports.

The Role

We're hiring a hands-on R&D engineering leader for our AI evaluation team - someone whose primary focus is growing and managing a high-performing team of engineers and scientists, while maintaining the technical depth to guide their architecture and system design. You'll drive AI/ML engineering excellence and coordinate across teams to align technical decisions and resolve dependencies. You'll partner closely with the Product team.

This role can be based either in Singapore or Munich.

What You’ll Do
  • Own the evaluation science, decide how we measure AI systems (accuracy, reliability, robustness, data quality) and turn research into methods that hold up under customer and regulatory scrutiny.
  • Lead the technical direction of AIP's evaluation engine across verticals: computer vision, LLM/RAG, VLM, and emerging areas like agentic and embodied AI systems.
  • Shape where the capability goes next, understand the systems we test and the customers who rely on the evidence, and bring a strong point of view to Product on which evaluation capabilities will matter 6-12 months out.
  • Lead through technical context. Your primary output is the success of your team. You set the bar for engineering quality through rigorous system design, strategic code reviews, and pairing - stepping into the codebase to unblock the team and guide architecture.
  • Own conceptual integrity as the system grows. Make and document the architecture decisions that matter, keep them coherent, and prevent uncontrolled coupling on key hotspots.
  • Make people management your top priority. Own 1:1s, performance, and career development for a multidisciplinary team of 8–10 engineers and scientists across Singapore and Europe. Partner on hiring to raise the team's bench strength, and create the shared context and ways of working that let engineers, AI engineers, and governance analysts solve problems together without constant top-down orchestration - building a culture of high trust and high output.
  • Own delivery and partner across teams. Translate the roadmap into executable plans, sequence the work, and set the standard for what reaches customers. This role reports to the CTO and works closely with the Product team to communicate load and dependencies, and to manage scoping and resourcing to ensure consistent execution against the product roadmap.
What We’re Looking For
  • 7+ years of professional software engineering experience shipping and operating production systems, including time as a tech lead and/or engineering manager.
  • Working depth in ML, data science, or statistics - enough to design and defend an evaluation metric and guide applied R&D, not just implement someone else's spec. You don't need to be a research scientist; you do need to hold your own with the ones on your team.
  • Proficiency in Python for backend services and data pipelines.
  • Demonstrated technical leadership of an engineering team - owning architecture decisions and setting engineering standards.
  • Direct people-management experience (or clear, evidenced readiness for it).
  • Strong architecture judgement - experience managing coupling, leading migrations, and keeping a growing system coherent through ADRs and dependency hygiene.
  • A leader's mindset with a builder's background - you find your deep satisfaction in growing people, scaling a team, and ensuring conceptual integrity.
  • Clear written and verbal communication, and comfort being measured against concrete quarterly outcomes.
Nice To Have
  • Experience building or integrating data-quality tooling, or evaluation/testing/assurance capability, in one or more AI domains: LLM/RAG, agentic systems, computer vision.
  • Ability to lead across a typed frontend stack (TypeScript/React).
  • Data-intensive pipelines with columnar/lakehouse formats (Parquet/Iceberg) and DuckDB or similar.
  • Container-based or serverless execution frameworks (Nuclio or comparable function/orchestration systems).
  • Kubernetes and Helm for production workloads.
  • GPU/CUDA infrastructure for model inference at scale.
  • Leading a platform migration with live, enterprise customers where evidence, auditability, and back-compatibility matter.
  • Published or applied research in model evaluation, benchmarking, or AI safety/assurance.
Our Hiring Blueprint
  • Production-grade code. You ship software that is correct, tested, observable, and maintainable by others
  • Communication and handover. You write clearly, document decisions, and leave work in a state another engineer can pick up. As a lead, you make your team's context legible.
  • Independent operation. You can take an ambiguous problem, scope it, decompose it, sequence it, and drive it to a shipped outcome without close supervision - and you help your team do the same.
  • T-shaped profile. Deep in your core domain (AI/backend/systems/etc.) and broad enough to operate steadily across the stack and the ML-evaluation domain

Resaro is an Equal Opportunity Employer. We respect each individual and support the diverse cultures, perspectives, skills and experiences within our teams.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Evaluation Engine Lead & R&D Manager
AI Evaluation Engine Lead & R&D Manager

Resaro • Singapore

On-site
SGD 150,000 - 210,000
(Lead) Research Engineer, Digital Services, IAIC
(Lead) Research Engineer, Digital Services, IAIC

A*STAR - Agency for Science, Technology and Research • Singapore

On-site
SGD 140,000 - 210,000
(Senior) Research Engineer, Digital Services, IAIC
(Senior) Research Engineer, Digital Services, IAIC

A*STAR - Agency for Science, Technology and Research • Singapore

On-site
SGD 140,000 - 210,000
Senior Software Engineer, Machine Learning, Acceleration Platform
Senior Software Engineer, Machine Learning, Acceleration Platform

United States Digital Space LLC • Singapore

On-site
SGD 140,000 - 230,000
Expert R&D Software Engineer – AI / ML
Expert R&D Software Engineer – AI / ML

Keysight Technologies • Singapore

On-site
SGD 180,000 - 320,000
Senior Research Engineer II, Digital Services
Senior Research Engineer II, Digital Services

A*STAR RESEARCH ENTITIES • Singapore

On-site
SGD 150,000 - 230,000
Fullstack Software Engineer
Fullstack Software Engineer

PatSnap • Singapore

On-site
SGD 140,000 - 210,000
Competitive compensation
Global teamwork opportunities
Career development paths
+1
Agentic AI (Artificial Intelligence) Business Consultant
Agentic AI (Artificial Intelligence) Business Consultant

Rolls-Royce • Singapore

On-site
SGD 180,000 - 240,000
Senior Research Engineer II, Digital Services, IAIC
Senior Research Engineer II, Digital Services, IAIC

A*STAR RESEARCH ENTITIES • Singapore

On-site
SGD 120,000 - 180,000
Applied ML / AI Engineer
Applied ML / AI Engineer

Nestria Ai Northstar Ai Shield Pte. Ltd. • Singapore

Hybrid
SGD 70,000 - 100,000