Research Engineer, AI Safety

Concordia AI; Singapore; On-site; SGD 70,000 - 110,000; Full time

Job summary

Concordia AI is hiring engineers to design and ship automated evaluation frameworks for frontier AI models and agent systems. You will contribute to building evaluation platforms, integrating benchmarks, and driving safety products from development to deployment across domestic and international clients.

The role emphasizes strong Python skills, DevOps tooling, and capability in Chinese communication for collaboration with partners in China and globally.

Qualifications

• Bachelor's degree or above required.
• Proficiency in Python with strong data structures/algorithms knowledge.
• Excellent logical reasoning and technical documentation skills.
• Strong Chinese reading/writing with spoken Chinese for communication.

Responsibilities

• Build automated evaluation platforms for large models, multimodal models, AI agents, and multi-agent systems.
• Integrate open-source and in-house benchmarks into the evaluation platform.
• Productize frontier AI safety technologies, including evaluation, risk modeling, alignment, and monitoring.
• Deliver safety products as services, including evaluation reports and vulnerability assessments.

Skills

Python

Logical reasoning

Technical documentation

Chinese reading/writing

Education

Bachelor's degree or above

Tools

Git

Docker

Kubernetes

Linux CLI

Job description

Our hiring process has 4 phases:

• Written application form
• Online written test
• 2 online interviews
• 2-day in-person work trial

*An additional coding test will be included as part of the online written test stage.

Background

Concordia AI is committed to identifying and addressing the most pressing safety risks arising from frontier AI development. As frontier large models and agent systems grow increasingly complex, how to translate safety principles into efficient, stable, and automated infrastructure has become the core challenge in putting AI safety technology into practice. We are looking for engineers who combine solid foundational technical skills with architectural thinking to join us and lead the development of automated evaluation frameworks, risk monitoring platforms, and safety products, building a solid safety foundation for AI systems.

Responsibilities

As a core team member at Concordia AI, you will focus on building evaluation frameworks and integrating evaluation benchmarks for frontier large models and AI agent systems. You will also lead the product development of safety evaluation and remediation tools, deploying them across frontier large models and agent systems to strengthen the safety of AI technologies.

• Evaluation Platform Development: Build automated evaluation platforms for large models, multimodal models, harnesses, AI agents, and multi-agent systems. Drive core platform capabilities, including model integration, benchmark integration, harness integration, request routing, task scheduling, error handling, cost optimization, and data analysis.
• Benchmark Integration: Integrate open-source and inhouse benchmarks into the evaluation platform, ensuring feature completeness, result accuracy, and operational stability.
• Safety Product Development: Productize frontier AI safety technologies-including evaluation, risk modeling, alignment, and monitoring-to build our public risk-monitoring platform as well as commercial safety evaluation and remediation products. Continuously optimize product functionality, performance, usability, and stability.
• Safety Service Deployment: Partner with leading domestic and international large model and AI agent developers in China and internationally to deliver safety products as services. Provide high-quality implementation plans, evaluation reports, vulnerability assessments, and improvement recommendations to secure client AI systems.

Qualifications

Required

• Alignment with Concordia AI's mission, along with a strong sense of responsibility, risk awareness, and a proactive mindset; Ability to work independently while collaborating effectively within a team.
• Bachelor's degree or above.
• A fast learner who continuously tracks and applies state-of-the-art technological advances
• Proficiency in Python with a strong command of data structures and algorithms.
• Proficiency with Linux CLI and DevOps/development tools such as Git, Docker, and Kubernetes.
• Practical experience with large model API integration, model deployment, and benchmarking.
• Excellent logical reasoning and technical documentation skills to articulate system designs and technical reports.
• Strong Chinese reading and writing skills, with proficient spoken Chinese for smooth communication.

Preferred

• Degree in Computer Science, Machine Learning, Artificial Intelligence, Software Engineering or a related field.
• 2+ years of research or industry experience on large models, AI agents, evaluation platforms, or other software systems.
• Experience with complex software engineering, agent development, or contributions to open-source projects.