Applied ML / AI Engineer

Nestria Ai Northstar Ai Shield Pte. Ltd.; Singapore; On-site; SGD 70,000 - 100,000; Full time

Job summary

Nestria Ai Northstar Ai Shield Pte. Ltd. is seeking an Applied ML / AI Engineer to design AI evaluation and orchestration workflows. This hybrid role involves working closely with founders and shaping AI systems for regulated industries.

Ideal candidates will have a Bachelor's degree in a relevant field, strong Python skills, and practical experience in AI and ML applications. Join us to build reliable AI systems in a collaborative, curiosity-led culture.

Qualifications

• Bachelor’s degree in Computer Science, AI, or related field.
• Master’s degree is preferred.
• Strong programming skills in Python required.
• Practical experience building AI applications is essential.

Responsibilities

• Design and implement AI evaluation workflows.
• Build verification flows for AI outputs.
• Support customer use-case adaptation.
• Develop orchestration workflows for AI agents.

Skills

Strong programming skills in Python

Understanding of model evaluation

Practical experience with AI, ML

Strong problem-solving ability

Education

Bachelor’s degree in Computer Science or related field

Master’s degree preferred

Tools

APIs

Data pipelines

Workflow orchestration

Job description

Location : Singapore
Employment Type: Full-time
Work Arrangement: Hybrid / on-site, depending on project needs
Compensation : Competitive base compensation, aligned with experience and role scope
Work Eligibility: Applicants must have the right to work in Singapore

Nestria AI is a Singapore-based high-assurance agentic AI startup building reliable, secure, and enterprise-ready AI systems for regulated and IP-sensitive industries. Our platform helps enterprises deploy agentic AI safely through runtime assurance, observability, verification workflows, secure orchestration, and customer-ready deployment environments.

We are building a creative, collaborative, and curiosity-led culture where people are encouraged to challenge the status quo, communicate openly, move with ownership, and support each other with empathy and respect.

About the Role

We are looking for an Applied ML / AI Engineer to design and implement AI evaluation, orchestration, and verification workflows for our platform. This role sits at the intersection of applied AI, software engineering, experimentation, evaluation, and customer use-case adaptation.

As an early team member, you will work closely with the founders and have the opportunity to shape the product, engineering culture, and customer-facing platform as the company grows.

Key Responsibilities

Design and implement AI evaluation workflows, including model evaluation logic, test cases, scoring, benchmarking, and performance analysis.

Build verification flows to assess AI outputs for correctness, reliability, traceability, and policy adherence.

Develop orchestration workflows for AI agents, including task routing, tool use, multi-step reasoning flows, and validation loops.

Support use-case adaptation across customer pilots, including workflow design, prompt architecture, data preparation, and evaluation setup.

Build testing pipelines for AI-driven features, including regression testing, edge-case testing, and model comparison.

Analyse model performance, failure modes, latency, accuracy, consistency, and reliability across different workflows.

Work with platform engineers to integrate AI workflows into runtime services, dashboards, APIs, and deployment environments.

Support experimentation with different models, prompting strategies, retrieval workflows, and verification methods.

Prepare technical documentation, evaluation reports, and internal engineering notes.

Work closely with founders and engineering team to translate customer use cases into working AI system designs.

Requirements

Bachelor’s degree in Computer Science, Engineering, Data Science, AI, Machine Learning, or a related technical field.

Master’s degree is preferred.

Strong programming skills in Python.

Practical experience building AI, ML, LLM, NLP, RAG, or agentic AI applications.

Understanding of model evaluation, testing, benchmarking, error analysis, and performance measurement.

Experience with APIs, data pipelines, workflow orchestration, and software engineering practices.

Familiarity with LLM frameworks, vector databases, retrieval systems, model providers, or evaluation libraries.

Ability to experiment quickly, analyse results clearly, and turn prototypes into reliable workflows.

Strong problem-solving ability and comfort working with ambiguous technical problems.

Nice to Have

• Experience with AI safety, AI governance, model risk management, red-teaming, or assurance workflows.
• Experience with agentic AI systems, tool-using agents, multi-agent workflows, or autonomous task execution.
• Familiarity with enterprise AI deployment, RAG pipelines, data security, or regulated environments.
• Experience with technical domains such as cybersecurity, software analysis, compliance automation, hardware security, or operations automation.

What We Look For

• Strong curiosity to learn and build in a fast-changing AI environment.
• Startup mindset, high ownership, and willingness to wear multiple hats.
• Clear thinking, practical execution, and comfort working through ambiguity.
• Strong culture add: openness, collaboration, empathy, and constructive challenge.
• Interest in building reliable AI systems that enterprises can trust and deploy.

Why Join Us

Work directly with the founding team of a deep-tech AI startup.

Work on high-impact problems in reliable AI, agentic AI, AI governance, security, and enterprise automation.

Gain exposure to customer pilots across regulated and IP-sensitive industries.

Join at an early stage where your work will directly shape the product and company direction.

Be part of a creative, collaborative, and curiosity-led culture that values openness, empathy, ownership, and constructive challenge.