Backend Engineer - Open-Source AI Router

Menlo Research Pte. Ltd.

Singapore

On-site

SGD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Menlo Research Pte. Ltd. is hiring to build Jan Router, an enterprise LLM gateway, in Singapore.

You will own architecture, the first production deployment, and everything from request proxying to the billing ledger. This lean, agent-native setup requires coordinating coding and execution agents to ship at team scale while ensuring robust auth and billing paths. You will work closely with frontier researchers to ship AI services from model-level routing to billing-grade metering, balancing speed

Qualifications

  • Backend engineer with production-grade systems experience.
  • Experience shipping from zero to production.
  • Familiar with LLM infra, routing gateways and observability.
  • Knowledge of payments, billing, metering, or usage-based systems.

Responsibilities

  • Build the core gateway: a unified, OpenAI-compatible API in front of multiple providers.
  • Own provider routing, reliability, and cost/latency-aware routing.
  • Build billing and metering with per-request token accounting and usage ledgers.
  • Implement org controls: API key management, per-team quotas, and RBAC.
  • Integrate the Jan Agent routing with the gateway for unified metering.
  • Make speed-versus-correctness trade-offs carefully to avoid security or billing issues.

Skills

Go
Rust
TypeScript
Python
Docker
Kubernetes
RBAC
OAuth/OIDC
PostgreSQL
Redis

Tools

OpenAPI-compatible API
CI/CD

Job description

Menlo Research Pte. Ltd. is hiring to build Jan Router, an enterprise LLM gateway, in Singapore.

You will own architecture, the first production deployment, and everything from request proxying to the billing ledger. This lean, agent-native setup requires coordinating coding and execution agents to ship at team scale while ensuring robust auth and billing paths. You will work closely with frontier researchers to ship AI services from model-level routing to billing-grade metering, balancing speed

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Engineer: Adaptive Model Routing for On-Device AI
Research Engineer: Adaptive Model Routing for On-Device AI

XG TECH PTE.LTD. • Singapore

On-site
SGD 120,000 - 180,000
Research Engineer, Intelligent Model Routing for Edge AI
Research Engineer, Intelligent Model Routing for Edge AI

XG TECH PTE. LTD. • Singapore

On-site
SGD 120,000 - 180,000
Backend Engineer Ho Chi Minh City
Backend Engineer Ho Chi Minh City

Menlo Research Pte. Ltd. • Singapore

On-site
SGD 120,000 - 180,000
Applied Scientist: Adaptive Model Routing & Agent Evaluation
Applied Scientist: Adaptive Model Routing & Agent Evaluation

Bitdeer Technologies Group • Singapore

On-site
SGD 120,000 - 240,000
AI Routing Systems Intern — Analytics & ML
AI Routing Systems Intern — Analytics & ML

Ministry of National Development • Singapore

On-site
SGD 50,000 - 70,000
Customer Engineer, APAC
Customer Engineer, APAC

OpenRouter, Inc • Singapore

On-site
SGD 120,000 - 180,000
Full-Stack AI Systems Engineer
Full-Stack AI Systems Engineer

Knoveleng • Singapore

On-site
SGD 54,000 - 80,000
Senior Member of Technical Staff (Model Routing)
Senior Member of Technical Staff (Model Routing)

XG TECH PTE. LTD. • Singapore

On-site
SGD 120,000 - 180,000
Senior AI Engineer - Enterprise AI, Agents & RAG
Senior AI Engineer - Enterprise AI, Agents & RAG

nanyang tech pte. ltd. • Singapore

On-site
SGD 180,000 - 280,000
Backend Engineer – AI-Driven Agentic Systems (12m Contract)
Backend Engineer – AI-Driven Agentic Systems (12m Contract)

RMA Consultants Pte Ltd • Singapore

On-site
SGD 60,000 - 90,000