AI Platform Architect: Inference APIs & Model Routing

Mekari; Jakarta Pusat; On-site; IDR 360,000,000 - 600,000,000; Full time

Job summary

Mekari is building a shared inference platform that connects products to AI via a governed path to external models and hosted systems. This full-stack role owns the API/backend, web control surfaces, models, and drivers, ensuring production readiness under real load.

This role covers platform shipping, intelligence supply, and evaluation, shaping secure REST APIs, streaming endpoints, and policy-aware routing while collaborating with cross-functional teams.

Qualifications

• Experience shipping full-stack platforms with AI components.
• Proven ability to design secure, scalable APIs and services.
• Strong background in backend systems under load and concurrency.

Responsibilities

• Stay close to tasks, acceptance criteria, quality risks, traffic patterns, customer feedback, and incidents.
• Own the request path: API contracts, authentication (OAuth2), RBAC, tenant isolation, policy, routing execution, fallback, streaming, and metering.
• Design and build secure REST APIs and streaming endpoints, and backend services that stay correct under concurrency, partial failure, and traffic spikes.
• Build the web control surfaces that let operators observe state without reading source code.
• Integrate external model providers and self-hosted inference endpoints, maintaining a versioned catalog of models, drivers, capabilities, limits, and prices.
• Measure serving performance and plan capacity to optimize cost.
• Develop small task-specific models, prompts, retrieval flows, and agent drivers exposed via the platform.
• Define task-level quality and unacceptable behavior with product teams and domain experts.
• Mentor other engineers and raise design/code quality through review.

Skills

API design

REST APIs

Concurrency

Security

Observability

Mentoring

Tools

PostgreSQL

Kubernetes

Docker

OAuth2

Job description

Mekari is building a shared inference platform that connects products to AI via a governed path to external models and hosted systems. This full-stack role owns the API/backend, web control surfaces, models, and drivers, ensuring production readiness under real load.

This role covers platform shipping, intelligence supply, and evaluation, shaping secure REST APIs, streaming endpoints, and policy-aware routing while collaborating with cross-functional teams.