Senior Backend Engineer - LLM & Distributed Systems

Aleroy; United Arab Emirates; On-site; AED 360,000 - 540,000; Full time

Benefits offered by this job

24 days annual leave

Health insurance

Modern office in Yas Creative Hub

Job summary

Aleroy is building a unified platform for high-performance AI inference. We are seeking a Senior Backend Engineer to own the architecture of core backend services and deliver end-to-end features.

You will work hands-on across Go, TypeScript/JavaScript (Node.js), and Python, building distributed systems, LLM-serving APIs, and robust data/storage layers. You will design OpenAI-compatible APIs, implement token streaming via SSE/WebSockets, and manage routing, caching, and scaling for multi-tenant

Qualifications

• 5+ years of professional backend engineering experience.
• Strong experience with Go and TypeScript/JavaScript; Python a plus.
• Experience building distributed systems with strong fault tolerance and service-to-service communication.
• Deep understanding of concurrency models in Go and Node.js.
• Strong database knowledge: PostgreSQL, indexing, transactions.
• Experience with Redis, Valkey or similar in-memory stores.
• Experience building backend systems for LLM inference and streaming APIs (SSE/WebSockets).
• Experience with REST and/or gRPC APIs and auth systems (JWT/Auth0).
• Track record of end-to-end design and driving decisions across teams.

Responsibilities

• Own architecture and evolution of core backend services.
• Build and scale distributed systems with Go/TypeScript/Python.
• Design OpenAI-compatible APIs for chat, streaming, and tool calls.
• Implement token streaming, routing, load balancing, and backpressure.

Skills

Go

TypeScript/JS

Python

Distributed systems

LLM inference

REST/gRPC APIs

Auth0/JWT

SSE/WebSockets

PostgreSQL

Redis/Valkey

Cloud storage (S3)

OpenAI-compatible API design

Tools

PostgreSQL

Redis

Valkey

Job description

Aleroy is building a unified platform for high-performance AI inference. We are seeking a Senior Backend Engineer to own the architecture of core backend services and deliver end-to-end features.

You will work hands-on across Go, TypeScript/JavaScript (Node.js), and Python, building distributed systems, LLM-serving APIs, and robust data/storage layers. You will design OpenAI-compatible APIs, implement token streaming via SSE/WebSockets, and manage routing, caching, and scaling for multi-tenant