Senior Backend Engineer: LLM Infra & Distributed Systems

Aleroy; Abu Dhabi; On-site; AED 240,000 - 420,000; Full time

Benefits offered by this job

Health insurance

24 days annual leave

Modern office in Yas Creative Hub

Job summary

Aleroy is seeking a Senior Backend Engineer to own the architecture and evolution of our core backend services. This is a hands-on role with real technical ownership across Go, TypeScript/Node.js, and Python.

You will design and maintain OpenAI-compatible APIs, build distributed systems that scale, and ensure high performance with PostgreSQL, Redis, and S3-compatible storage. Come join a small, senior team in Abu Dhabi delivering AI infrastructure.

Qualifications

• 5+ years of professional backend engineering experience.
• Strong commercial experience with both Go and TypeScript/JavaScript (Node.js); Python is a plus.
• Proven experience building and operating distributed systems, with an understanding of consistency, fault tolerance, and service-to-service communication.
• Deep understanding of concurrency models and how they work under the hood: Go's goroutines, channels, and scheduler, and Node.js's event loop and async/await model, including the trade-offs between them.
• Strong database knowledge: schema design, indexing, query optimization, transactions and isolation levels, and locking, primarily in PostgreSQL.
• Experience with Redis, Valkey, or similar in-memory stores.
• Experience building backend systems that serve LLM inference, or a strong understanding of the request lifecycle, token streaming, and long-running requests.
• Experience building streaming APIs (SSE/WebSockets), including cancellation and client disconnect handling.
• Understanding of OpenAI-compatible API design and its streaming and error semantics.
• Experience with request routing, load balancing, backpressure, and admission control for workloads where request cost varies widely.
• Hands-on experience designing REST and/or gRPC APIs.
• Experience building auth systems with JWT, Auth0, or similar.
• Track record of leading the design of systems or major features end to end, including writing design docs and driving decisions across teams.
• Experience debugging and resolving complex production issues in systems you owned.
• Ability to make trade-offs between speed, reliability, and maintainability, and to explain them clearly.

Responsibilities

• Design, build, and maintain backend services in Go and TypeScript/JavaScript (Node.js), plus Python where it fits.
• Build and scale distributed systems that stay reliable as traffic and complexity grow.
• Own features end to end, from design docs and implementation through testing and release.
• Identify tech debt, bottlenecks, and reliability risks before they become problems.
• Design and maintain OpenAI-compatible APIs for chat completions, streaming, and tool calls.
• Build token streaming over SSE/WebSockets with proper cancellation, disconnect handling, and partial responses.
• Build request routing and load balancing across inference backends by model, capacity, latency, and region.
• Implement backpressure, queueing, and admission control for variable-cost LLM workloads.
• Design REST and gRPC interfaces between internal services.
• Design and optimize data models in PostgreSQL.
• Use Redis/Valkey for caching, state, and high-performance workloads.
• Integrate with S3-compatible storage and Cloudflare R2.
• Build authentication and authorization flows with Auth0 and JWT.
• Build token-based rate limiting and usage metering for multi-tenant APIs.
• Build reliable third-party integrations, including Stripe payments, with retries, idempotency, and proper failure handling.
• Profile and optimize services for latency, throughput, and resource usage.
• Implement caching, concurrency, rate limiting, and timeout strategies.
• Write automated tests using Go testing tools, Jest/Supertest, pytest, and Testcontainers.
• Mentor engineers and raise the bar through code reviews and design discussions.

Skills

Go

TypeScript/JavaScript

Python

Distributed systems

PostgreSQL

Redis

LLM inference

REST/gRPC

SSE/WebSockets

OpenAI-compatible API design

Auth & security

Tools

Jest

Testcontainers

pytest

JWT

Auth0

Stripe

S3-compatible storage

Cloudflare R2

Job description

Aleroy is seeking a Senior Backend Engineer to own the architecture and evolution of our core backend services. This is a hands-on role with real technical ownership across Go, TypeScript/Node.js, and Python.

You will design and maintain OpenAI-compatible APIs, build distributed systems that scale, and ensure high performance with PostgreSQL, Redis, and S3-compatible storage. Come join a small, senior team in Abu Dhabi delivering AI infrastructure.