Senior Backend Engineer — LLM Infra & Distributed Systems

Aleroy

United States

Remote

USD 150,000 - 230,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
24 days annual leave plus public holid
Competitive salary with performance‑in

Job summary

Aleroy is seeking a Senior Backend Engineer to own the architecture and evolution of our core backend services. This hands-on role requires turning ambiguous problems into clear technical plans and owning outcomes after code ships.

You will design and maintain backend services in Go and TS/JS, build distributed systems, and implement OpenAI-compatible APIs with streaming, routing, and data storage using PostgreSQL and Redis.

Qualifications

  • 5+ years of backend engineering experience.
  • Strong experience with Go and TypeScript/JavaScript (Node.js).
  • Experience building distributed systems with concurrency models.
  • Proficiency with PostgreSQL and Redis.
  • Experience designing REST and/or gRPC APIs.

Responsibilities

  • Design, build, and maintain backend services in Go and TypeScript/JavaScript (Node.js).
  • Build and scale distributed systems that stay reliable as traffic grows.
  • Own features end to end from design through testing and release.
  • Design and maintain OpenAI-compatible APIs for chat and streaming.
  • Implement REST and gRPC interfaces between internal services.

Skills

Go
TypeScript/JavaScript
Distributed systems
PostgreSQL
Redis/Valkey
REST and gRPC

Tools

Jest/Supertest
pytest
Testcontainers
SSE/WebSockets

Job description

Aleroy is seeking a Senior Backend Engineer to own the architecture and evolution of our core backend services. This hands-on role requires turning ambiguous problems into clear technical plans and owning outcomes after code ships.

You will design and maintain backend services in Go and TS/JS, build distributed systems, and implement OpenAI-compatible APIs with streaming, routing, and data storage using PostgreSQL and Redis.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Backend Engineer – LLM Inference Platform
Senior Backend Engineer – LLM Inference Platform

Aleroy • United States

Remote
USD 140,000 - 180,000
24 days annual leave
Health insurance
Performance-based incentives
Backend Engineer (LLM inference) (Fully Remote)
Backend Engineer (LLM inference) (Fully Remote)

Aleroy • United States

Remote
USD 140,000 - 180,000
24 days annual leave
Health insurance
Performance-based incentives
Backend Engineer (LLM inference)
Backend Engineer (LLM inference)

Aleroy • United States

Remote
USD 150,000 - 230,000
Health insurance
24 days annual leave plus public holid
Competitive salary with performance‑in
Backend Engineer, TypeScript — Own AI API Features
Backend Engineer, TypeScript — Own AI API Features

Aleroy • United States

Remote
USD 90,000 - 130,000
Ownership of meaningful backend fees
Direct voice in technical decisions
Competitive compensation and incentive
Backend Engineer (TypeScript) (Fully Remote)
Backend Engineer (TypeScript) (Fully Remote)

Aleroy • United States

Remote
USD 90,000 - 130,000
Ownership of meaningful backend fees
Direct voice in technical decisions
Competitive compensation and incentive
Remote Senior Backend Engineer - LLM Inference & APIs
Remote Senior Backend Engineer - LLM Inference & APIs

HellaGoodAudio • United States

Remote
USD 120,000 - 170,000
Health insurance
24 days annual leave + public holidays
Remote-friendly
Senior Backend Engineer - AI Infra & LLM Focus
Senior Backend Engineer - AI Infra & LLM Focus

Underdog: Verified engineers. Interview-ready. Searching confidentially. And companies apply to you • United States

On-site
USD 150,000 - 230,000
Foundational Impact
Equity Ownership
Competitive Compensation
+2
Senior Backend Engineer, AI & LLM Platform
Senior Backend Engineer, AI & LLM Platform

chief.com • New York (NY)

On-site
USD 160,000 - 170,000
Competitive salary and equity
Flexible vacation policy
20 weeks paid parental leave
+2
Senior Backend Platform Engineer - Golang & APIs
Senior Backend Platform Engineer - Golang & APIs

Alkira Australia • Northern (KY)

Hybrid
USD 85,000 - 155,000
Senior Backend Engineer, Scalable AI Workflows
Senior Backend Engineer, Scalable AI Workflows

Algora Public Benefit Corporation • San Francisco (CA)

Hybrid
USD 150,000 - 210,000