Senior Backend Engineer – LLM Inference Platform

Aleroy

United States

Remote

USD 140,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

24 days annual leave
Health insurance
Performance-based incentives

Job summary

Aleroy in the United States is seeking a senior backend engineer to own the architecture and evolution of our core services powering AI inference. You will translate ambiguous problems into clear technical plans and drive decisions end to end.

Design OpenAI-compatible APIs for chat completions, streaming, and tool calls, optimize PostgreSQL data models, and implement caching with Redis and Valkey. Join a small, senior team that values ownership, fast execution, and low bureaucracy.

Qualifications

  • Experience owning backend architecture and delivering end-to-end technical decisions.
  • Strong API design skills for scalable services and AI tooling.
  • Experience with PostgreSQL and caching strategies (Redis).

Responsibilities

  • Own the architecture and evolution of core backend services with real technical ownership.
  • Design OpenAI-compatible APIs for chat completions, streaming, and tool calls.
  • Optimize data models in PostgreSQL and use Redis/Valkey for caching.

Skills

Backend architecture
API design
OpenAI API familiarity
PostgreSQL
Redis caching

Tools

PostgreSQL
Redis
Valkey

Job description

Aleroy in the United States is seeking a senior backend engineer to own the architecture and evolution of our core services powering AI inference. You will translate ambiguous problems into clear technical plans and drive decisions end to end.

Design OpenAI-compatible APIs for chat completions, streaming, and tool calls, optimize PostgreSQL data models, and implement caching with Redis and Valkey. Join a small, senior team that values ownership, fast execution, and low bureaucracy.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Backend Engineer (LLM inference) (Fully Remote)
Backend Engineer (LLM inference) (Fully Remote)

Aleroy • United States

Remote
USD 140,000 - 180,000
24 days annual leave
Health insurance
Performance-based incentives
Senior Backend Engineer — LLM Infra & Distributed Systems
Senior Backend Engineer — LLM Infra & Distributed Systems

Aleroy • United States

Remote
USD 150,000 - 230,000
Health insurance
24 days annual leave plus public holid
Competitive salary with performance‑in
Backend Engineer (LLM inference)
Backend Engineer (LLM inference)

Aleroy • United States

Remote
USD 150,000 - 230,000
Health insurance
24 days annual leave plus public holid
Competitive salary with performance‑in
Senior AI Backend Architect
Senior AI Backend Architect

Aimlroles • United States

Remote
USD 140,000 - 200,000
Senior Backend Engineer, Inference Platform (Equity)
Senior Backend Engineer, Inference Platform (Equity)

Together Computer Inc • San Francisco (CA)

On-site
USD 200,000 - 290,000
Equity
Health insurance
Competitive base salary
Remote Senior Backend Engineer - LLM Inference & APIs
Remote Senior Backend Engineer - LLM Inference & APIs

HellaGoodAudio • United States

Remote
USD 120,000 - 170,000
Health insurance
24 days annual leave + public holidays
Remote-friendly
Senior Backend Engineer - AI/LLM & Microservices
Senior Backend Engineer - AI/LLM & Microservices

Coinbase, Inc. • New York (NY)

On-site
USD 150,000 - 210,000
Medical Insurance
Dental Insurance
Vision Insurance
+3
Senior Backend Engineer - AI Infra & LLM Focus
Senior Backend Engineer - AI Infra & LLM Focus

Underdog: Verified engineers. Interview-ready. Searching confidentially. And companies apply to you • United States

On-site
USD 150,000 - 230,000
Foundational Impact
Equity Ownership
Competitive Compensation
+2
Lead Inference Engineer — AI Serving & GPU Optimization
Lead Inference Engineer — AI Serving & GPU Optimization

Aleroy • United States

Remote
USD 140,000 - 190,000
Principal AI Systems Engineer (LLM Backend Architect)
Principal AI Systems Engineer (LLM Backend Architect)

Salesforce • San Francisco (CA)

On-site
USD 180,000 - 240,000
Paid Time Off
Medical Insurance
Dental Insurance
+7