Remote Senior Backend Engineer for AI Platform & LLM Infra

Jobgether; United States; A distancia; USD 140.000 - 210.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote work US

Technical ownership

High-scale engineering

Modern stack

Professional growth

Collaborative environment

Descripción de la vacante

Jobgether is seeking an experienced Backend Engineer to architect and scale our AI platform in production for millions of users. You will own backend services, design APIs, and lead integration with multiple LLM providers, including retrieval-augmented generation and token streaming.

Ideal candidates have 5+ years of backend experience with Go or similar statically typed languages, plus hands-on work with vector databases, model serving, and observability.

Formación

• Backend engineering experience with a statically typed language (Go/Java/Kotlin/C#).
• Production LLM features in production (retrieval-augmented generation, streaming).
• LLM serving with multi-provider routing, failover, token streaming, and usage metering.
• Experience building vector search and embedding pipelines with source-backed answers.
• Understanding AI failure modes; implement instrumentation and safeguards.
• Ability to own backend services lifecycle from schema to on-call support.
• Location in United States and work authorization.

Responsabilidades

• Design, build, and scale backend infrastructure for AI features across a high-traffic platform.
• Develop and maintain LLM integration and serving services with model routing and streaming.
• Build retrieval-augmented generation systems with vector search and citations.
• Own API design and backend service architecture across deployment and operations.
• Monitor live services, troubleshoot incidents, improve resilience.
• Collaborate with platform architects to align engineering practices and AI capabilities.

Conocimientos

Backend engineering

Go

Java

Python

LLM integration

API design

Observability

Cloud/DevOps

Herramientas

LiteLLM

vLLM

TGI

Qdrant

pgvector

LoRA

Ruby on Rails

React/TypeScript

Descripción del empleo

Jobgether is seeking an experienced Backend Engineer to architect and scale our AI platform in production for millions of users. You will own backend services, design APIs, and lead integration with multiple LLM providers, including retrieval-augmented generation and token streaming.

Ideal candidates have 5+ years of backend experience with Go or similar statically typed languages, plus hands-on work with vector databases, model serving, and observability.