Founding Backend Engineer

LiteLLM; Deutschland; Remote; EUR 50.000 - 70.000; Vollzeit

Zusammenfassung

A growing tech startup in Germany seeks a backend developer to unify API formats for LLMs, migrate systems for higher throughput, and enhance infrastructure. Candidates should have 2+ years in backend or full-stack roles and be excited about open source software. This position offers a chance to shape the tech stack and work closely with the leadership team in a dynamic environment.

Qualifikationen

• 2+ years of experience in backend or full-stack development.
• Excitement about open source software and engaging with users.
• Key role in maintaining and scaling reliable infrastructure.
• Thrives in a small, accountable team.

Aufgaben

• Unify the format for calling LLM APIs in the OpenAI spec.
• Migrate key systems from httpx to aiohttp.
• Add support for Anthropic, Bedrock Anthropic thinking param.
• Handle LLM provider-specific quirks.
• Compute aggregate spend with 1M+ Logs in the database.

Kenntnisse

Backend development

Full-stack development

Production grade critical systems

Open source software

High-performance infrastructure

Tools

Python

FastAPI

JS/TS

Redis

Postgres

s3

GCS Storage

Datadog

Slack API

Jobbeschreibung

Your main responsibility will be to make sure that LiteLLM unifies the format for calling LLM APIs in the OpenAI spec. Doing this involves writing transformations to transform the API request from the OpenAI spec to the format of the LLM provider.

You will be working closely with our CEO and CTO in this role.

Example projects you will pick up on joining:

• Migrate key systems from httpx to aiohttp to get 10x higher throughput

• Add support for Anthropic, Bedrock Anthropic thinking param on LiteLLM

• Handle LLM provider-specific quirks like OpenAI o-1 not supporting streaming

• Ensure LiteLLM can compute aggregate spend once there are 1M+ Logs in the database

• Add cost tracking + logging for /v1/messages Anthropic API

What is our tech stack

Backend built on Python, FastAPI. Frontend on JS/TS. Redis, Postgres, s3, GCS Storage, Datadog, Slack API

Who we are looking for

• Previous founders

• You have 2+ years of experience in backend or full-stack development and have worked on production grade critical systems

• You are excited about open source software. You want to talk to our users to understand why they use us and what they require.

• You have played a key role in maintaining and scaling reliable, high-performance infrastructure.

• You are a hard worker and thrive working in a small and accountable team

• You are eager to take responsibility for shaping the infrastructure of a rapidly growing development tool.