Senior Software Engineer (Backend/LLM Infrastructure)

Routine Labs GmbH; Berlin; On-site; EUR 70,000 - 90,000; Full time

Job summary

A tech-focused company in Berlin is seeking a Senior Software Engineer specializing in backend and LLM infrastructure. The role involves building Python/FastAPI services, optimizing LLM pipelines, and ensuring the reliability of CI/CD processes. Ideal candidates will have 5-8 years of backend or full-stack experience and hands-on knowledge of LLM systems. The company values diverse perspectives and encourages applicants from all backgrounds.

Qualifications

• 5–8+ years of backend or full-stack engineering experience with Python/FastAPI in production.
• Hands-on experience with LLM systems and performance/cost optimization.
• Strong operations mindset focusing on SLOs, monitoring, incidents, and rollbacks.

Responsibilities

• Build and maintain Python/FastAPI services and SQLAlchemy models.
• Implement and optimize LLM orchestration pipelines.
• Own CI/CD pipelines and ensure operational reliability.

Skills

Python

FastAPI

LLM systems

CI/CD

Redis

Tools

SQLAlchemy

Celery

OpenTelemetry

Job description

At New Objectives, we are building Europe's first secure, auditable, and EU-compliant automation infrastructure for legacy systems. We're taking a practical approach to improving how engineers work with AI systems. Combining LLMs with familiar software engineering methods to make it easier for people to build, modify and maintain software automations. Our platform lowers the effort required to turn natural-language instructions into deterministic, testable code that can interface with and automate legacy systems.

We’re hiring a Senior Software Engineer (Backend/LLM Infrastructure) to build and operate the backend services and LLM pipelines that make this automation fast, reliable, and production-ready.

Tasks

• Build and maintain Python/FastAPI services, SQLAlchemy/Alembic models, Redis caching, and background jobs (Celery/RQ).
• Implement and optimize LLM orchestration pipelines: RAG flows, agent workflows, evaluation, tracing, retries, and feature flags.
• Own CI/CD pipelines, environment promotion, schema migrations, canary/blue-green deployments, and operational reliability.
• Add observability: structured logs, OpenTelemetry tracing, and RAG quality dashboards.
• Integrate secure multi-tenant access with SSO (OIDC/SAML) and RBAC.
• Participate in on-call rotations, incident response, and continuous improvement of production systems.

Requirements

• 5–8+ years of backend or full-stack engineering experience with Python/FastAPI/LangGraph in production.
• Hands-on experience with LLM systems, embeddings, vector stores, and performance/cost optimization.
• Strong CI/CD and operations mindset: SLOs, monitoring, incidents, and rollbacks.
  Solid SQL, Redis, and background job experience.
• Experience integrating SSO (OIDC/SAML) and multi-tenant RBAC.
• Nice addition: Playwright/Stagehands/pywinauto, Temporal/Kafka, feature flags (langfuse/Unleash), HIPAA/SOC2 exposure.

Join the team shaping the technical foundation of a company redefining how legacy software gets automated.

We value diverse perspectives and welcome candidates of all genders, identities and backgrounds.