Staff Software Engineer

Annapurna; Berlin; Vor Ort; EUR 110.000 - 170.000; Vollzeit

Zusammenfassung

Annapurna in Berlin is seeking a Staff Software Engineer to lead backend services powering thousands of concurrent AI conversations at enterprise scale. You will impact latency, throughput, reliability, and production observability across the stack.

The role emphasizes real-time, low-latency systems with WebSocket/Socket.IO, Python asyncio, FastAPI and Pydantic. You will integrate LLMs, orchestrate concurrent tasks, and design contract-first APIs with OpenAPI/AsyncAPI, while championing tests,

Qualifikationen

• Experience designing low-latency, real-time backend services.
• Proficient with Python 3.13, asyncio, FastAPI, and Pydantic.
• Experience integrating LLMs via SDKs and gateways.
• Experience with concurrent, event-driven systems and retries.
• Familiarity with MongoDB (async) and Azure Blob Storage.
• Strong observability practice with OpenTelemetry and testing tooling.

Aufgaben

• Design and operate backend services powering thousands of concurrent AI conversations.
• Lead end-to-end delivery and ownership of roadmaps in fast-paced environments.
• Ensure latency, throughput, reliability, and observability in production.

Kenntnisse

Real-time systems

Python (asyncio)

LLM integration

Concurrent, event-driven design

WebSocket/Socket.IO

Async workflow orchestration

Tools

MongoDB (async)

Azure Blob Storage

OpenAPI/AsyncAPI

Docker/Kubernetes

OpenTelemetry

Jobbeschreibung

We are partnering with our client, a cutting-edge software company in Berlin, to hire a Staff Software Engineer for a team at the forefront of Agentic Engineering. You will play a pivotal role in building backend services that drive thousands of realistic, concurrent, AI-driven conversations at enterprise scale, directly impacting latency, throughput, reliability, and operational visibility in production.

Key Skills and Experience

• High-performance, real-time systems: Designing and operating low-latency services for WebSocket/Socket.IO, server-sent events, and long-lived connections, including handling reconnects, backpressure, and partial delivery.
• Python (asyncio) expertise: Deep proficiency with Python 3.13, asyncio, FastAPI, Pydantic, and hexagonal architectures to build scalable, maintainable, and testable backend services.
• LLM integration: Experience integrating LLMs via SDKs and gateways, managing prompt-driven personas, streaming completions, and balancing cost–latency trade-offs in production.
• Concurrent, event-driven systems: Task orchestration and scheduling with tools like APScheduler, managing thousands of concurrent jobs, implementing retries, resilience, idempotency, and graceful shutdown.
• Data and storage: Working with MongoDB (async), Azure Blob Storage, and contract-first API design using OpenAPI/AsyncAPI.
• Observability and quality: Implementing OpenTelemetry, Datadog, structured logging, SLOs, and robust testing with pytest, Testcontainers, Pact, Locust, ruff, mypy, and SonarQube.
• Cloud-native delivery: Operating Dockerized services on Kubernetes with Helm, GitHub Actions CI/CD, feature flags, and Renovate.
• Leadership and ownership: Leading complex multi-month roadmaps, owning end-to-end delivery and operations, and thriving in fast-paced, product-focused environments.

If this aligns with your background and aspirations, we would be delighted to introduce you to our client's team.