Low-Latency AI Backend Engineer

AI Chopping Block; Zürich; Vor Ort; CHF 120.000 - 170.000; Vollzeit

Zusammenfassung

AI Chopping Block is seeking a Backend Engineer, AI to own the inference and orchestration layer powering AI interactions. You will build and operate production systems that turn model capability into fast, stable APIs used across mobile and desktop clients.

Ideal candidates have strong backend fundamentals, experience with high-throughput services, and familiarity with AI inference patterns. The role emphasizes latency optimization and reliable production readiness.

Qualifikationen

• Strong backend engineering fundamentals in production environments.
• Experience running high-throughput, low-latency services.
• Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
• Comfortable debugging distributed systems under load.

Aufgaben

• Build and operate backend systems that serve AI-powered features in production.
• Design inference pipelines, orchestration layers, and service boundaries around models.
• Own production concerns: monitoring, logging, alerting, and incident response.
• Optimize latency and throughput across inference, caching, batching, and streaming.

Kenntnisse

Backend engineering

High-throughput services

Distributed systems

Debugging under load

Shipping mindset

Tools

Python

NodeJs

Pytorch

OpenAI/Anthropic/LLMs

SQL

NoSQL

Kubernetes

Docker

Jobbeschreibung

AI Chopping Block is seeking a Backend Engineer, AI to own the inference and orchestration layer powering AI interactions. You will build and operate production systems that turn model capability into fast, stable APIs used across mobile and desktop clients.

Ideal candidates have strong backend fundamentals, experience with high-throughput services, and familiarity with AI inference patterns. The role emphasizes latency optimization and reliable production readiness.