Machine Learning Engineer (Voice) (m/f/d)

Zaitgeist Innovation Group GmbH

Berlin

On-site

EUR 70,000 - 110,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Real ownership of models and live user
EU GPU infrastructure
Central office near Rosenthaler Platz
28 days vacation

Job summary

HalloCharly / Zaitgeist is building an in-house voice AI stack in Berlin. You will select and fine-tune STT/TTS models, run production inference on EU GPUs, and design the orchestration layer for real-time voice interactions with an LLM backend.

Join a small Berlin team shipping state-of-the-art speech systems, with CI-driven evaluation and a strong bias toward quality. Expect hands-on ML, fast iteration, and edge-case testing in a production setting.

Qualifications

  • Several years of work on ML systems or strong notebooks background
  • Good PyTorch skills and hands-on tuning of speech/audio models
  • Experience with STT and/or TTS (Whisper-family or similar) preferred
  • Experience with serving (GPU inference, streaming, latency, batching) is a plus
  • Strong quality mindset: evaluate, benchmark, and avoid shipping on single examples
  • Daily use of AI coding assistants and rapid development without production risk
  • Nice-to-have: real-time voice, privacy-preserving ML, German language skills

Responsibilities

  • Select open STT and TTS models, fine-tune on our domain with PyTorch and measure baseline improvements
  • Serve models in production on our GPUs in the EU: streaming, batching, quantisation, latency budgets and cost per call
  • Build the voice agent's orchestration layer: turn-taking, barge-in, tool calls and hand-over to our LLM agent (Python, FastAPI, pydantic-ai)
  • Evals that gate releases: word error rate on anonymised calls, pronunciation and naturalness tests, end-to-end conversation evals
  • Monitor quality in production and close the loop: from a failed call to a test case and better training data

Skills

PyTorch
Speech model fine-tuning
STT / TTS experience
GPU serving / inference
Quality mindset
AI coding assistants
German language skills (nice-to-have)

Tools

Python
FastAPI
pydantic-ai
PyTorch
vLLM
Docker

Job description

Charly answers the phone for more than 100 German municipalities — around the clock, in over 30 languages, hosted in the EU. Behind it is a small team in Berlin that ships fast: around 150 pull requests land in our repositories every month, and a good idea often talks to real citizens the same week. On the phone, the speech layer decides everything: does Charly catch a street name spoken in dialect, does the answer sound natural, does Charly avoid talking over people? We are now building this layer ourselves — with open models, on our own GPUs in Germany. That's where you come in.

Your Role

Select open STT and TTS models, fine-tune them on our domain with PyTorch and measure them properly against the baseline

Serve models in production on our own GPUs in the EU: streaming, batching, quantisation, latency budgets and cost per call

Build the voice agent's orchestration layer: turn-taking, barge-in, tool calls and the hand-over to our LLM agent (Python, FastAPI, pydantic-ai)

Evals that gate releases: word error rate on anonymised calls, pronunciation and naturalness tests, end-to-end conversation evals — wired into CI

Monitor quality in production and close the loop: from a failed call to a test case and to better training data

Your Profile

We welcome experienced candidates with several years of work on ML systems just as much as career starters who have mostly worked in notebooks so far

Good PyTorch skills, ideally with hands-on experience fine-tuning speech or audio models

Ideally experience with STT and/or TTS, e.g. Whisper-family models or modern neural TTS

Experience with serving (GPU inference, streaming, quantisation, latency under load) is a plus — otherwise you will learn it with us

A strong quality mindset: you don't ship without an eval, you distrust single examples, and you build benchmarks that predict real-world quality

You use AI coding assistants every day and move fast without putting production at risk

Nice-to-have: real-time voice (telephony/SIP, VAD, barge-in), privacy-preserving ML, German language skills

What We Offer

Real ownership: your models talk to citizens on live phone lines within your first month

Our own GPU infrastructure in the EU and room to experiment

A beautiful and central office right at Rosenthaler Platz

28 days of vacation per year

Our Application Process

01

Application to jobs@zaitgeist.com

02

Short phone screen

03

On-site interview

Python

FastAPI

Supabase

Frontend

TypeScript

Next.js

Tailwind

Cloud

EU hosting

Docker

Coolify

Logfire

AI / ML

pydantic-ai

PyTorch

vLLM

Ready for the next step?

We look forward to meeting you. Send us your application with your

CV and relevant projects or code samples.

To filter out AI-generated applications, please start your cover letter or

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Engineer - Speech (m/f/d)
Senior ML Engineer - Speech (m/f/d)

voize-l • Berlin

Hybrid
EUR 75,000 - 120,000
Stock options
Hybrid work environment
30 vacation days + birthday off
+4
Senior ML Engineer - Speech (m/f/d)
Senior ML Engineer - Speech (m/f/d)

Customer Onboarding Team Lead (m/f/d) @ voize • Hamburg

Hybrid
EUR 70,000 - 120,000
Stock options
30 vacation days
Germany transport ticket
+1
Senior ML Engineer - Speech (m/f/d)
Senior ML Engineer - Speech (m/f/d)

Voize • Berlin

Hybrid
EUR 70,000 - 110,000
Stock options
Vacation days 30
Transport ticket
+5
Senior ML Engineer - Speech (m/f/d)
Senior ML Engineer - Speech (m/f/d)

Customer Onboarding Team Lead (m/f/d) @ voize • Berlin

Hybrid
EUR 70,000 - 110,000
Stock options
30 vacation days
Germany Transport Ticket
+3
Senior ML Engineer - Speech (m/f/d)
Senior ML Engineer - Speech (m/f/d)

Customer Onboarding Team Lead (m/f/d) @ voize • München

Remote
EUR 90,000 - 130,000
Stock options
30 vacation days
Germany Transport Ticket
+2
Senior ML Engineer - Speech (m/f/d)
Senior ML Engineer - Speech (m/f/d)

Customer Onboarding Team Lead (m/f/d) @ voize • Köln

Hybrid
EUR 65,000 - 110,000
Stock options
30 vacation days
Germany Transport Ticket
+4
Senior ML Engineer - Speech (m/f/d)
Senior ML Engineer - Speech (m/f/d)

Voize • München

Hybrid
EUR 90,000 - 130,000
30 vacation days
Germany Transport Ticket
Urban Sports Club
+5
Senior ML Engineer - Speech (m/f/d)
Senior ML Engineer - Speech (m/f/d)

Voize • Köln

Hybrid
EUR 75,000 - 115,000
Stock options
30 vacation days + birthday off
Germany Transport Ticket
+2
Senior ML Engineer - Speech (m/f/d)
Senior ML Engineer - Speech (m/f/d)

Voize • Hamburg

Remote
EUR 90,000 - 120,000
Stock options
30 vacation days
Germany Transport Ticket
+6
GTM Engineering Associate (m/f/d) | GovTech with Real Impact
GTM Engineering Associate (m/f/d) | GovTech with Real Impact

Zaitgeist Innovation Group GmbH • Berlin

On-site
EUR 17,000 - 30,000
Office in Berlin Mitte near Rosenthale
Flexible part-time hours around study