AI Engineer, AI Platform

Volta Software; Lombardia; Hybrid; EUR 90,000 - 130,000; Full time

Job summary

Volta Software seeks a backend engineer transitioning to AI systems to scale production-grade, multi-tenant pipelines. You will design tenant configurations and thresholds, ensuring per-customer data separation and observability across the stack.

You will optimize LLM orchestration, implement fault-tolerant queues, and drive cost-aware, secure deployments with robust testing and gradual rollout.

Qualifications

• Strong Python (FastAPI or similar), with typing and tests.
• Production LLM orchestration involving retries, tool calls and versioned prompts.
• Containerised services deployed on Cloud Run, GKE, EKS or ECS.
• Observability through tracing and metrics (Langfuse, OpenTelemetry).
• CI/CD and automated testing for non-deterministic systems.
• Fluent English; nice-to-have French or Italian.

Responsibilities

• Design the tenant configuration model (prompts, schemas, rules, feature switches).
• Implement true multi-tenancy with per-tenant data separation across services, storage, caches and traces.
• Scale the pipeline with Cloud Run components and robust queuing and retries.
• Instrument services for traceability and cost visibility across tenants.
• Control costs with per-tenant dashboards, caching, and batching of LLM workloads.
• Ensure security via guardrails, least-privilege access and CI/CD gated rollout.

Skills

Python

FastAPI

LLM orchestration

Typing

Testing

CI/CD

Containers

Cloud Run

Kubernetes

Observability

Distributed systems

Education

Bachelor's in CS

Tools

Docker

Langfuse

OpenTelemetry

CI/CD tooling

GKE

EKS

Cloud Run

Vertex AI

Job description

You’ll make Volta’s AI pipeline production-grade at enterprise scale: multi-tenant, observable, cost-efficient and configurable per customer without code changes. You’ll take parsing, matching and LLM orchestration services that already work and make them work for fifteen enterprise customers at once. You report to the Head of AI.

• Turn the Core into configuration: design the tenant configuration model (prompts, schemas, matching rules, thresholds, feature switches) so onboarding a new enterprise customer is configuration plus evaluation, not a code change

• Make multi-tenancy real: per-tenant data separation across services, storage, caches, knowledge bases and traces

• Scale the pipeline: Cloud Run services for ingestion, API, parsing and matching that absorb bursts of orders and large documents, with queues, idempotency and retries that don’t re-run the whole pipeline

• Make it observable: every LLM call traced and costed in Langfuse, trace IDs carried onto orders, alerts on stuck orders and quality regressions

• Keep cost per order under control: model choice per step, caching, batching, cost dashboards per customer

• Ship safely: replay and regression tests in CI for prompts and schemas, versioned prompts and configs, gradual rollout per tenant

• Make accuracy a release gate: plug per-customer evaluation harnesses into the delivery pipeline, with the data scientists

• Make it secure: treat prompts, model outputs, tools and data flows as untrusted attack surface, and enforce it with automated guardrails, least-privilege access and continuous red-teaming in CI/CD

Backend engineer who moved into AI systems: 4+ years building production backend services in Python, at least one or two on LLM-powered systems in production Distributed systems done right: queues, async processing, idempotency, retries, back-pressure, concurrency on shared databases Multi-tenant SaaS: you’ve designed or operated a system serving many customers with real isolation requirements Observability first: you’ve instrumented services with tracing and metrics and used them to debug production Config over code: you’ve built systems driven by versioned configuration, feature flags or rules, and kept them understandable Must have: strong Python (FastAPI or similar), typing, tests; production LLM orchestration (structured outputs, tool calling, retries and fallbacks, prompt versioning); containerised services on Cloud Run, GKE, EKS or ECS; tracing and LLM observability (Langfuse, OpenTelemetry or similar); CI/CD and automated testing of non-deterministic systems; fluent English Nice to have: GCP (Cloud Run, Vertex AI, Pub/Sub, IAM); Elasticsearch or hybrid search; agent frameworks; cost optimisation of LLM workloads; GDPR and data residency in practice; French or Italian Location: Paris or Milan, hybrid, 3 office days a week

At Volta, we believe diversity makes our teams stronger.

We welcome all applications, regardless of gender, background, or experience.