AI Engineer, AI Platform

Volta Software; Paris; Híbrido; EUR 90 000 - 130 000; Tempo integral

Resumo da oferta

Volta Software is seeking a Backend Engineer who has migrated into AI systems to productionize a multi-tenant AI pipeline in Paris. You will build scalable Python services and LLM orchestration, ensuring per-customer data isolation across distributed components.

You’ll focus on configurability, observability, and cost control with robust CI/CD, testing, and security guardrails. Hybrid work with three office days weekly in Paris.

Qualificações

• 4+ years building production backend services in Python.
• Experience with LLM-powered systems and orchestration.
• Strong emphasis on multi-tenant SaaS and data isolation.
• Instrumented services with tracing/metrics and used them to debug production.
• Fluent English; French a plus.

Responsabilidades

• Turn the Core into configuration: tenant config models, prompts, schemas and feature switches.
• Scale and observe the pipeline with Cloud Run, queues, idempotency and retries.
• Make it observable: tracing, cost accounting, Langfuse, and alerting.
• Keep costs under control: caching, batching, and per-customer dashboards.
• Ship safely: CI/CD, tests for prompts/schemas, versioned configs, gradual rollout.
• Ensure security: guardrails and least-privilege in data flows and prompts.

Ferramentas

Cloud Run

GKE

EKS

ECS

Langfuse

OpenTelemetry

CI/CD

Python

FastAPI

LLM orchestration

Multi-tenant SaaS

Descrição da oferta de emprego

You’ll make Volta’s AI pipeline production-grade at enterprise scale: multi-tenant, observable, cost-efficient and configurable per customer without code changes. You’ll take parsing, matching and LLM orchestration services that already work and make them work for fifteen enterprise customers at once. You report to the Head of AI.

• Turn the Core into configuration: design the tenant configuration model (prompts, schemas, matching rules, thresholds, feature switches) so onboarding a new enterprise customer is configuration plus evaluation, not a code change

• Make multi-tenancy real: per-tenant data separation across services, storage, caches, knowledge bases and traces

• Scale the pipeline: Cloud Run services for ingestion, API, parsing and matching that absorb bursts of orders and large documents, with queues, idempotency and retries that don’t re-run the whole pipeline

• Make it observable: every LLM call traced and costed in Langfuse, trace IDs carried onto orders, alerts on stuck orders and quality regressions

• Keep cost per order under control: model choice per step, caching, batching, cost dashboards per customer

• Ship safely: replay and regression tests in CI for prompts and schemas, versioned prompts and configs, gradual rollout per tenant

• Make accuracy a release gate: plug per-customer evaluation harnesses into the delivery pipeline, with the data scientists

• Make it secure: treat prompts, model outputs, tools and data flows as untrusted attack surface, and enforce it with automated guardrails, least-privilege access and continuous red-teaming in CI/CD

Backend engineer who moved into AI systems: 4+ years building production backend services in Python, at least one or two on LLM-powered systems in production Distributed systems done right: queues, async processing, idempotency, retries, back-pressure, concurrency on shared databases Multi-tenant SaaS: you’ve designed or operated a system serving many customers with real isolation requirements Observability first: you’ve instrumented services with tracing and metrics and used them to debug production Config over code: you’ve built systems driven by versioned configuration, feature flags or rules, and kept them understandable Must have: strong Python (FastAPI or similar), typing, tests; production LLM orchestration (structured outputs, tool calling, retries and fallbacks, prompt versioning); containerised services on Cloud Run, GKE, EKS or ECS; tracing and LLM observability (Langfuse, OpenTelemetry or similar); CI/CD and automated testing of non-deterministic systems; fluent English Nice to have: GCP (Cloud Run, Vertex AI, Pub/Sub, IAM); Elasticsearch or hybrid search; agent frameworks; cost optimisation of LLM workloads; GDPR and data residency in practice; French or Italian Location: Paris or Milan, hybrid, 3 office days a week