Remote Senior AI Platform Engineer - Scalable LLM Infra

Truvio; Venlo; Hybrid; EUR 90,000 - 140,000; Full time

Job summary

Truvio is building a shared AI platform used across Dynamics 365 products to ship agents efficiently. You will own core platform services, evaluation tooling, and safety controls, enabling rapid, reliable AI features for customers.

You will collaborate with the Principal AI Engineer and product teams, shaping platform capabilities and ensuring production-grade observability and cost controls. This is a remote role within Europe for a senior IC who thrives on ownership and practical problem

Qualifications

• 6+ years of software engineering with at least 2 years building production systems on top of LLMs or ML models.
• Strong backend skills in Python and/or C#/.NET, plus solid API and distributed systems design.
• Hands-on cloud experience, ideally Azure (Azure OpenAI or AI Foundry, AKS or Container Apps, Functions, Key Vault).
• Practical experience with retrieval, embeddings, vector or graph stores, and agent or tool-calling patterns.
• A habit of measuring things: evals, SLOs, cost per request.
• Infrastructure as code and CI/CD (Bicep or Terraform, GitHub Actions or Azure DevOps).
• Clear written English and comfort working across time zones in a remote team.

Responsibilities

• Design and run the core platform services: LLM gateway and model routing, prompt and tool registries, retrieval over our context graph, and agent orchestration.
• Build evaluation and testing infrastructure so every AI feature has offline evals, regression suites and production quality signals before and after release.
• Make AI safe to run in customer ERP tenants: tenant isolation, data residency, PII handling, cost controls, audit trails and human-in-the-loop hooks for Trust & Control.
• Own observability for AI workloads: tracing, latency, token cost and quality dashboards per customer and per feature.
• Ship SDKs, templates and docs that let product teams build an agent in days, not months.
• Partner with the Principal AI Engineer and product teams to turn repeated needs into platform capabilities.
• Evaluate new models and frameworks with a bias toward what is proven in production.

Skills

Software engineering

Python

C#/.NET

Backend design

Cloud computing

Retrieval/embeddings

Infra as code

CI/CD

English communication

Distributed systems

Tools

Azure

AKS

Container Apps

Functions

Key Vault

Terraform

GitHub Actions

Azure DevOps

Job description

Truvio is building a shared AI platform used across Dynamics 365 products to ship agents efficiently. You will own core platform services, evaluation tooling, and safety controls, enabling rapid, reliable AI features for customers.

You will collaborate with the Principal AI Engineer and product teams, shaping platform capabilities and ensuring production-grade observability and cost controls. This is a remote role within Europe for a senior IC who thrives on ownership and practical problem