Senior SRE: AI Inference Platform Reliability

Jobgether; Netherlands; On-site; EUR 120,000 - 180,000; Full time

Benefits offered by this job

Competitive compensation

Learning opportunities

Ownership in work

International team

Job summary

Token Factory seeks a Senior Site Reliability Engineer to own the reliability, performance, and observability of a large-scale AI inference platform in the Netherlands. You will design telemetry pipelines, optimize GPU workloads, and implement self-healing, scalable infrastructure with Kubernetes and IaC tooling.

Collaboration with software and infra teams is essential in a fast-moving, international environment.

Qualifications

• Significant experience in Site Reliability Engineering or Production Engineering.
• ],
• job_responsibilities_description":[ ],
• CoT_job_summary_short
• job_summary_short
• contract_type
• location_type
• remote_scope
• perks
• stated_min
• stated_max
• stated_absolute
• salary_estimation_cot
• estimated_low
• estimated_medium
• estimated_high
• currency
• frequency
• bonus
• tax
• application_email
• job_end_date
• contact_person
• hiring_department_name

Responsibilities

• Own the reliability, performance, and observability of the inference platform and its supporting infrastructure.
• Design, implement, and continuously improve telemetry pipelines covering metrics, logs, and traces.
• Build monitoring and observability solutions capable of processing large volumes of production signals and converting them into actionable insights.
• Configure and optimize Kubernetes infrastructure for high availability, scalability, and efficient resource utilization.
• Tune Kubernetes autoscaling mechanisms to improve the efficiency and utilization of GPU resources.
• Develop and maintain Terraform modules and infrastructure-as-code patterns that embed resilience and reliability into new clusters and services.
• Design and improve request-routing, retry, and failure-handling mechanisms to minimize the impact of transient infrastructure or service failures.
• Develop automation and operational tooling to detect, isolate, and remediate incidents quickly.
• Create, maintain, and improve runbooks for incident response and operational procedures.
• Participate in production incident management, troubleshooting issues and restoring services within demanding reliability objectives.
• Lead or contribute to post-mortem processes and implement corrective actions to prevent recurring incidents.
• Define and improve reliability practices for high-throughput APIs, including alerting strategies and Service Level Objectives (SLOs).
• Investigate distributed-system failures and performance issues across infrastructure and application layers.
• Optimize systems from the kernel and infrastructure layer through to the application layer.
• Support and improve the operation of GPU-intensive inference workloads and accelerator-based infrastructure.
• Contribute to scaling the inference platform while balancing performance, reliability, and infrastructure costs.
• Collaborate closely with software engineers to incorporate reliability into platform development.
• Promote automation, self-healing capabilities, and engineering practices that reduce operational overhead.

Job description

Token Factory seeks a Senior Site Reliability Engineer to own the reliability, performance, and observability of a large-scale AI inference platform in the Netherlands. You will design telemetry pipelines, optimize GPU workloads, and implement self-healing, scalable infrastructure with Kubernetes and IaC tooling.

Collaboration with software and infra teams is essential in a fast-moving, international environment.