Senior Platform Engineer: Self-Hosted AI (Multi-Cloud)

EG A/S; Warszawa; On-site; PLN 180,000 - 280,000; Full time

Job summary

EG is seeking a Senior Platform Engineer – Self-Hosted AI Platform to own and evolve the runtime of EG's centralized AI platform across hybrid and multi-cloud environments. You will design abstractions to unify access to LLM providers and self-hosted models, ensuring a seamless developer experience irrespective of workload location.

You will drive architecture decisions, establish engineering standards, and ensure operational excellence across the platform runtime, collaborating with Azure and

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related discipline.
• Strong experience building and operating distributed systems and platform services.
• Hands-on experience with containerisation and modern runtime environments (Docker, Kubernetes, or similar).
• Experience designing platform abstractions or internal developer platforms (IDPs).
• Familiar with AI/LLM ecosystems, including model serving, routing, or inference workflows.
• Strong understanding of APIs, service design, and multi-tenant systems.
• Experience with observability, monitoring, and production operations.
• Solid understanding of security and compliance in distributed environments.
• Experience supporting production systems with strong operational ownership.

Responsibilities

• Own the design, deployment, and operation of the self-hosted AI platform runtime.
• Build and maintain platform components, including LLM gateways and routing layers and model serving infrastructure.
• Design a unified interface for accessing AI capabilities across cloud providers and self-hosted environments.
• Develop and maintain containerised services and runtime environments using Docker and Kubernetes.
• Establish Infrastructure-as-Code and GitOps practices using Terraform, Helm, or similar tooling.
• Implement observability, monitoring, and tracing across platform components.
• Ensure platform security, including secrets management, access control, and data protection.
• Drive performance optimisation, scalability, and cost efficiency of AI workloads.
• Enable hybrid and multi-cloud interoperability across AWS, Azure, and self-hosted environments.
• Partner with SDK and application teams to ensure smooth integration and developer adoption.
• Lead incident response, production support, and operational excellence for platform services.
• Mentor engineers and contribute to shared platform standards across teams.

Skills

Distributed systems

Containerization

Platform abstractions

AI/LLM ecosystems

APIs & multi-tenant

Observability & monitoring

Security & compliance

Operational ownership

CS/Engineering degree

Education

CS/Engineering degree

Tools

Docker

Kubernetes

Terraform

GitOps

Job description

EG is seeking a Senior Platform Engineer – Self-Hosted AI Platform to own and evolve the runtime of EG's centralized AI platform across hybrid and multi-cloud environments. You will design abstractions to unify access to LLM providers and self-hosted models, ensuring a seamless developer experience irrespective of workload location.

You will drive architecture decisions, establish engineering standards, and ensure operational excellence across the platform runtime, collaborating with Azure and