Senior GPU Infra Engineer - Remote, Scale & Reliability

Sharon AI, Inc; United Arab Emirates; On-site; AED 420,000 - 660,000; Full time

Benefits offered by this job

Remote-first across EMEA

Hands-on with GPU infrastructure

Impact on platform reliability

Job summary

Sharon AI, Inc. is seeking an experienced Senior Infrastructure Engineer to build, operate and improve a large-scale GPU‑based platform across multi‑tenant environments.

You will lead on Kubernetes, HPC schedulers, and Terraform/Ansible automation while partnering with ML and platform teams to optimize performance, reliability and cost.

This remote-first role spans across EMEA and offers the chance to shape production-grade infrastructure for AI workloads and future GPU services.

Qualifications

• 6+ years in infrastructure engineering, platform engineering or SRE roles.
• Deep expertise across cloud and/or bare-metal environments.
• Hands-on with Kubernetes and container orchestration.
• Experience with GPU-based systems and workloads.
• Proficient in Terraform, Ansible, and similar IaC tools.
• Programming/scripting in Python, Go, or Bash.

Responsibilities

• Build and operate large-scale multi-tenant infrastructure for GPUaaS.
• Manage HPC clusters and GPU-optimised infrastructure.
• Develop Infrastructure-as-Code with Terraform/Ansible.
• Automate provisioning, scaling and configuration.
• Improve GPU utilisation, scheduling and cost efficiency.
• Enhance observability with monitoring, logging, and alerts.
• Ensure high availability, fault tolerance and DR capabilities.
• Maintain security controls and workload isolation.
• Collaborate with ML/platform teams to optimise performance.
• Provide L3 support during standard working hours in EMEA.

Skills

Kubernetes

SRE

Cloud & Bare-metal

Python/Go/Bash

Security

Observability

Cost Optimization

Networking

Leadership

CI/CD

Distributed Systems

Education

Bachelor's degree in CS/Engineering

Tools

Terraform

Ansible

Slurm

GPU management tooling

Job description

Sharon AI, Inc. is seeking an experienced Senior Infrastructure Engineer to build, operate and improve a large-scale GPU‑based platform across multi‑tenant environments.

You will lead on Kubernetes, HPC schedulers, and Terraform/Ansible automation while partnering with ML and platform teams to optimize performance, reliability and cost.

This remote-first role spans across EMEA and offers the chance to shape production-grade infrastructure for AI workloads and future GPU services.