Remote Senior AI Infra Engineer — Self-Hosted Cloud Routing

CloudCraft Labs LLC; Time; On-site; NOK 1,335,000 - 2,002,000; Full time

Job summary

CloudCraft Labs LLC is seeking a Senior AI Infrastructure Engineer to own the UniCraft routing layer and platform running across customer clouds. This remote, full-time role focuses on building scalable backend infrastructure and cost-aware tooling.

You will design high-throughput systems, optimize for latency and reliability, and work with Kubernetes, AWS/GCP/Azure, and Python to ship production-ready infrastructure. Experience with async and distributed systems is required.

Qualifications

• 5+ years building high-throughput backend or infrastructure systems in production.
• Strong Python and distributed-systems fundamentals; comfortable with async and streaming.
• Hands-on Kubernetes and cloud (AWS / GCP / Azure) experience.
• A bias for measuring before optimizing.

Responsibilities

• Design and own the UniCraft routing layer that selects the best model per request across 12+ providers.
• Build the semantic cache, automatic failover, and provider-arbitrage logic that keep cost and latency down.
• Make the stack run cleanly inside customer clouds — Kubernetes, GPU scheduling, autoscaling, and safe upgrades.
• Instrument everything around cost-per-resolved-task, not just raw latency.

Skills

Python

Distributed systems

Async programming

Performance optimization

Tools

Kubernetes

AWS

GCP

Azure

Monitoring tools

Job description

CloudCraft Labs LLC is seeking a Senior AI Infrastructure Engineer to own the UniCraft routing layer and platform running across customer clouds. This remote, full-time role focuses on building scalable backend infrastructure and cost-aware tooling.

You will design high-throughput systems, optimize for latency and reliability, and work with Kubernetes, AWS/GCP/Azure, and Python to ship production-ready infrastructure. Experience with async and distributed systems is required.