Engineering Manager: AI Production Platform & Fleet Orchestration

Jobgether SRL; United States; Remote; USD 200,000 - 300,000; Full time

Benefits offered by this job

Remote-first culture

Equity participation

Medical/dental/vision insurance

Job summary

Jobgether SRL seeks an Engineering Manager, Production Platform and Orchestration to lead a distributed team building the AI inference production foundation. You will shape provisioning, deployment, health, upgrades, and control-plane capabilities for a heterogeneous accelerator fleet.

You will drive reliability, automation, and scalable operating practices across software, hardware, and data center teams, ensuring service readiness and customer impact awareness.

Qualifications

• Experience managing engineering teams in distributed systems, cloud infrastructure, or production platforms.
• Strong judgment across Linux systems, networking, orchestration, deployment, observability, and reliability.
• Proven ability to turn ambiguous operational challenges into clear roadmaps and ownership models.
• Experience recruiting, coaching, and retaining engineers while maintaining high technical standards.
• Ability to operate across software, hardware, data center, and business boundaries.
• Excellent written and verbal communication for technical and executive stakeholders.
• Hands-on leadership with architectural involvement and production discussions.
• Experience operating services with on-call, incident management, and reliability planning.
• Experience with control planes, schedulers, placement systems, and multi-rack orchestration.
• Experience with accelerator fleets in production is strongly preferred.
• Background in data center deployment, firmware coordination, and sparing/RMA processes.

Responsibilities

• Lead, coach, and grow a distributed engineering team focused on production platforms and fleet orchestration.
• Define ownership boundaries and recruit to scale with infrastructure footprint.
• Translate business priorities into a coherent engineering roadmap while shielding from reactive demands.
• Define strategy for provisioning, deployment, environment lifecycle, and production control-plane capabilities.
• Build reliable orchestration systems across a heterogeneous accelerator environment.
• Establish SLAs, metrics, alerts, and on-call practices for production systems.
• Own incident management cadence, postmortems, and reliability reviews.
• Drive automation across deployment, upgrades, diagnostics, and capacity planning.
• Collaborate with hardware, data center, and model/serving teams to turn platform capabilities into serviceable production lines.
• Monitor fleet health and incidents to guide platform investments.
• Establish scalable operating practices and specialized ownership as the team grows.

Skills

Distributed systems

Cloud infrastructure

Production platforms

SRE

Technical leadership

Linux systems

Networking

Observability

Automation

Capacity management

Tools

Kubernetes

Container orchestration

Automation tooling

Job description

Jobgether SRL seeks an Engineering Manager, Production Platform and Orchestration to lead a distributed team building the AI inference production foundation. You will shape provisioning, deployment, health, upgrades, and control-plane capabilities for a heterogeneous accelerator fleet.

You will drive reliability, automation, and scalable operating practices across software, hardware, and data center teams, ensuring service readiness and customer impact awareness.