Engineering Manager, Production Platform and Orchestration

Jobgether SRL; United States; Remote; USD 200,000 - 300,000; Full time

Benefits offered by this job

Remote-first culture

Equity participation

Medical/dental/vision insurance

Job summary

Jobgether SRL seeks an Engineering Manager, Production Platform and Orchestration to lead a distributed team building the AI inference production foundation. You will shape provisioning, deployment, health, upgrades, and control-plane capabilities for a heterogeneous accelerator fleet.

You will drive reliability, automation, and scalable operating practices across software, hardware, and data center teams, ensuring service readiness and customer impact awareness.

Qualifications

• Experience managing engineering teams in distributed systems, cloud infrastructure, or production platforms.
• Strong judgment across Linux systems, networking, orchestration, deployment, observability, and reliability.
• Proven ability to turn ambiguous operational challenges into clear roadmaps and ownership models.
• Experience recruiting, coaching, and retaining engineers while maintaining high technical standards.
• Ability to operate across software, hardware, data center, and business boundaries.
• Excellent written and verbal communication for technical and executive stakeholders.
• Hands-on leadership with architectural involvement and production discussions.
• Experience operating services with on-call, incident management, and reliability planning.
• Experience with control planes, schedulers, placement systems, and multi-rack orchestration.
• Experience with accelerator fleets in production is strongly preferred.
• Background in data center deployment, firmware coordination, and sparing/RMA processes.

Responsibilities

• Lead, coach, and grow a distributed engineering team focused on production platforms and fleet orchestration.
• Define ownership boundaries and recruit to scale with infrastructure footprint.
• Translate business priorities into a coherent engineering roadmap while shielding from reactive demands.
• Define strategy for provisioning, deployment, environment lifecycle, and production control-plane capabilities.
• Build reliable orchestration systems across a heterogeneous accelerator environment.
• Establish SLAs, metrics, alerts, and on-call practices for production systems.
• Own incident management cadence, postmortems, and reliability reviews.
• Drive automation across deployment, upgrades, diagnostics, and capacity planning.
• Collaborate with hardware, data center, and model/serving teams to turn platform capabilities into serviceable production lines.
• Monitor fleet health and incidents to guide platform investments.
• Establish scalable operating practices and specialized ownership as the team grows.

Skills

Distributed systems

Cloud infrastructure

Production platforms

SRE

Technical leadership

Linux systems

Networking

Observability

Automation

Capacity management

Tools

Kubernetes

Container orchestration

Automation tooling

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Engineering Manager, Production Platform and Orchestration based in the United States.

This is a high-impact technical leadership role responsible for building the production foundation behind a rapidly scaling AI inference platform. You will lead the engineering organization responsible for provisioning, deploying, observing, upgrading, and reliably operating production systems. The role combines people leadership, systems architecture, operational excellence, and strategic roadmap ownership. You will shape the orchestration, reliability, automation, and control-plane capabilities required to support a growing and increasingly heterogeneous accelerator fleet. Working across software, hardware, data center, serving, model, and customer-facing teams, you will turn complex operational needs into durable engineering solutions. You will also establish clear ownership, measurable reliability standards, and scalable operating practices that reduce manual effort as the fleet expands. This is an opportunity to influence both the technology and organizational foundations of a next-generation AI infrastructure environment.

• Lead, coach, and grow a distributed engineering team focused on production platforms, fleet orchestration, reliability, and operational automation.
• Establish clear ownership boundaries, develop emerging technical leaders, recruit effectively, and create an organization capable of scaling with the infrastructure footprint.
• Translate customer and business priorities into a coherent engineering roadmap while protecting the team from reactive or unstructured operational demands.
• Define the technical strategy for provisioning, deployment, environment lifecycle, fleet health, capacity, upgrades, rollback, and production control-plane capabilities.
• Build reliable orchestration systems covering inventory, placement, configuration, health management, and multi-system operations across a heterogeneous accelerator environment.
• Establish service-level objectives, operational metrics, alerting standards, and sustainable on-call practices for customer-facing production systems.
• Own the operating cadence for incidents, escalations, postmortems, corrective actions, launch readiness, and reliability reviews.
• Drive automation across deployment, upgrades, remediation, diagnostics, capacity planning, and common support workflows to prevent fleet growth from creating proportional operational overhead.
• Partner with hardware and data center teams on rack bring-up, networking, firmware, sparing, failure handling, and infrastructure transitions.
• Collaborate with serving/API, model enablement, and compiler/runtime teams to turn new platform capabilities into reliable, supportable production services.
• Monitor fleet health, incident patterns, deployment reliability, operational toil, and critical failure points, using these insights to prioritize platform investments.
• Establish durable operating practices and specialized ownership as the production organization grows across fleet orchestration, deployment lifecycle, observability, data center operations, and operational tooling.

Requirements

• Demonstrated success managing and growing engineering teams responsible for distributed systems, cloud infrastructure, production platforms, SRE, or closely related technical domains.
• Strong technical judgment across Linux systems, networking, orchestration, deployment systems, observability, and production reliability.
• Proven ability to turn ambiguous operational challenges into clear roadmaps, explicit ownership models, and measurable engineering outcomes.
• Experience recruiting, coaching, developing, and retaining engineers across experience levels while maintaining a high technical bar.
• Ability to operate effectively across software, hardware, data center, customer, and business boundaries.
• Excellent written and verbal communication skills, including the ability to make technical tradeoffs, priorities, risks, and decisions clear to both technical and executive stakeholders.
• Hands-on leadership style with sufficient technical and operational depth to engage in architecture and production discussions without becoming a bottleneck.
• Experience operating services with meaningful availability expectations, including on-call programs, incident management, root-cause analysis, and reliability planning.
• Experience with control planes, schedulers, placement systems, capacity-management systems, or multi-rack orchestration is highly valuable.
• Experience working with GPU, FPGA, ASIC, or other accelerator fleets in production is strongly preferred.
• Background in data center deployment, hardware lifecycle management, firmware coordination, sparing/RMA processes, or production networking is advantageous.
• Demonstrated ability to scale infrastructure from early deployments to multiple sites or hundreds of systems.
• Experience with customer-facing infrastructure where engineering teams participate in production escalation and service readiness.
• Proven automation experience that has materially reduced operational toil, incident frequency, recovery time, or manual intervention.
• Ability to develop a sustainable production organization with clear specialties, healthy management spans, and scalable operational coverage.

Benefits

• Base salary range of $200,000–$300,000, with flexibility based on experience, specialized expertise, qualifications, internal equity, and expected impact.
• Competitive equity as part of the overall compensation package.
• Fully company-paid medical, dental, and vision insurance for employees and dependents.
• Company-paid life and disability insurance, with additional voluntary coverage options.
• Supplemental hospital, critical illness, and accident insurance options.
• Unlimited paid time off designed to support meaningful rest and flexibility.
• 13 paid company holidays.
• Remote-first work culture with a company-provided computer and home-office setup.
• 401(k) plan with company matching, eligible from day one.
• Opportunity to shape both the technology and organizational foundations of a rapidly growing AI infrastructure environment.
• Visa transfer support for eligible H-1B candidates; new visa sponsorship is not available for this role.
• Position is remote within the United States and requires current authorization to work in the U.S.