AI Infra TPM: Scale, Availability & Ops Leadership

Greenhouse Software, Inc.; New York, Northern (NY, KY); Hybrid; USD 150,000 - 230,000; Full time

Job summary

Nscale is seeking a Principal Technical Program Manager (TPM) for AI Infrastructure Operations to lead large-scale programs across data-center scale GPU fleets, InfiniBand networks, and related toolchains. You will align engineering execution with business goals and own critical performance metrics such as uptime and availability.

This role requires deep technical fluency in data center infrastructure, Linux, and networking, plus proven program management discipline (Agile/Scrum; PMP preferred).

Qualifications

• 5+ years of experience in a Technical Program Management role driving large-scale infrastructure or software programs.
• Strong foundation in data center infrastructure, distributed systems, Linux, and networking concepts.
• Proven program management rigor with Agile, Scrum, PMP preferred; excellent communication and presentation skills.
• Metrics-driven mindset with experience defining and improving system performance against KPIs (uptime, availability, MTTR).
• Ability to execute in ambiguity and lead cross-functional teams through complex programs.

Responsibilities

• Own planning, execution, and delivery of strategic operational programs for AI infrastructure.
• Establish and track KPIs, dashboards, and reporting on availability, uptime, and health.
• Standardize incident, change, and postmortem processes to reduce toil and MTTR.
• Coordinate across hardware, compute, network, and data-center teams; manage vendor dependencies.
• Translate capacity plans into actionable delivery roadmaps; ensure hardware integration meets go-live criteria.
• Identify risks and communicate impacts to stakeholders across the organization.

Skills

Agile methodologies

Scrum

PMP

Linux

Networking concepts

Data center infra

Education

Bachelor's or Master's in CS/Engineering

Job description

Nscale is seeking a Principal Technical Program Manager (TPM) for AI Infrastructure Operations to lead large-scale programs across data-center scale GPU fleets, InfiniBand networks, and related toolchains. You will align engineering execution with business goals and own critical performance metrics such as uptime and availability.

This role requires deep technical fluency in data center infrastructure, Linux, and networking, plus proven program management discipline (Agile/Scrum; PMP preferred).