Junior Technical Program Manager — Infrastructure Operations

Togetherai; San Francisco (CA); Hybrid; USD 150,000 - 175,000; Full time

Benefits offered by this job

Competitive compensation

Startup equity

Health insurance

Other competitive benefits

Job summary

Togetherai is seeking a Junior TPM to manage the operational complexities of its demanding GPU fleet in San Francisco. This role involves owning the complete node lifecycle and driving cross-functional collaboration to resolve issues promptly.

The ideal candidate will demonstrate resilience, organizational skills, and a bias toward action in a fast-paced environment. This position offers a competitive salary range of $150,000 to $175,000, equity, and health benefits in a hybrid work model.

Qualifications

• Prior experience in a TPM role, managing end-to-end programs.
• Technical experience engaging with technical problems.
• Resilience in fast-paced, chaotic environments.

Responsibilities

• Own the end-to-end node lifecycle from failure through repair.
• Drive node remediation with urgency.
• Manage timelines for datacenter bring-ups.
• Identify GPU utilization loss and drive resolution.
• Build dashboards for operational efficiency.
• Improve workflows through process improvements.
• Develop relationships with datacenter providers.

Skills

Experience in TPM role

Technical background

Bias toward action

Resilience in fast-paced environments

Strong organizational skills

Ability to zoom out

Job description

About the Role

Together AI runs one of the most demanding GPU fleets in the industry. Keeping that fleet healthy - every node online, every GPU performing, every datacenter transition running on schedule - is operationally complex and genuinely high-stakes. We're looking for a Junior TPM to own that operational reality.

This is not a coordination or status-reporting role. You will own the end-to-end node lifecycle - from the moment a node goes down through repair, return, and re-integration - and you'll drive the cross-functional work to close every gap as fast as possible. You'll manage datacenter bring-ups, hunt down GPU utilization loss, and build the processes and dashboards that make our fleet operations more visible and accountable over time.

The environment moves fast and doesn't always come with a clear playbook. Much of what you'll work on is genuinely novel - you'll be figuring things out alongside engineers who are building at the frontier. If that sounds like an obstacle, this isn't the right role. If it sounds like the best possible way to learn, keep reading.

Responsibilities

• Own the end-to-end node lifecycle - from failure through repair, return, and re-integration — across provider ticketing, internal tooling, and the state machine that governs each stage
• Drive node remediation to resolution with urgency, eliminating gaps in ownership at every handoff
• Manage project timelines for new datacenter bring-ups, coordinating across internal teams and external providers to keep milestones on track
• Identify and diagnose GPU utilization loss across the fleet, working with engineering leads to drive resolution
• Build dashboards and tracking processes that make efficiency gaps visible and ensure they get closed
• Continuously improve operational workflows through process improvements and lightweight automation
• Develop and maintain relationships with external datacenter providers

Requirements

• Some prior experience in a TPM role - we're open to candidates who came into TPM from engineering, ops, or another technical function, but you should have done the work in practice: owning programs end-to-end, driving cross-functional resolution, managing external dependencies
• A technical background or demonstrated experience in a highly technical environment - you don't need to know GPUs on day one, but you need to be able to engage meaningfully with technical problems and earn credibility with infrastructure engineers
• A genuine bias toward action - you see a problem and start moving, even when the path forward isn't fully clear
• Resilience in a fast-paced, sometimes chaotic environment - you adapt quickly, stay effective under pressure, and don't wait for perfect conditions to make progress
• Strong organizational instincts - you can manage multiple workstreams, track dependencies, and keep things moving without losing the thread
• Ability to zoom out - you can be deep in the weeds on an operational problem while keeping the bigger picture in view

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $150,000 - $175,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge. This is a hybrid role based in the Bay Area.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy