Director, Data Center Operations

Together

San Francisco (CA)

On-site

USD 250,000 - 300,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Together is seeking a Director of Data Center Operations to own the operational foundation of its growing data center portfolio across the US and Asia. This builder role covers white space design, fit-out, power and cooling infrastructure, and the creation of a break-fix/smart hands team with a scalable operating model.

You'll manage multiple sites and work with vendors to ensure on-time, high-quality deployments, eventually traveling to Asia to oversee regional deployments.

Qualifications

  • Hands-on experience designing and commissioning data center infrastructure.
  • Experience scaling data center infrastructure at scale.
  • Proven people leadership of technical operations teams.
  • Ability to stand up teams and functions from scratch.
  • Strong vendor and contractor management skills.
  • Nice to have GPU/AI infra, multi-region portfolio, or Asia market familiarity.

Responsibilities

  • Own the design, fit-out, and commissioning of white space sites across the US and Asia, with a focus on PDUs, CDUs, and IT-adjacent infrastructure.
  • Build and lead a ~20-person break-fix and smart hands team from scratch — define the operating model, hire the initial team, and establish processes and playbooks.
  • Manage a portfolio of 5+ sites across two regions in various deployment and live operation stages.
  • Partner with vendors, contractors, and equipment suppliers to drive deployments to schedule and quality.
  • Establish operational standards, runbooks, and escalation processes for a nascent but growing infrastructure function.
  • Serve as the technical authority on data center infrastructure decisions from evaluation to live operation.
  • Travel to Asia periodically to oversee regional site deployments and support the local team.

Skills

Data Center Operations
Team Leadership
Vendor Management
Power & Cooling
Playbook Development
GPU/AI Infra

Job description

Together AI is scaling its physical AI infrastructure rapidly — and we're looking for a Director of Data Center Operations to help us build it right. This is a ground-floor opportunity to own the operational foundation of Together's growing data center portfolio across the US and Asia.

You'll be responsible for designing and commissioning white space deployments — taking pre-built environments and fitting them out with the power distribution, cooling distribution, and systems infrastructure needed to run high-density GPU workloads at scale. At the same time, you'll be building the break-fix and smart hands team from scratch: hiring, defining the playbook, and standing up the function that keeps our sites running around the clock.

This is not a steady-state operations role. It's a builder role. You'll be joining a small but fast-moving team, with real ownership over outcomes and the autonomy to shape how Together AI operates its physical infrastructure for years to come. If you've scaled data center infrastructure through hypergrowth before and want to do it again with more ownership — this is that opportunity.

Responsibilities
  • Own the design, fit-out, and commissioning of white space sites across the US and Asia, with a focus on power distribution (PDUs), cooling distribution (CDUs), and IT-adjacent infrastructure
  • Build and lead a ~20-person break-fix and smart hands team from scratch — define the operating model, hire the initial team, and establish the processes and playbooks that keep sites running
  • Manage a portfolio of 5+ sites across two regions in various stages of deployment and live operation
  • Partner with vendors, contractors, and equipment suppliers to drive site deployments to schedule and quality
  • Establish operational standards, runbooks, and escalation processes for a nascent but rapidly growing infrastructure function
  • Serve as the technical authority on data center infrastructure decisions — from white space evaluation through to live production operation
  • Travel to Asia periodically to oversee regional site deployments and support the local team
Requirements
  • Deep, hands-on technical knowledge of data center power and cooling systems at the IT-adjacent layer — PDUs, CDUs, power distribution, and white space fit-out
  • Proven experience designing and commissioning data center infrastructure, from evaluation through to live operation
  • Experience operating data center infrastructure at meaningful scale, supporting large production workloads
  • People leadership experience — you've hired, developed, and led technical operations teams
  • A builder's instinct — you're comfortable standing up teams and functions from scratch, writing the playbook where none exists, and operating with ambiguity
  • Strong vendor and contractor management skills — you know how to hold external partners accountable to timeline and quality
  • Nice to have: experience with GPU or AI infrastructure deployments, multi-site or multi-region portfolio management, or familiarity with Asian markets
About Together AI

Together AI is a research-driven AI infrastructure company on a mission to dramatically lower the cost of modern AI by co-designing software, hardware, algorithms, and models. We believe open and transparent AI systems create the best outcomes for society — and we're building the physical and computational foundation to make that real. Our team has been behind landmark advances including FlashAttention, Hyena, FlexGen, and RedPajama.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $250,000 - $300,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Director, Data Center Operations
Director, Data Center Operations

Together AI • San Francisco (CA)

On-site
USD 250,000 - 300,000
Competitive compensation
Startup equity
Health insurance
+1
Director, Data Center Operations
Director, Data Center Operations

Togetherai • San Francisco (CA)

On-site
USD 250,000 - 300,000
Competitive compensation
Startup equity
Health insurance
+1
Program Manager, Data Center Delivery
Program Manager, Data Center Delivery

SupportFinity™ • San Francisco (CA)

Hybrid
USD 170,000 - 210,000
Equity
Health insurance
Remote-friendly
Associate, Infrastructure Strategy & Operations
Associate, Infrastructure Strategy & Operations

Together AI • San Francisco (CA)

Remote
USD 140,000 - 170,000
Startup equity
Health insurance
Remote work flexibility
+1
Strategic Finance Senior Associate - Compute
Strategic Finance Senior Associate - Compute

Socket.dev • San Francisco (CA)

On-site
USD 138,000 - 175,000
Startup equity
Health insurance
Benefits
Infrastructure Design Engineer
Infrastructure Design Engineer

Together AI • San Francisco (CA)

On-site
USD 210,000 - 250,000
Health insurance
Startup equity
Flexible remote work
Strategic Finance Senior Associate - Compute
Strategic Finance Senior Associate - Compute

Together AI • San Francisco (CA)

On-site
USD 138,000 - 175,000
Health insurance
Equity
Competitive benefits
Data Center Operations Coordinator
Data Center Operations Coordinator

Together AI • San Francisco (CA)

On-site
USD 150,000 - 200,000
Health insurance
Startup equity
Competitive benefits
Data Center Operations Coordinator
Data Center Operations Coordinator

Togetherai • San Francisco (CA)

On-site
USD 150,000 - 200,000
Startup equity
Health insurance
Competitive benefits
Senior Software Engineer - Together Cloud Infrastructure
Senior Software Engineer - Together Cloud Infrastructure

Together AI • San Francisco (CA)

On-site
USD 160,000 - 230,000
Startup Equity
Health Insurance
Flexible Remote Work