Datacenter Operations Manager

Larsen & Toubro Limited

Concord (CA)

On-site

USD 120,000 - 150,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical insurance
Vision insurance
401(k)

Job summary

A leading engineering firm is seeking an experienced AI Data Center Operations Manager to lead operations for their AI data center in California. This role requires managing critical infrastructure like power, cooling, and network systems while ensuring the performance of NVIDIA GPU clusters. Candidates should have 7+ years of experience in data center operations, with expertise in HVAC and mechanical systems. Benefits include medical insurance and a 401(k). This is a full-time position with a mid-senior level seniority.

Qualifications

  • 7+ years of experience in data center operations, with 3+ years managing AI or HPC environments.
  • Hands-on experience with GPU clusters (NVIDIA B300 preferred) and Dell PowerEdge hardware.
  • Strong knowledge of networking, telco systems, and high-availability architectures.

Responsibilities

  • Oversee daily operations of power systems, mechanical/electrical infrastructure, and HVAC.
  • Ensure continuous uptime and operational efficiency for AI compute clusters.
  • Coordinate hardware upgrades and troubleshooting with engineering teams.

Skills

Leadership
Communication
Vendor management
HVAC knowledge
Leadership skills
Vendor management

Education

Bachelor's degree in electrical engineering, Mechanical Engineering, or Computer Science
Master's degree preferred

Tools

NVIDIA B300 GPU
Dell PowerEdge hardware
Kubernetes
Slurm

Job description

AI Data Center Operations Manager

We are seeking an experienced AI Data Center Operations Manager to lead operations for a cutting-edge AI data center. This role involves managing all critical infrastructure systems—including power, mechanical, electrical, cooling, HVAC, liquid cooling, network, telco, chillers, water treatment plant, and generators—while ensuring optimal performance of NVIDIA B300 GPU clusters on Dell PowerEdge hardware. The position requires strong collaboration with vendors and internal teams to maintain high availability, security, and compliance.

Key Responsibilities
Infrastructure Operations
  • Oversee daily operations of power systems, mechanical/electrical infrastructure, HVAC, liquid cooling, chillers, water treatment plant, and backup generators.
  • Ensure continuous uptime and operational efficiency for AI compute clusters.
AI Hardware & Compute Management
  • Coordinate hardware upgrades and troubleshooting with engineering teams.
  • Act as primary liaison with vendors including Servers, HVAC providers, electrical contractors, and other critical service partners.
  • Negotiate and manage service agreements, maintenance schedules, and procurement.
Network & Telco
  • Maintain robust connectivity and manage network infrastructure supporting AI workloads.
  • Work with telecom providers to ensure redundancy and high availability.
Physical Security & Compliance
  • Partner with the physical security team to enforce access control, surveillance, and compliance with security protocols.
  • Ensure adherence to industry standards and environmental regulations.
  • Implement advanced monitoring systems for power, cooling, and compute resources.
  • Lead incident response and root cause analysis for outages or failures.
Qualifications
  • Bachelor’s degree in electrical engineering, Mechanical Engineering, Computer Science, or related field (master’s preferred).
  • 7+ years of experience in data center operations, with 3+ years managing AI or HPC environments.
  • Expertise in power systems, HVAC, liquid cooling, and mechanical/electrical infrastructure.
  • Hands‑on experience with GPU clusters (NVIDIA B300 preferred) and Dell PowerEdge hardware.
  • Strong knowledge of networking, telco systems, and high‑availability architectures.
  • Excellent leadership, communication, and vendor management skills.
Preferred Skills
  • Familiarity with AI workload orchestration tools (Kubernetes, Slurm).
  • Certifications: CDCP/CDCS, ITIL, or Data Center Management.
  • Experience with environmental sustainability practices in data centers.
Benefits
  • Medical insurance
  • Vision insurance
  • 401(k)
Seniority level
  • Mid-Senior level
Employment type
  • Full-time
Job function
  • Other
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Data Center Ops Leader
AI Data Center Ops Leader

Larsen & Toubro Limited • Concord (CA)

On-site
USD 120,000 - 150,000
Medical insurance
Vision insurance
401(k)
Data Center Operations Manager - Systems Integrator
Data Center Operations Manager - Systems Integrator

Hamilton Barnes • Texas

On-site
USD 180,000 - 220,000
Health insurance
Retirement plan with company match
Paid time off & holidays
+2
NMC_000421 - Sr. Data Center Expert - AI Data Centers & Liquid Cooling
NMC_000421 - Sr. Data Center Expert - AI Data Centers & Liquid Cooling

New Millenium Consulting • New Jersey

On-site
USD 140,000 - 210,000
Senior Solutions Architect, Data Center Infrastructure, Senior Solutions Architect, Data Center[...]
Senior Solutions Architect, Data Center Infrastructure, Senior Solutions Architect, Data Center[...]

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 287,500
Equity
Comprehensive benefits package
Datacenter Site Manager, Ops
Datacenter Site Manager, Ops

Blue Signal LLC. • Houston (TX)

On-site
USD 120,000 - 180,000
Competitive base salary
Comprehensive benefits package
Generous PTO policy
Director of Facilities Engineering- Data Centers
Director of Facilities Engineering- Data Centers

EZ Blockchain • Chicago (IL)

On-site
USD 210,000 - 320,000
Health insurance
PTO
Sick leave
+4
Engineering Manager, AI Clusters
Engineering Manager, AI Clusters

Lenovo Inc. • North Carolina

On-site
USD 180,000 - 240,000
Senior Solutions Architect, AI Compute – NPN
Senior Solutions Architect, AI Compute – NPN

NVIDIA Corporation • New Jersey

On-site
USD 184,000 - 357,000
Equity
Benefits
Data Center Mechanical Engineer
Data Center Mechanical Engineer

GTN Technical Staffing • Fort Worth (TX), Arlington (TX), Dallas (TX)

On-site
USD 200,000 - 350,000
Medical insurance
Vision insurance
401(k)
+4
Senior Solutions Architect, AI Compute – NPN
Senior Solutions Architect, AI Compute – NPN

NVIDIA Corporation • Washington

On-site
USD 184,000 - 357,000
Equity and Benefits