Senior Infrastructure Engineer

Groq; Palo Alto (CA); On-site; USD 132,000 - 280,000; Full time

Job summary

A cutting-edge company in AI is seeking a Senior Infrastructure Engineer to build and maintain custom cloud infrastructure. The role focuses on provisioning Kubernetes clusters and collaborating with data center operations, ideal for candidates with strong Linux and automation skills. Groq offers a competitive salary and a collaborative work environment.

Qualifications

• Experience with provisioning and deploying Kubernetes clusters.
• Familiarity with network fundamentals like DHCP and DNS.
• Ability to write scripts in Go, Python, or Bash.

Responsibilities

• Support the provisioning and deployment of Kubernetes clusters on bare metal servers.
• Build and maintain tooling for bare metal provisioning.
• Collaborate with data center operations to ensure hardware readiness.

Skills

Linux

Kubernetes

Automation

Networking

Infrastructure-as-Code

Tools

Terraform

Git

PXE/iPXE/HTTPBoot

Job description

Join to apply for the Senior Infrastructure Engineer role at Groq

Join to apply for the Senior Infrastructure Engineer role at Groq

Get AI-powered advice on this job and more exclusive features.

About Groq

Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud, giving businesses and developers the speed and scale they need. Headquartered in Silicon Valley, we are on a mission to make high performance AI compute more accessible and affordable. When real-time AI is within reach, anything is possible. Build fast.

Senior Infrastructure Engineer

Mission:

At Groq, we’re building a custom cloud from the ground up — one data center at a time. Our Infrastructure Platform team owns the systems that turn racks of bare metal into production-ready Kubernetes clusters powering the next generation of AI workloads.

About Groq

Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud, giving businesses and developers the speed and scale they need. Headquartered in Silicon Valley, we are on a mission to make high performance AI compute more accessible and affordable. When real-time AI is within reach, anything is possible. Build fast.

Senior Infrastructure Engineer

Mission:

At Groq, we’re building a custom cloud from the ground up — one data center at a time. Our Infrastructure Platform team owns the systems that turn racks of bare metal into production-ready Kubernetes clusters powering the next generation of AI workloads.

We’re looking for an Infrastructure Engineer to help us scale this effort. This is a hands-on role focused on provisioning, automation, and working closely with our data center and networking teams to bring new sites online. If you’re passionate about infrastructure, enjoy debugging things close to the metal, and want to grow your skills across Linux, Kubernetes, and distributed systems — we’d love to talk.

Responsibilities & opportunities in this role:

• Support the provisioning and deployment of Kubernetes clusters on bare metal servers.
• Help build and maintain tooling for bare metal provisioning — including DHCP, DNS, PXE/iPXE/HTTPBoot, and Talos Linux Machine Configuration.
• Write and maintain scripts and services (Go, Python, Bash) to automate deployment workflows across new and existing sites.
• Partner with data center operations and networking teams to ensure hardware is correctly configured, connected, and ready for use.
• Manage infrastructure configuration using tools like Git, Flux, and Terraform.
• Contribute to system documentation, runbooks, and tooling that makes our infrastructure reliable and repeatable.
  
  
  

Ideal candidates have/are:

• Experience with Linux / Kubernetes systems and comfort working in a terminal.
• Familiarity with infrastructure-as-code and Git-based workflows (e.g., Terraform, Flux, Kustomize).
• Ability to write and maintain basic tooling in Go, Python, or Bash.
• Understanding of networking fundamentals (IPAM, VLANs, DHCP, DNS).
• Working knowledge of storage concepts (block vs object, NFS, RAID, etc.).
• Strong sense of ownership and a willingness to dive into hardware, firmware, or low-level provisioning issues.
  
  
  

Nice to Have

• Experience provisioning physical machines in a data center environment.
• Exposure to Talos Linux, Kubernetes bootstrapping, or Kubernetes platform engineering.
• Previous collaboration with facilities, hardware, or network teams in an operational role.
  
  
  

Attributes of a Groqster:

• Humility - Egos are checked at the door
• Collaborative & Team Savvy - We make up the smartest person in the room, together
• Growth & Giver Mindset - Learn it all versus know it all, we share knowledge generously
• Curious & Innovative - Take a creative approach to projects, problems, and design
• Passion, Grit, & Boldness - no limit thinking, fueling informed risk taking
  
  
  

If this sounds like you, we’d love to hear from you!

Compensation: At Groq, a competitive base salary is part of our comprehensive compensation package, which includes equity and benefits. For this role, the base salary range is $132,100 to $279,800, determined by your skills, qualifications, experience and internal benchmarks.

Location: Some roles may require being located near or on our primary sites, as indicated in the job description.

At Groq: Our goal is to hire and promote an exceptional workforce as diverse as the global populations we serve. Groq is an equal opportunity employer committed to diversity, inclusion, and belonging in all aspects of our organization. We value and celebrate diversity in thought, beliefs, talent, expression, and backgrounds. We know that our individual differences make us better.

Groq is an Equal Opportunity Employer that is committed to inclusion and diversity. Qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, gender, sexual orientation, gender identity, disability or protected veteran status. We also take affirmative action to offer employment opportunities to minorities, women, individuals with disabilities, and protected veterans.

Groq is committed to working with qualified individuals with physical or mental disabilities. Applicants who would like to contact us regarding the accessibility of our website or who need special assistance or a reasonable accommodation for any part of the application or hiring process may contact us at: [e-mail]. This contact information is for accommodation requests only. Evaluation of requests for reasonable accommodations will be determined on a case-by-case basis.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Semiconductor Manufacturing

Referrals increase your chances of interviewing at Groq by 2x

Get notified about new Senior Infrastructure Engineer jobs in Palo Alto, CA.

San Francisco Bay Area $60.00-$65.00 19 hours ago

Newark, CA $50,000.00-$70,000.00 2 weeks ago

User Support Lead and Junior System Administrator

Senior AI Architect – Multi-Agent Systems & Platform Infrastructure

Sunnyvale, CA $180,000.00-$210,000.00 1 month ago

Staff Software Engineer - Scalable Systems & Infrastructure

Senior Site Reliability / Gitops Engineer

San Jose, CA $100,000.00-$215,000.00 1 day ago

Sr AI/ML Engineer, Agentic Systems 200k-500k (Hybrid or Remote)

San Mateo, CA $200,000.00-$500,000.00 2 weeks ago

Staff Software Engineer (Batch Infrastructure)

Staff Software Engineer (Batch Infrastructure)

Senior Software Engineer - Data Lakehouse Infrastructure

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.