Production Engineer, IaaS

Fluidstack; New York (NY); Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Equity

Pension/retirement plan

Health, dental, vision insurance

Generous PTO

Job summary

Fluidstack is building civilization-scale infrastructure for AI, expanding hyperscale compute and data center operations. You will own the observability platform, design and expose stable APIs for production infrastructure, and lead the creation of a unified production control plane.

You will ensure fleet state is the single source of truth and orchestrate smooth onboarding of new hardware into the platform. We value autonomy, rapid delivery, and deep competence in distributed systems.

Qualifications

• Requires 5+ years of applied industry experience.
• Designs APIs that age well and scale at speed.
• Proficient in Go and Python; strong PostgreSQL skills.
• Experience with distributed systems and large-scale observability.
• Familiarity with Prometheus-style observability stacks is a plus.

Responsibilities

• Own the observability platform across the fleet, building data pipelines and health checks.
• Define and build the API surface for infrastructure used by all tools.
• Develop the production control plane with unified machine management and state inspection.
• Own fleet state as the source of truth, including site lifecycle and integrations.
• Onboard new hardware into the platform, ensuring seamless production deployment.

Skills

5+ years

APIs design

Go

Python

PostgreSQL

Distributed systems

Tools

Prometheus

Thanos

VictoriaMetrics

Temporal

Cadence

Redfish

Go

Python

PostgreSQL

Job description

About Fluidstack

We exist to make humanity more free. For most of human history, you farmed or you starved. Technology gave people more time for the things they wanted to do, instead of things they had to do. Powerful AI will be the biggest lever for human choice we've ever built - but only if models are aligned with what humanity actually wants. There are groups building AI who don't share these goals. Whoever deploys frontier compute infrastructure fastest will decide whether AI expands human freedom or shrinks it.

We're singularly focused on delivering 10 to 100s of GWs of compute faster than anyone else, rethinking every layer of the stack. We acquire power, design and build data centers, and operate them - with teams spanning hardware and software. Speed and scale are our key differentiators. Come be a part of building civilization-scale infrastructure for AI.

How We Operate

• Be a barrel. Full autonomy. Own things end to end, take on scope without being asked, no permission required to operate outside your core role.

• Insane urgency. We drive everything forward as fast as possible.

• Reason from first principles. Challenge every assumption. Zero analogy thinking, no egos, the best idea wins.

• Love of the game. The frontier of AI is the most interesting problem of our time. We put in long hours at high intensity to push the frontier forward.

• Build something that actually matters. If you're going to spend your time, spend it on something that matters to the world.

The Production Engineering Team

Examples of key exciting problems the team is working on

• Make tens of thousands of GPUs legible in real time: build the observability platform that turns raw telemetry into signal, from site-level health down to individual device and link. At this scale, you cannot operate what you cannot see.

• Build the control plane every team at Fluidstack depends on: replace one-off tooling with a stable, versioned API surface that covers unified machine management, actual state inspection, and distributed command execution. One interface for the whole company, not a hundred scripts.

• Make the system's view of itself always match reality: integrate fleet state as a machine-readable source of truth across provisioning, operations, and customer-facing platforms, so every new site and GPU generation lands cleanly from day zero.

Role Scope

• Own the observability platform. Build and operate the data pipelines, decoration and correlation engine, and healthcheck framework that make the fleet legible — from site down to device and link. No other team should need to scrape production directly to answer a question.

• Define and build the API surface for infrastructure. Design the contracts between production infrastructure and every tool that touches it. All other teams at Fluidstack use your tooling to manage and operate our hyperscale fleet.

• Build the production control plane. Unified machine management, actual state inspection, distributed command execution — and the Kubernetes-based infrastructure that underpins it all.

• Own fleet state as source of truth. SLOs, site lifecycle state, and integration with internal infrastructure management and customer-facing operations platforms. What the system says about itself should match reality, and you're accountable when it doesn't.

• Land new hardware into the platform cleanly. ZTP, DHCP, DNS, artifacts — every new XPU generation and site integration goes through IaaS before production.

What We're Looking For

The below is a starting point. We always make space for exceptional people, so if you don't fit this role exactly,

• You treat toil as a bug. If something requires a human to do it twice, you build the thing that makes it not require a human.

• You bring 5+ years of applied industry experience.

• You design APIs that age well. You've felt the pain of a leaky abstraction at scale and you don't repeat it.

• You move toward ambiguity, not away from it. You walk into the fog, build the map, and explain it to everyone else.

• You learn at a steep slope. You reach real competence in an unfamiliar domain fast. We value this over existing expertise.

• You carry a pager without flinching. You run the incident, write the postmortem, fix the systemic cause, and move on.

• You're fluent with AI tooling. LLM APIs, MCP servers, and agentic frameworks, and you drive Claude Code, Cursor, or similar every day.

• You've shipped production services that other teams depend on at scale, and you're comfortable in any language using AI coding tools.

• Bonus: Distributed systems and data pipeline engineering. Time-series observability stacks (Prometheus, Thanos, VictoriaMetrics). API design and versioning at scale. Workflow and orchestration engines (Temporal, Cadence). BMC/Redfish or hardware telemetry. Go, Python, and Postgres.

Salary & Benefits

• Competitive total compensation package (salary + equity).

• Retirement or pension plan, in line with local norms.

• Health, dental, and vision insurance.

• Generous PTO policy, in line with local norms.

We are committed to pay equity and transparency.

Fluidstack is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Fluidstack will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

You will receive a confirmation email once your application has successfully been accepted. If there is an error with your submission and you did not receive a confirmation email, please email [e-mail] with your resume/CV, the role you've applied for, and the date you submitted your application-- someone from our recruiting team will be in touch.