Infrastructure Ops Engineer

The Consensus; San Francisco (CA); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Competitive compensation

100% health insurance coverage

Flexible PTO policy

Paid parental leave

Fertility and family-building stipend

Company-facilitated 401(k)

Job summary

The Consensus in San Francisco is seeking an Infrastructure Ops Engineer to manage daily operations of our GPU fleet and maintain infrastructure excellence. This hands-on role collaborates closely with SRE and account teams to ensure timely fulfillment of customer capacity requests.

Candidates should have a Bachelor's or Master's degree in Computer Science or a related field, with at least 2 years of relevant experience. Exceptional attention to detail and technical communication skills are vital. Enjoy benefits like competitive compensation and 100% health insurance coverage.

Qualifications

• 2+ years of experience in a customer-facing technical role or as a junior SRE/Cloud Engineer.
• Strong ownership mindset and attention to detail.
• Ability to communicate complex technical blockers to internal and external stakeholders.

Responsibilities

• Manage daily node operations to ensure GPU fleet health.
• Partner with sales to fulfill customer capacity requests.
• Identify gaps in capacity lifecycle and drive fixes.

Skills

Kubernetes

Technical communication

Operational excellence

Automation

Education

Bachelor's or Master's degree in Computer Science or related field

Job description

THE ROLE

As an Infrastructure Ops Engineer at Baseten, you are the operational engine of our global infrastructure. You will sit at the intersection of technical customer success and infrastructure engineering, partnering closely with our SRE and FDE teams to execute the complex hardware lifecycles that power our fleet

This role is designed for high-energy, detail-oriented individuals who thrive on technical coordination and operational excellence. You aren't just managing clusters; you are acting as the technical glue between our customers' needs and our hardware reality, ensuring that high-level capacity strategies are translated into boots-on-the-ground results.

While you will be hands‑on with Kubernetes and cloud-native tools, your success is measured by your ability to project‑manage the resolution of capacity puzzles, ensuring our platform remains reliable, observable, and ready for the next massive AI deployment.

EXAMPLE INITIATIVES

• The "Lost Node" Investigation: Debugging cluster‑level blockers to solve why pods aren't scheduling despite available capacity
• Regional Compliance Guard: Auditing and correcting scheduling policies to ensure customer data stays within specified geographical constraints (e.g., EU-only vs US-only)
• High‑Stakes Maintenance Orchestration: Coordinating critical maintenance cycles both externally (with vendors) and internally (with Baseten SREs) to evacuate workloads from unhealthy nodes and integrate replacement hardware with zero customer disruption

RESPONSIBILITIES

• Fleet Maintenance: Manage daily node operations including tainting/untainting, node draining, and PVC repairs to ensure GPU fleet health and operational cost control
• GTM & Capacity Fulfillment: Partner with Sales and account teams to scope and fulfill customer capacity requests, translating complex timelines into concrete infrastructure actions and clear ETAs
• Process & Observability Engineering: Identify recurring gaps in the capacity lifecycle (intake, triage, comms) and drive fixes by defining lightweight processes and improving system observability
• Technical Orchestration: Act as the operational bridge between SRE and Infra teams, executing discrete changes and verifying system status during high‑stakes maintenance windows
• Technical Documentation: Contribute to the internal knowledge base for GPU‑specific issues (H100/A100/B200) to accelerate future incident resolution
• Automation & Tooling: Identify repetitive workflows and partner with engineering to build scripts, dashboards, and internal tools that reduce manual intervention and shorten time‑to‑mitigation
• Knowledge Excellence: Maintain a living database of GPU‑specific intelligence (H100/B200) and market moves to accelerate incident resolution and support strategic briefings for leadership

REQUIREMENTS

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• 2+ years of professional work experience, ideally in a customer‑facing technical role or as a junior SRE/Cloud Engineer
• Strong familiarity with Kubernetes and the lifecycle of cloud-based container orchestration
• Strong ownership mindset and attention to detail, demonstrated through fast detection, clear communication, and reliable follow‑through
• Demonstrated ability to communicate complex technical blockers clearly to both internal engineering teams and external vendors
• Preference for SF or NYC‑based candidates to foster a close‑knit "family" atmosphere in the office

BENEFITS

• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents
• Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
• Paid parental leave
• Fertility and family‑building stipend through Carrot
• Company‑facilitated 401(k)
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).