Senior Infrastructure Engineer Macroscope · San Francisco · Platform & Infrastructure $207,250–$288,250 e 12d ago

Devopsroles

San Francisco (CA)

On-site

USD 180,000 - 230,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Macroscope is seeking a Senior Backend Infrastructure Engineer to shape and scale the foundation of our core services and inference platforms. You’ll design distributed systems, APIs, and infrastructure to deploy and manage LLMs at scale on Google Cloud.

You’ll lead projects focused on backend scalability, reliability, and performance, partnering with the engineering team to establish best practices for cloud infrastructure, CI/CD, observability, and production operations while collaborating

Qualifications

  • Experience architecting distributed backend systems at scale.
  • Strong cloud experience with Google Cloud Platform (GCP) including IAM, networking, monitoring, and IaC.
  • Experience building infrastructure for modern LLM workloads including inference serving, fine-tuning, and training workflows.

Responsibilities

  • Design and operate scalable backend infrastructure and APIs.
  • Lead backend/infrastructure projects and drive architectural decisions.
  • Collaborate with ML Research to support training and inference workloads.

Skills

Distributed backend
GCP Cloud
Go programming
LLM infra
Observability
PostgreSQL
CI/CD
Team leadership

Tools

Terraform

Job description

About Macroscope

Macroscope is building the infrastructure for the next generation of software development, where engineers direct fleets of agents, every change is automatically reviewed and verified, and organizations have a clear understanding of how their products and codebases are evolving.

Our mission is to give engineers more leverage and leaders more clarity, so teams can build better software, faster.

Macroscope is founded by former entrepreneurs who have started and sold multiple companies, and operated as product/engineering executives at public tech companies. We're fortunate to be supported by the best VC firms and angels in the business, including Lightspeed Venture Partners, Thrive Capital, Google Ventures, and Adverb.

About the role

We’re looking for a Senior Backend Infrastructure Engineer to help shape and scale the foundation of Macroscope’s core services and inference platforms. You’ll play a key role in designing and implementing the distributed systems, infrastructure, and APIs that power our core product, while building the infrastructure needed to deploy and manage LLMs at scale.

You’ll lead projects focused on backend scalability, reliability, and performance, ensuring our systems can evolve alongside customer demand. You’ll partner closely with the engineering team to establish best practices across cloud infrastructure, CI/CD pipelines, observability, and production operations.

You’ll also work closely with our ML Research team to architect and build the infrastructure needed to support our growing ML research, training, and inference workloads.

As part of our small team, you’ll work directly with the founders, engineers, and designer to make architectural decisions that will help define the trajectory of our product and company.

Our technology stack: TypeScript/React (frontend), Go (backend), Temporal, Google Cloud (GCP), Postgres, Terraform, and custom-built AST \"code walkers\" in various languages (Go, TypeScript, Swift, Python, Rust).

Qualifications
  • Deep experience architecting and operating distributed backend systems at scale.

  • Expertise in building resilient, performant, and maintainable backend services and APIs.

  • Strong proficiency with cloud environments, ideally Google Cloud Platform (GCP), including networking, IAM, monitoring, and infrastructure as code (Terraform or equivalent).

  • Experience building or operating infrastructure for modern LLM workloads, including inference serving, fine-tuning, and training workflows. Familiarity with techniques such as LoRA and reinforcement learning (RL) is a plus.

  • Experience leading backend or infrastructure projects and driving architectural decisions in high-growth engineering environments.

  • Hands‑on experience with databases (SQL/Postgres), caching layers, and messaging systems.

  • Familiarity with observability tools and practices, including logging, metrics, tracing, and alerting.

  • You use AI tools to accelerate your work as an engineer and stay current with emerging technologies and best practices.

  • Strong experience with Go, our primary backend language, is highly preferred.

  • Bonus: experience with Temporal or similar durable execution/workflow orchestration systems.

About you
  • You are extremely high agency. We are a small startup and we intend to keep an extremely flat organizational structure for as long as possible. Instead of relying on people managers, product managers and heavy processes, we rely on exceptionally talented individuals with high agency to be self‑motivated towards contributing to our mission.

  • You want to work at an early stage startup. The default state of any startup is failure. The only way to overcome the daunting odds of making a startup venture successful is for a densely packed group of insanely hard working and talented people to work together to build something useful to and loved by customers. If you're not willing to work extremely hard on something high risk, this startup isn't for you.

  • You act like an owner. You put immense care and craft into what you build because you take responsibility for all parts of the product. You don't walk past broken windows.

  • You care about what we're building. Life's too short to work on something you're not passionate about. We are a small group of ambitious people who want to build something insanely great that we want to use, and that we think every company will want to use. If our mission and product don't resonate with you, we understand and would encourage you to find something that does.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Full Stack Engineer
Full Stack Engineer

Macroscope • San Francisco (CA)

On-site
USD 120,000 - 160,000
Technical Customer Success Engineer
Technical Customer Success Engineer

Macroscope • San Francisco (CA)

On-site
USD 95,000 - 130,000
GTM Engineer
GTM Engineer

Macroscope • San Francisco (CA)

On-site
USD 80,000 - 120,000
Senior Software Engineer
Senior Software Engineer

SproutsAI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Senior Software Engineer
Senior Software Engineer

MetAntz • Palo Alto (CA)

On-site
USD 200,000 - 300,000
Staff Software Engineer, Backend
Staff Software Engineer, Backend

Gradial • Washington

On-site
USD 180,000 - 240,000
Performance-based bonus
Equity awards
Medical, dental & vision
+5
Platform Engineer
Platform Engineer

Harper • San Francisco (CA)

On-site
USD 140,000 - 280,000
Uber commuter benefits
Meals provided (breakfast, lunch, and/
Snacks, drinks and coffee daily
+2
Senior MLOps Engineer Palo Alto, CA ·
Senior MLOps Engineer Palo Alto, CA ·

Nace.AI • Palo Alto (CA)

Hybrid
USD 180,000 - 240,000
Equity
Premium benefits
Founding Infrastructure Engineer
Founding Infrastructure Engineer

Matterhaul, Inc. • San Francisco (CA)

On-site
USD 200,000 - 260,000
Equity options
Hardware + AI coding budget
Real office in SF
Motion Designer / Video Producer
Motion Designer / Video Producer

Macroscope • San Francisco (CA)

On-site
USD 150,000 - 300,000