Senior Backend Infra Engineer - Scale AI & LLMs (GCP)

Devopsroles; San Francisco (CA); On-site; USD 180,000 - 230,000; Full time

Job summary

Macroscope is seeking a Senior Backend Infrastructure Engineer to shape and scale the foundation of our core services and inference platforms. You’ll design distributed systems, APIs, and infrastructure to deploy and manage LLMs at scale on Google Cloud.

You’ll lead projects focused on backend scalability, reliability, and performance, partnering with the engineering team to establish best practices for cloud infrastructure, CI/CD, observability, and production operations while collaborating

Qualifications

• Experience architecting distributed backend systems at scale.
• Strong cloud experience with Google Cloud Platform (GCP) including IAM, networking, monitoring, and IaC.
• Experience building infrastructure for modern LLM workloads including inference serving, fine-tuning, and training workflows.

Responsibilities

• Design and operate scalable backend infrastructure and APIs.
• Lead backend/infrastructure projects and drive architectural decisions.
• Collaborate with ML Research to support training and inference workloads.

Skills

Distributed backend

GCP Cloud

Go programming

LLM infra

Observability

PostgreSQL

CI/CD

Team leadership

Tools

Terraform

Job description

Macroscope is seeking a Senior Backend Infrastructure Engineer to shape and scale the foundation of our core services and inference platforms. You’ll design distributed systems, APIs, and infrastructure to deploy and manage LLMs at scale on Google Cloud.

You’ll lead projects focused on backend scalability, reliability, and performance, partnering with the engineering team to establish best practices for cloud infrastructure, CI/CD, observability, and production operations while collaborating