Staff AI Platform Engineer - Cloud & Data Governance

Redpanda; San Francisco (CA); Hybrid; USD 220,000 - 260,000; Full time

Job summary

Redpanda is seeking a Staff Software Engineer to architect and build the ADP product, leading system design for the Agentic Data Plane and cloud services across AWS, GCP, and Azure. This hybrid role is based in San Francisco, with collaboration across Cloud, Core, Platform, and pre-/post-sales teams to deliver scalable, zero-downtime systems.

You will drive architecture discussions, push for reliability and security, and guide large projects end-to-end, shaping engineering culture and

Qualifications

• Significant experience designing and operating large-scale, reliable systems in public cloud environments.
• Experience leading large technical projects end-to-end from design to production operations.
• Strong proficiency in Go (or comparable systems language) and willingness to ramp.
• Experience with AI-assisted software development workflows including Claude Code.
• Production experience with Kubernetes and operating workloads.
• Working knowledge of AWS/Azure/GCP and IaC for systems and networks.
• Familiarity with stream processing concepts.
• Excellent written and verbal communication in a globally distributed async environment.

Responsibilities

• Design, build and operate ADP and cloud services across AWS, GCP, and Azure, including control plane and data plane components.
• Convert ambiguous product requirements into clear technical designs and executable workstreams.
• Lead the technical direction of large projects within ADP and contribute to architecture discussions with Cloud teams.
• Anticipate technical risks and mitigate to ensure timely, high-quality delivery.
• Set and uphold standards for reliability, scalability, performance, and security.
• Identify and champion new features and improvements to engineering culture and operations.
• Participate in on-call escalation chains to reduce incidents and improve health.
• Build tools for automated infrastructure provisioning, deployment, and self-healing.
• Make resilience and observability integral to enterprise-grade systems in the cloud.

Skills

Go

Large-scale systems

Public cloud

AI-assisted workflows

Distributed collaboration

Tools

Kubernetes

Claude Code

Terraform

Job description

Redpanda is seeking a Staff Software Engineer to architect and build the ADP product, leading system design for the Agentic Data Plane and cloud services across AWS, GCP, and Azure. This hybrid role is based in San Francisco, with collaboration across Cloud, Core, Platform, and pre-/post-sales teams to deliver scalable, zero-downtime systems.

You will drive architecture discussions, push for reliability and security, and guide large projects end-to-end, shaping engineering culture and