Principal Infra Architect — Self-Contained Cloud Platform

Astronomer; New York (NY); On-site; USD 277,000 - 390,000; Full time

Job summary

Astronomer is seeking a Principal Software Engineer to lead architecture for a cloud‑agnostic platform that provisions and orchestrates Airflow on‑premises. You will own control plane and data plane design, ensuring strong security, scalability, and isolation for enterprise environments.

You will mentor engineers, define APIs, and drive platform observability with metrics, logs, and traces across diverse, often air‑gapped networks.

Qualifications

• 10+ years in enterprise infrastructure engineering.
• Proven success building production‑grade control planes and APIs.
• Experience with observability stacks (Prometheus, OpenTelemetry, Grafana) in isolated environments.
• Strong Kubernetes foundation with Operators (CRDs) and Helm deployments.
• Hands‑on hybrid cloud architectures across AWS, GCP, Azure and on‑prem/bare‑metal.
• Advanced coding skills in Go, Python or TypeScript and systems design.

Responsibilities

• Define, design, and build end‑to‑end architecture for control plane and data plane services.
• Architect an extensible platform API with REST or gRPC and long‑term backward compatibility.
• Design comprehensive observability for the platform including metrics, logs, and traces.
• Architect for varied isolation levels across private clouds and air‑gapped networks.
• Provide technical leadership and align engineering with product management and executives.
• Mentor senior engineers and drive rigorous design reviews and RFCs.

Skills

Infrastructure architecture

API design

Platform observability

Kubernetes

Hybrid cloud

Go/Python/TS

Technical communication

Tools

Kubernetes

Helm

CRDs

Job description

Astronomer is seeking a Principal Software Engineer to lead architecture for a cloud‑agnostic platform that provisions and orchestrates Airflow on‑premises. You will own control plane and data plane design, ensuring strong security, scalability, and isolation for enterprise environments.

You will mentor engineers, define APIs, and drive platform observability with metrics, logs, and traces across diverse, often air‑gapped networks.