Principal Infra Architect, Self-Contained Data Platform

astronomer; New York (NY); Hybrid; USD 277,000 - 390,000; Full time

Job summary

Astronomer in New York is seeking a Principal Software Engineer to provide technical leadership, architectural vision, and mentorship for our core engineering group. You will be the primary architect of a cloud-agnostic platform that provisions, scales, and orchestrates Airflow instances on premises.

This role focuses on a self-contained infrastructure with no dependency on external SaaS, spanning control and data planes, API design, observability, and secure, isolated environments.

Qualifications

• 10+ years of professional software engineering in enterprise infra or private cloud.
• Experience building production-grade infrastructure control planes and APIs.
• Observability stacks in isolated environments (Prometheus/OpenTelemetry/Grafana).
• Strong Kubernetes with Operators and Helm deployments.

Responsibilities

• Define, Design, and Build Core Architecture for control and data planes.
• Architect an extensible Platform API with REST or gRPC.
• Design comprehensive platform observability (metrics, logs, traces).
• Architect for varied isolation levels across clouds and air-gapped networks.
• Provide technical leadership and align with product management and executives.
• Mentor and elevate engineering practices.

Skills

10+ years infra exp

Control Plane API

Observability stacks

Kubernetes knowledge

Hybrid Cloud design

Go/Python/TS

Technical communication

Tools

Prometheus

OpenTelemetry

Grafana

Kubernetes Operators

Helm

PostgreSQL

Etcd/Consul

Job description

Astronomer in New York is seeking a Principal Software Engineer to provide technical leadership, architectural vision, and mentorship for our core engineering group. You will be the primary architect of a cloud-agnostic platform that provisions, scales, and orchestrates Airflow instances on premises.

This role focuses on a self-contained infrastructure with no dependency on external SaaS, spanning control and data planes, API design, observability, and secure, isolated environments.