Principal Software Engineer

Astronomer

United States

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Astronomer is seeking a Principal Software Engineer to provide technical leadership for our core engineering group. You will architect a cloud-agnostic platform that provisions and orchestrates Airflow instances entirely on-premises within customer environments, including air-gapped networks.

You will lead design of control and data planes, build robust APIs, advance observability stacks, and mentor senior engineers while collaborating with product management and executives to align roadmaps

Qualifications

  • 10+ years of professional software engineering experience at staff/principal level.
  • Proven success building production-grade infrastructure control planes.
  • Experience with API design for programmatic customer workflows.
  • Practical observability experience (Prometheus/OpenTelemetry/Grafana).
  • Strong Kubernetes experience including Operators, Helm, and API interactions.

Responsibilities

  • Define, design, and build core architecture for control and data plane services.
  • Architect extensible platform APIs to support UI and integrations.
  • Design platform observability and telemetry across components.
  • Ensure operation across isolated and air-gapped environments.
  • Provide technical leadership and mentor senior engineers.

Skills

Infrastructure leadership
Kubernetes
Cloud-native observability
API design
Go / Python / TypeScript
Communication skills

Job description

Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than 800 of the world's leading enterprises, Astronomer lets businesses do more with their data. To learn more, visit www.astronomer.io .

About the Role

We are seeking an exceptional Principal Software Engineer to provide technical leadership, architectural vision, and team mentorship for our core engineering group. In this role, you will be the primary architect and public face of a cloud-agnostic software platform that helps enterprise customers provision, scale, and orchestrate Apache Airflow instances completely on-premises within their own environments. This is a unique infrastructure challenge: our platform is designed to be completely self-contained, operating without reliance on an external SaaS backbone or mandatory outbound communication. Both our control plane and data planes deploy locally inside the customer's infrastructure. You will lead the engineering team in defining, designing, and building these systems to function reliably across a spectrum of enterprise network setups-ranging from standard customer-managed clouds to strictly isolated, air-gapped environments.

What You'll Do
  • Define, Design, and Build Core Architecture : Own the end-to-end definition, design, and implementation of both the control plane and data plane services, creating highly resilient inter-connections between them to power this self-contained infrastructure platform.
  • Architect an Extensible Platform API : Drive the design, data modeling, versioning, and long-term backward compatibility of robust APIs (such as REST or gRPC). These APIs serve as the core platform engine that power the customer-facing UI, and the developer endpoints for customer-facing programmatic integrations.
  • Design Comprehensive Platform Observability : Architect the telemetry framework (metrics, logs, and traces) for the self-contained platform itself, ensuring deep visibility into both the core control plane services and the performance, health, and status of the underlying Airflow instances it provisions.
  • Architect for Varied Isolation Levels : Oversee the architecture of a self-contained software platform, ensuring all services, images, dependencies, and configurations can run smoothly whether deployed in connected private clouds or highly secure, zero-egress networks.
  • Provide Technical Leadership : Act as the technical face of the team, translating complex enterprise infrastructure needs into execution roadmaps while aligning closely with product management and executive stakeholders.
  • Mentor and Elevate : Foster a culture of engineering and operational excellence through comprehensive design reviews, high-leverage code contributions, and direct career mentorship for senior engineers.
What You'll Bring
  • Extensive Infrastructure Experience : 10+ years of professional software engineering experience, with a significant track record operating at a Staff, Senior Staff, or Principal level within an enterprise infrastructure, database-as-a-service (DBaaS), or private cloud organization.
  • Control Plane & API Productization : Proven success building production-grade infrastructure control planes, with a deep understanding of API design principles required to support programmatic customer workflows and user interfaces.
  • Cloud-Native Observability Expertise : Practical experience designing and implementing infrastructure observability stacks (e.g., Prometheus, OpenTelemetry, Grafana) to capture, aggregate, and surface system health and workflow data within isolated environments.
  • Strong Kubernetes Foundation : Solid operational knowledge and architectural understanding of container orchestration platforms, specifically Kubernetes . You have practical experience building custom Kubernetes Operators (CRDs) , managing Helm deployments, and working with the Kubernetes API to orchestrate application lifecycles.
  • Hybrid Cloud Architecture : Hands-on systems design expertise involving isolated environments across multiple public cloud providers (AWS, GCP, Azure), Red Hat OpenShift enterprise deployments, and bare-metal on-premise infrastructure.
  • Advanced Coding & Systems Design : Expert-level software development skills (e.g., Go, Python, TypeScript) with deep knowledge of distributed state stores (such as Etcd, Consul, or PostgreSQL), concurrency, and network security patterns.
  • Top-Notch Technical Communication : Exceptional oral and written communication skills with a proven ability to author crisp, high-density technical "one-pagers" and actionable RFCs. You can drive fast organizational alignment by distilling complex systems choices into brief, highly readable documents, presenting confidently to executive leader.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, Platform
Senior Software Engineer, Platform

Astronomer • Cincinnati (OH)

On-site
GBP 100,000 - 140,000
Senior Software Engineer, Platform
Senior Software Engineer, Platform

Astronomer • New York (NY)

On-site
USD 210,000 - 250,000
Principal Cloud Infra Architect & Platform Lead
Principal Cloud Infra Architect & Platform Lead

Astronomer • United States

On-site
USD 180,000 - 240,000
Staff Product Manager
Staff Product Manager

Astronomer • San Francisco (CA), New York (NY)

Hybrid
USD 230,000 - 300,000
Staff Product Manager
Staff Product Manager

Astronomer • United States

On-site
USD 230,000 - 300,000
Staff Product Manager
Staff Product Manager

Astronomer • Town of Tonawanda (NY)

On-site
USD 230,000 - 300,000
Equity
Comprehensive benefits
Senior Apache Airflow Platform Engineer
Senior Apache Airflow Platform Engineer

Veriipro • Plano (TX)

On-site
USD 180,000 - 240,000
Vice President of Product Marketing
Vice President of Product Marketing

Astronomer • New York (NY)

Remote
USD 220,000 - 320,000
Remote friendly
Work from anywhere
Co-workers in over 40 states and 15+ 2
+8
Senior Core Platform Engineer – Go, Kubernetes, APIs (Hybrid)
Senior Core Platform Engineer – Go, Kubernetes, APIs (Hybrid)

Astronomer • New York (NY)

Hybrid
USD 210,000 - 250,000
Equity
Comprehensive benefits package
Hybrid work model
Astronomer Architect
Astronomer Architect

Tata Consultancy Services Limited • Plano (TX)

On-site
USD 100,000 - 120,000
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Health
Parental Leaves