Staff Observability Engineer — Data Pipeline Platform

Astronomer; New York (NY); Hybrid; USD 275,000 - 377,000; Full time

Benefits offered by this job

Equity

Benefits package

Job summary

Astronomer is hiring a Staff Software Engineer to help build and scale the observability platform that gives customers visibility into data pipelines and products. You will shape architecture, craft reliable features, and drive improvements across product, design, and engineering teams.

You will mentor engineers, set standards for code quality, testing, and operations, and proactively identify risks and opportunities in a fast-growing data-centric environment.

Qualifications

• Experience designing and scaling distributed systems.
• Hands-on with Golang, Python, Kubernetes, SQL/OLAP databases, Kafka, or streaming platforms.
• Strong collaboration and communication across teams.
• Ability to work in ambiguous environments and deliver results.
• Mentor engineers and contribute to team growth.

Responsibilities

• Lead end-to-end architecture and evolution of major platform components.
• Build scalable, reliable features with observability into customer data pipelines.
• Collaborate with product, design, and engineering to deliver high-impact initiatives.
• Write high-quality code with strong testing, CI/CD, and operations practices.
• Set engineering standards for code quality, testing, and operations.
• Improve observability tooling, infrastructure, and processes.
• Lead incident responses and guide rapid resolution with long-term fixes.
• Identify technical opportunities, risks, and gaps and drive initiatives.
• Mentor engineers through design reviews, pairing, and feedback.

Skills

Distributed systems

Golang

Python

Kubernetes

SQL/OLAP databases

Kafka

Stream processing

CI/CD

Observability tooling

Tools

Datadog

Honeycomb

Apache Airflow

Job description

Astronomer is hiring a Staff Software Engineer to help build and scale the observability platform that gives customers visibility into data pipelines and products. You will shape architecture, craft reliable features, and drive improvements across product, design, and engineering teams.

You will mentor engineers, set standards for code quality, testing, and operations, and proactively identify risks and opportunities in a fast-growing data-centric environment.