Senior Software Engineer - AI for Data Platforms (Hybrid NYC)

Apply; New York, Northern (NY, KY); Hybrid; USD 210,000 - 250,000; Full time

Benefits offered by this job

Equity

Job summary

Astronomer is seeking a Software Engineer to help build the context layer for data and AI products. You’ll work across the stack on search, retrieval, and code generation, collaborating with R&D and product teams to bring AI concepts to life in the product experience.

The role is hybrid with at least 3 days in the New York City office; you’ll contribute to open-source efforts and participate in community events while shaping the future of AI for data practitioners at scale.

Qualifications

• 5-8 years of software engineering experience with Python or Go.
• Empathy for users and a deep interest in improving workflows of data professionals.
• Familiarity with early-stage product development; comfortable with ambiguity in a fast-changing field.
• Experience with LLMs, vector databases, embeddings, or other applied AI areas— or a strong desire to dive in.
• Creative, experimental mindset; enjoy exploring uncharted areas, validating hypotheses, and learning through iteration.
• Strong collaboration and communication skills—you can explain complex systems clearly to technical and non-technical audiences.
• Collaborative approach and comfort working in an evolving, research-driven environment where ideas move quickly.

Responsibilities

• Shape the future of AI for data engineering and data flow across organizations.
• Design and engineer the brain of Astronomer’s context layer, powering data modeling and semantic search.
• Push the boundaries of applied AI by experimenting with LLMs and retrieval techniques to create developer tools for insights.
• Turn research into reality by partnering with R&D and product teams to bring concepts to life in the product experience.
• Solve high-impact information retrieval and search challenges at a global scale using Astronomer’s data pipelines.
• Influence the technical vision and architecture for the next generation of AI-driven data products.
• Represent Astronomer in the community through open-source contributions and technical talks.

Skills

Python

Go

LLMs

Embeddings

Tools

Apache Airflow

Vector databases

Job description

Astronomer is seeking a Software Engineer to help build the context layer for data and AI products. You’ll work across the stack on search, retrieval, and code generation, collaborating with R&D and product teams to bring AI concepts to life in the product experience.

The role is hybrid with at least 3 days in the New York City office; you’ll contribute to open-source efforts and participate in community events while shaping the future of AI for data practitioners at scale.