Senior Software Engineer, AI Data Platform

Astronomer; New York (NY); Hybrid; USD 210,000 - 250,000; Full time

Benefits offered by this job

Equity

Comprehensive benefits package

Job summary

Astronomer is hiring a Software Engineer to help build the foundation of its AI-enabled data platform. You will work across the stack to design, implement, and scale systems for data modeling, semantic search, and code generation, collaborating with a small, highly skilled team.

You will explore LLMs, embeddings, and retrieval techniques, turning research into product features while contributing to a hybrid work model in NYC.

Qualifications

• 5-8 years of software engineering experience with Python or Go.
• Empathy for users and a deep interest in improving workflows for data professionals.
• Familiarity with early-stage product development; comfortable with ambiguity in a fast-changing field.
• Experience with LLMs, vector databases, embeddings, or other applied AI areas—or a strong desire to dive in.
• Creative, experimental mindset; enjoy exploring uncharted areas and learning through iteration.
• Strong collaboration and communication skills; able to explain complex systems to technical and non-technical audiences.
• Collaborative approach and comfort working in an evolving, research-driven environment where ideas move quickly.

Responsibilities

• Shape the future of AI for data engineering.
• Design and engineer the brain of Astronomer’s context layer for data modeling, semantic search, retrieval, and code generation.
• Push the boundaries of applied AI with LLMs and retrieval techniques to build developer tools.
• Turn research into reality by working with R&D and product teams to bring early AI concepts to life in the product experience.
• Solve high-impact information retrieval and search challenges at a global scale, leveraging data pipelines across industries.
• Influence the technical vision and architecture for AI-driven data products.
• Represent Astronomer in the community through open-source contributions and talks.

Skills

Python

Go

LLMs

Vector databases

Embeddings

Tools

Apache Airflow

Job description

Astronomer is hiring a Software Engineer to help build the foundation of its AI-enabled data platform. You will work across the stack to design, implement, and scale systems for data modeling, semantic search, and code generation, collaborating with a small, highly skilled team.

You will explore LLMs, embeddings, and retrieval techniques, turning research into product features while contributing to a hybrid work model in NYC.