Senior Software Engineer, AI for Data Platforms

Astronomer; United States; Hybrid; USD 200,000 - 230,000; Full time

Job summary

Astronomer in New York is seeking a Software Engineer to help design and build the foundation of our context layer for data and AI. You will work across the stack on search, information retrieval, and AI features that power data practitioners.

The role emphasizes collaboration, experimentation, and delivering scalable data products, with a hybrid model requiring at least 3 days in the NYC office.

Qualifications

• 5-8 years of software engineering experience with Python or Go.
• Empathy for users and a deep interest in improving the workflows of data professionals.
• Experience with LLMs, vector databases, embeddings, or a strong desire to dive in.
• Creative, experimental mindset and willingness to learn through iteration.
• Strong collaboration and communication skills to explain complex systems clearly.

Responsibilities

• Shape the future of AI for data engineering and data workflows.
• Design and engineer the brain of Astronomer’s context layer for data modeling, semantic search, and code generation.
• Push the boundaries of applied AI with LLMs and cutting-edge retrieval techniques.
• Turn research into reality by collaborating with R&D and product teams.
• Solve high-impact information retrieval and search challenges at a global scale across industries.
• Influence the technical vision and architecture for AI-driven data products.

Skills

Python

Go

LLMs

Vector databases

Embeddings

Open source

Tools

Apache Airflow

Job description

Astronomer in New York is seeking a Software Engineer to help design and build the foundation of our context layer for data and AI. You will work across the stack on search, information retrieval, and AI features that power data practitioners.

The role emphasizes collaboration, experimentation, and delivering scalable data products, with a hybrid model requiring at least 3 days in the NYC office.