Staff Software Engineer

B Capital; India; On-site; INR 21,824,712 - 26,652,298; Full time

Job summary

Starburst is searching for a Staff Data Engineer to build and manage a high-quality data lake, optimize data pipelines, and collaborate with technical teams to enhance data products. Ideal candidates will have at least 7 years of data engineering experience and be proficient in tools such as Trino, Apache Airflow, and various AWS services. This position supports remote work options, offering a competitive pay range of $227,850 to $278,250 USD.

Qualifications

• At least 7 years of data engineering experience, and a clear passion for data and analytics.
• Experience building and optimizing data pipelines using Trino, Spark, dbt.
• Strong discipline in software engineering practices, including high code quality.

Responsibilities

• Build and manage a high quality data lake.
• Collaborate with technical leads to build robust data products.
• Envision innovative approaches to data management.

Skills

Data engineering experience

Data pipelines optimization with Trino

Collaboration with teams

Fluency in SQL

Excellent coding in Java, Python or Scala

Tools

Trino

Apache Airflow

Terraform

AWS EMR

Database management tools

Job description

About the role

Starburst is looking for an experienced Data Engineer to build and enhance internal usage, telemetry, and product data analytics for both Starburst Enterprise and Starburst Galaxy. This role focuses on using our own software to better understand our customers and how they use our products. As a key target persona, you will also provide valuable feedback on performance, user experience, and integration with the larger data engineering ecosystem. You’ll work closely with our dynamic, talented, global engineers while emphasizing quality and speed to insights.

As a Staff Data Engineer at Starburst you will:

• Build and manage a high quality data lake to support various aspects of Starburst’s business, including product management, finance, customer support, and engineering.
• Find innovative ways to use Trino and Starburst to solve data management challenges.
• Collaborate with technical leads, product managers and data analysts to build robust data products and analytics.
• Leverage AI to democratize access to datasets for users throughout Starburst.
• Enable dataset preparation and model evaluation for Starburst’s AI projects.
• Define and adapt data engineering processes and best practices to focus on execution and delivering reliable answers to important business questions.
• Work closely with leaders from other teams and departments to iterate on both data architecture and design of data solutions, focusing on high‑quality results accessible at several levels.
• Envision innovative approaches to data management and work with Starburst’s product teams to bring those innovations to market.

Some of the things we look for:

• At least 7 years of data engineering experience, and a clear passion for data and analytics.
• Enthusiasm for working both independently and collaboratively with strong, diverse, high‑performing teams to get value and insights from data.
• Experience building and optimizing data pipelines using Trino, Spark, dbt, and related frameworks.
• Experience managing data infrastructure in public clouds.
• Experience using and managing orchestration frameworks such as Apache Airflow or Dagster.
• Knowledge of RAG and other design patterns for AI applications.
• Fluency in SQL.
• Experience building API integrations for extracting data from third‑party sources.
• Excellent coding ability in Java, Python or Scala.
• Knowledge of data modelling techniques appropriate for modern data lakes.
• Experience with a variety of AWS services such as EMR, EC2, S3, and IAM. Multi‑cloud experience (GCP/Azure) is also nice to have.
• Able to use Configuration‑as‑Code and Infrastructure‑as‑Code tools such as Pulumi, Terraform, and/or Ansible.
• Demonstrable experience in delivering value and hitting deadlines consistently.
• Strong discipline in software engineering practices, including high code quality, extensive automated testing, and rigorous code review.
• Highly proficient in both written and verbal communication, coupled with strong organizational abilities.

Where could this role be based?

Remote, US

Pay Range: $227,850 — $278,250 USD

Starburst provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.