Staff Data Platform Engineer (Python) — Real-Time Lakehouse

Duettoresearch; United States; On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Inclusive work environment

Collaborative team culture

Job summary

Duettoresearch is looking for a Staff Software Engineer to own the data infrastructure that drives real-time pricing for hotels. This role will involve designing and implementing reliable data pipelines and architectures on AWS, while working in an AI-first environment. Ideal candidates have over 7 years of experience with Python and PySpark, and are passionate about data engineering.

The position offers the chance to work with a modern tech stack, including AWS Glue and Apache Iceberg, in a collaborative and inclusive team. Remote work is available within the US.

Qualifications

• 7+ years building production data systems in Python.
• Deep expertise in PySpark and distributed data processing.
• Strong experience with lakehouse architectures.

Responsibilities

• Own the design and reliability of Duetto's data lakehouse.
• Architect the shift from batch to near-real-time streaming.
• Drive data quality and governance at scale.

Skills

Production data systems in Python

Deep expertise in PySpark

Lakehouse architectures

Production experience with Airflow

Solid AWS experience

Data quality improvement

Tools

Apache Iceberg

AWS Glue

S3

Job description

Duettoresearch is looking for a Staff Software Engineer to own the data infrastructure that drives real-time pricing for hotels. This role will involve designing and implementing reliable data pipelines and architectures on AWS, while working in an AI-first environment. Ideal candidates have over 7 years of experience with Python and PySpark, and are passionate about data engineering.

The position offers the chance to work with a modern tech stack, including AWS Glue and Apache Iceberg, in a collaborative and inclusive team. Remote work is available within the US.