Data Engineer: Scalable Pipelines, Spark & Airflow

Ubique Systems; Kraków; On-site; PLN 120,000 - 180,000; Full time

Job summary

Ubique Systems is seeking a data-focused engineer to design, build, and operate scalable batch and streaming data pipelines. The role involves implementing distributed data processing with Spark or Apache Beam and orchestrating workflows using Apache Airflow to ensure efficient data management.

Collaborate with Analytics Engineers and Platform Engineers to develop transformations using SQL and dbt, driving data quality and reliable project execution.

Qualifications

• Designing scalable batch and streaming data pipelines.
• Experience with Spark or Apache Beam.
• Transformations using SQL and dbt for data quality.

Responsibilities

• Designing, building, and operating scalable data pipelines.
• Orchestrating workflows with Apache Airflow.
• Developing transformations using SQL and dbt.

Job description

Ubique Systems is seeking a data-focused engineer to design, build, and operate scalable batch and streaming data pipelines. The role involves implementing distributed data processing with Spark or Apache Beam and orchestrating workflows using Apache Airflow to ensure efficient data management.

Collaborate with Analytics Engineers and Platform Engineers to develop transformations using SQL and dbt, driving data quality and reliable project execution.