Data Engineer – Big Data / Data Platform

Ubique Systems; Kraków; On-site; PLN 120,000 - 180,000; Full time

Job summary

Ubique Systems is seeking a data-focused engineer to design, build, and operate scalable batch and streaming data pipelines. The role involves implementing distributed data processing with Spark or Apache Beam and orchestrating workflows using Apache Airflow to ensure efficient data management.

Collaborate with Analytics Engineers and Platform Engineers to develop transformations using SQL and dbt, driving data quality and reliable project execution.

Qualifications

• Designing scalable batch and streaming data pipelines.
• Experience with Spark or Apache Beam.
• Transformations using SQL and dbt for data quality.

Responsibilities

• Designing, building, and operating scalable data pipelines.
• Orchestrating workflows with Apache Airflow.
• Developing transformations using SQL and dbt.

Job description

Designing, building, and operating scalable batch and streaming data pipelines is a primary responsibility.

Implementing distributed data processing using frameworks like Spark and Apache Beam is crucial. Orchestrating workflows with Apache Airflow ensures efficient data management.

Developing and maintaining transformations using SQL and dbt is essential for data quality. Collaborating with Analytics Engineers and Platform Engineers is necessary for successful project execution.