Databricks Data Engineer - Scalable ETL & Delta Lake

OBI Smart Technologies Poland; Katowice; Hybrid; PLN 120,000 - 180,000; Full time

Job summary

OBI Smart Technologies Poland is hiring a Data Engineer to design, develop, and maintain scalable ETL/ELT pipelines and data models for high-volume e-commerce, marketplace, retail, and tracking data. You will work with Databricks, Spark, Python, SQL, and Delta Lake, ensuring data quality and availability across domains.

You will implement Unity Catalog, Databricks Workflows, and Streaming, automate complex transformations, monitor pipeline performance, and collaborate with BI teams to deliver

Qualifications

• Completed university degree in Computer Science, Software Engineering, Business Informatics, Data Engineering, or a comparable quantitative field.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines and data models for high-volume e-commerce, marketplace, retail, and tracking data.
• Build and optimize data engineering solutions on Databricks and Spark using Python, PySpark, Scala, and SQL.
• Implement Delta Lake pipelines and modern Databricks capabilities, including Unity Catalog and Structured Streaming.
• Develop robust data models that integrate marketplace and retail data across domains.
• Automate complex data preparation and transformation processes for reliable data delivery and analytics.
• Optimize, monitor, and troubleshoot distributed data jobs for performance and reliability.
• Integrate data pipelines with downstream analytics and BI solutions like Looker with stakeholders.

Skills

Databricks

Apache Spark

Delta Lake

Python

SQL

Data modeling

Data transformation

CI/CD for data engineering

Workflow orchestration

Education

Bachelor's degree in Computer Science / Software Engineering / Data Engineering

Tools

Databricks

Apache Spark

Delta Lake

Unity Catalog

Databricks Workflows

Airflow

Looker

Job description

OBI Smart Technologies Poland is hiring a Data Engineer to design, develop, and maintain scalable ETL/ELT pipelines and data models for high-volume e-commerce, marketplace, retail, and tracking data. You will work with Databricks, Spark, Python, SQL, and Delta Lake, ensuring data quality and availability across domains.

You will implement Unity Catalog, Databricks Workflows, and Streaming, automate complex transformations, monitor pipeline performance, and collaborate with BI teams to deliver