Databricks Data Developer (B2B)

OBI Smart Technologies Poland; Katowice; Hybrid; PLN 120,000 - 180,000; Full time

Job summary

OBI Smart Technologies Poland is hiring a Data Engineer to design, develop, and maintain scalable ETL/ELT pipelines and data models for high-volume e-commerce, marketplace, retail, and tracking data. You will work with Databricks, Spark, Python, SQL, and Delta Lake, ensuring data quality and availability across domains.

You will implement Unity Catalog, Databricks Workflows, and Streaming, automate complex transformations, monitor pipeline performance, and collaborate with BI teams to deliver

Qualifications

• Completed university degree in Computer Science, Software Engineering, Business Informatics, Data Engineering, or a comparable quantitative field.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines and data models for high-volume e-commerce, marketplace, retail, and tracking data.
• Build and optimize data engineering solutions on Databricks and Spark using Python, PySpark, Scala, and SQL.
• Implement Delta Lake pipelines and modern Databricks capabilities, including Unity Catalog and Structured Streaming.
• Develop robust data models that integrate marketplace and retail data across domains.
• Automate complex data preparation and transformation processes for reliable data delivery and analytics.
• Optimize, monitor, and troubleshoot distributed data jobs for performance and reliability.
• Integrate data pipelines with downstream analytics and BI solutions like Looker with stakeholders.

Skills

Databricks

Apache Spark

Delta Lake

Python

SQL

Data modeling

Data transformation

CI/CD for data engineering

Workflow orchestration

Education

Bachelor's degree in Computer Science / Software Engineering / Data Engineering

Tools

Databricks

Apache Spark

Delta Lake

Unity Catalog

Databricks Workflows

Airflow

Looker

Job description

Responsibilities

• Design, develop, and maintain scalable, production-grade ETL/ELT pipelines and data models processing high-volume e-commerce, marketplace, retail, and tracking data.


• Build and optimize data engineering solutions on Databricks and Apache Spark, using Python, PySpark, Scala, and SQL as appropriate.


• Implement and maintain Delta Lake pipelines and modern Databricks capabilities, including Unity Catalog, Databricks Workflows, and Structured Streaming.


• Develop robust data models that integrate marketplace and retail data, ensuring data consistency, quality, and availability across business domains.


• Automate complex data preparation and transformation processes to enable reliable data delivery and self-service analytics.


• Optimize, monitor, and troubleshoot distributed data jobs, ensuring pipeline performance, reliability, and scalability.


• Integrate data pipelines with downstream analytics and BI solutions, including Looker, while collaborating with business and technical stakeholders to translate requirements into effective data solutions.

Qualifications

• Completed university degree in Computer Science, Software Engineering, Business Informatics, Data Engineering, or a comparable quantitative field.


• Several years of professional experience in Data Engineering or Data Platform Development, ideally within e-commerce or digital commerce environments.


• Strong hands-on expertise in Databricks, Apache Spark and Delta Lake, including building and maintaining scalable batch and streaming data pipelines.


• Excellent knowledge of Python and SQL, with experience in data transformation, data modeling, and processing large datasets.


• Practical experience with workflow orchestration tools such as Databricks Workflows or Apache Airflow, as well as CI/CD practices for data engineering.


• Understanding of data quality, governance, monitoring, and performance optimization in distributed data platforms.


• Strong communication skills in English and Polish, with readiness to work in a hybrid model in Katowice

Nice to Have

• Experience with Unity Catalog and Structured Streaming in Databricks.


• Familiarity with integrating data pipelines into BI and analytics ecosystems, particularly Looker.


• Experience with AI/ML integrations within Databricks.


• Knowledge of data engineering challenges in international marketplace and retail environments.

About OBI Smart Technologies

WHO ARE WE:

We are a joint venture between OBI and Reply Group, responsible for co-designing, building and operating mission-critical digital platforms for commerce, customer service, and omnichannel retail.

OUR MISSION:

"We unite technology leadership with deep retail vision to implement standardized processes and scalable digital products that drive efficient support for one of Europe’s largest DIY retailers. Leveraging proven best practices, we advance the internationalization of products and the digital mindset of our partners, delivering consistent and business-critical solutions to support the targets of our customer."\