Databricks Data Engineer: Scale & Migrate Pipelines

Xebia Group; Polska; Remote; PLN 180,000 - 300,000; Full time

Job summary

Xebia Group in Poland is seeking an experienced Data Engineer to design and implement scalable data pipelines on Databricks. You will standardize existing pipelines and migrate legacy ones while collaborating with data architects and analytics teams.

Proficiency in Python, dbt, and cloud platforms (Azure, AWS, GCP) is required. You will also help on onboarding datasets from US and APAC regions and contribute to future Data Science and MLOps foundations.

Qualifications

• Proven experience as a Data Engineer.
• Hands-on Databricks experience with production pipelines.
• Strong Python skills for data processing.
• Experience with dbt and data transformation layers.
• Solid data pipeline design, orchestration, and scalability.
• Experience with cloud data platforms (Azure/AWS/GCP).
• Knowledge of data modeling (medallion, dimensional).
• Experience handling financial or market data.
• Familiar with CI/CD for data pipelines.
• Ability to work independently and own data solutions.

Responsibilities

• Design scalable data pipelines on Databricks.
• Standardize existing pipelines using gold standard approach.
• Migrate and refactor legacy data pipelines.
• Develop data transformations using dbt and Python.
• Onboard new datasets (US, APAC regions).
• Collaborate with data architects and analytics teams.
• Contribute to Data Science and MLOps foundations.
• Work under capacity constraints and optimize performance.

Skills

Databricks

Python

dbt

Data pipelines

Cloud platforms

Data modeling

CI/CD for data

Migrations

Team collaboration

Tools

Azure

AWS

GCP

Job description

Xebia Group in Poland is seeking an experienced Data Engineer to design and implement scalable data pipelines on Databricks. You will standardize existing pipelines and migrate legacy ones while collaborating with data architects and analytics teams.

Proficiency in Python, dbt, and cloud platforms (Azure, AWS, GCP) is required. You will also help on onboarding datasets from US and APAC regions and contribute to future Data Science and MLOps foundations.