Senior Databricks Data Engineer: Scalable Pipelines & MLOps

Xebiacee; Polska; On-site; PLN 140,000 - 200,000; Full time

Benefits offered by this job

EU region work permit required

Job summary

Xebia is seeking an experienced Data Engineer to design and implement scalable data pipelines on Databricks. You will standardize pipelines, migrate legacy systems, and develop data transformations using dbt and Python.

Work with cloud platforms (Azure, AWS, GCP), collaborate with data architects, and contribute to data science foundations while optimizing for performance and cost. EU region work permit is required.

Qualifications

• Proven experience as a data engineer with end-to-end data pipelines.
• Hands-on Databricks experience with production-grade pipelines.
• Strong Python skills for data processing.
• Experience with dbt and data transformation layers.
• Understanding of data pipeline design, orchestration, and scalability.
• Experience migrating legacy pipelines and working with cloud data platforms.
• Knowledge of data modeling (medallion architecture, dimensional models).
• Familiarity with CI/CD practices for data pipelines.

Responsibilities

• Design and implement scalable data pipelines on Databricks.
• Standardize existing pipelines using a gold-standard approach.
• Migrate and refactor legacy data pipelines.
• Develop data transformations using dbt and Python.
• Onboard new datasets across regions (US, APAC).
• Collaborate with data architects and analytics teams.
• Contribute to Data Science and MLOps foundations.
• Optimize performance and resource usage under capacity constraints.

Skills

Data Engineer

Databricks

Python

dbt

CI/CD for data pipelines

Cloud platforms

Data modeling

Independent work

Communication

Tools

Databricks

dbt

Azure

AWS

GCP

Job description

Xebia is seeking an experienced Data Engineer to design and implement scalable data pipelines on Databricks. You will standardize pipelines, migrate legacy systems, and develop data transformations using dbt and Python.

Work with cloud platforms (Azure, AWS, GCP), collaborate with data architects, and contribute to data science foundations while optimizing for performance and cost. EU region work permit is required.