Data Engineer (DBX, dbt), Regular

Webellian; Warszawa; Hybrid; PLN 180,000 - 260,000; Full time

Job summary

Webellian in Warsaw is seeking a Data Engineer to help build a Central Data Platform for a major global insurer. You will design end-to-end data pipelines on Databricks, manage ETL/ELT processes, and collaborate with data scientists and engineers across teams.

You will work with Azure Cloud technologies, GitHub-based CI/CD, and modern data tooling. A strong background in Python, SQL, and PySpark, plus a degree in a technical field, will help you succeed in this role.

Qualifications

• Strong experience with Databricks (DBX).
• Advanced knowledge of Python with libraries such as Pydantic (advantage).
• Solid experience in building and optimizing ETL/ELT pipelines.
• Very good knowledge of SQL and relational databases.
• Experience with PySpark.
• Familiarity with dbt is a plus.
• Experience with Azure Data Services is an advantage.
• Knowledge of CI/CD practices and tools (e.g. GitHub).
• General understanding of infrastructure, orchestration, and IT security principles.

Responsibilities

• Contribute by building a training dataset for document processing and decision support.
• Design and implement end-to-end data pipelines (ingestion, transformation, storage, and consumption).
• Prepare and maintain high-quality training datasets for machine learning models.
• Work with large-scale data on a modern cloud data platform (Databricks).
• Apply best practices in data engineering, testing, and deployment.
• Collaborate closely with data scientists, engineers, and business stakeholders.
• Continuously improve performance, reliability, and automation of data workflows.

Skills

Databricks

Python

SQL

PySpark

CI/CD

GitHub

Infrastructure concepts

Security principles

Education

Bachelor’s or Master’s degree in a technical field

Tools

DBT

Terraform

Azure Data Services

Databricks

GitHub

Job description

Webellian is a well-established Digital Transformation and IT consulting company committed to creating a positive impact for our clients. We strive to make a meaningful difference in diverse sectors such as insurance, banking, healthcare, retail, and manufacturing. Our passion for cutting-edge and disruptive technologies, as well as our shared values and strong principles, are what motivate us. We are a community of engineers and senior advisors who work with our clients across industries, playing a deep and meaningful role in accelerating and realizing their vision and strategy.

About the position

The project focuses on building a Central Data Platform for one of the biggest globally operating insurance company. It involves over 80 specialists divided into multiple teams, working together to prepare deep insights over integrated data. Tech stack includes Databricks, DBT, dltHub, PowerBI, GitHub and Terraform, everything hosted in Azure Cloud.
As a Data Engineer in this project you will be responsible for ensuring optimal and technically integral ETLs developed. You will have access to LLM based tools. Currently, we are also discussing data consumption through Genie Spaces, with preparation of data with use of Ontology.

Goals and challenges

• Contribute by building a training dataset for document processing and decision support
• Design and implement end-to-end data pipelines (ingestion, transformation, storage, and consumption)
• Prepare and maintain high-quality training datasets for machine learning models
• Work with large-scale data on a modern cloud data platform (Databricks)
• Apply best practices in data engineering, testing, and deployment
• Collaborate closely with data scientists, engineers, and business stakeholders
• Continuously improve performance, reliability, and automation of data workfl

Hard skills we are looking for

• Strong experience withDatabricks (DBX)
• Advanced knowledge ofPython(experience with libraries such asPydanticis a plus;PydanticAIis a strong advantage)
• Solid experience in building and optimizingETL/ELT pipelines
• Very good knowledge ofSQLand relational databases
• Experience withPySpark
• Familiarity withdbtis a plus
• Experience with Azure Data Services is an advantage
• Knowledge of CI/CD practices and tools (e.g. GitHub)
• General understanding of infrastructure, orchestration, and IT security principles

Soft Skills & Experience

• Proven experience inData Engineering(Regular level)
• Bachelor’s or Master’s degree in a technical field (e.g. Computer Science, Engineering) or equivalent experience
• Fluent English (written and spoken)
• DevOps mindset ("you build it, you run it")
• Ability to understand complex requirements and translate them into actionable solutions
• Strong communication skills and ability to work with cross-functional teams
• Attention to detail, especially regarding data quality and business logic
• Proactive attitude, ownership, and willingness to learn new technologies
• Experience in the insurance domain is a plus

What we offer

• Benefits such as private medical care, group insurance, Multisport card
• There are English classes available
• Hybrid work (at least 1 day/2 months on-site) in Warsaw (Mokotów)
• Opportunity to work with excellent professionals
• High standards of work and focus on the quality of code
• New technologies in use;
• Continuously learning and growth
• International team
• Pinball, PlayStation & much more (on-site)
• Join a growing team of dedicated professionals!

We love to pass on the knowledge to grow excellence, speak our minds without playing politics, and just enjoy hanging around together. If you share our passions - we want to meet you!