Azure Data Engineer: Databricks, Pipelines & Analytics

PearSon; Polska; Hybrid; PLN 120,000 - 180,000; Full time

Job summary

PearSon is seeking a data engineer in Poland to build and optimize data pipelines using MS Azure services (Data Factory, Databricks, Data Lake Storage) and PySpark. You will transform ingested data and ensure robust, scalable data models with strong SQL design.

Ideal candidates have hands-on programming experience (Python, Java, Scala, R, or .NET/C#), excellent numerical analytics, and a degree in Computer Science or a related field; a Master’s is a plus.

Qualifications

• Previous experience as a data engineer or in a similar role.
• Experience with MS Azure services such as Data Lake Storage, Data Factory, Databricks, Azure SQL Database, Azure Synapse Analytics, Functions.
• Technical expertise with data models, data mining, analytics and segmentation techniques.
• Proficiency in Python, Java, Scala, R, .NET/C#.
• Hands-on experience with SQL database design.
• Strong numerical and analytical skills.

Responsibilities

• Design, build and optimize data pipelines on Azure stack.
• Transform and ingest data for analytics and reporting.
• Collaborate with data scientists and analysts to implement data models.
• Ensure data quality, governance and performance tuning.

Skills

Data engineering experience

Data modeling

Data mining

Analytics

Segmentation techniques

Python

Java

Scala

R

C#/.NET

SQL database design

Education

Bachelor's degree in Computer Science/IT or related field

Master's degree preferred

Tools

Azure Databricks

Azure Data Factory

PySpark

Notebook

Data ingestion

Data transformation

Job description

PearSon is seeking a data engineer in Poland to build and optimize data pipelines using MS Azure services (Data Factory, Databricks, Data Lake Storage) and PySpark. You will transform ingested data and ensure robust, scalable data models with strong SQL design.

Ideal candidates have hands-on programming experience (Python, Java, Scala, R, or .NET/C#), excellent numerical analytics, and a degree in Computer Science or a related field; a Master’s is a plus.