Data Engineer: Scalable Pipelines on Spark & Azure

Sigma Software; Warszawa; On-site; PLN 180,000 - 260,000; Full time

Job summary

Sigma Software in Warszawa is seeking a Data Engineer to design and develop scalable, high-performance data platforms that power analytics and decision-making.

You will build pipelines with Spark/pySpark and Databricks, shape cloud data solutions on Azure (Data Factory, Synapse, Data Lake Storage), and model data to support reporting. Collaboration with analysts and engineers is essential, with strong SQL and Python skills expected.

Qualifications

• 4+ years of hands-on experience in data engineering or building data processing platforms.
• Strong SQL skills and solid Python experience for pipeline development.
• Experience with distributed processing frameworks (Apache Spark/pySpark, Databricks preferred).
• Practical experience designing and implementing pipelines in cloud environments (Azure preferred).
• Experience with production-scale analytical systems and data modeling.
• Understanding of ETL/ELT design, dimensional modeling, and data warehousing principles.
• Experience with modern data lake architectures and formats (Parquet, JSON).
• Familiarity with workflow orchestration tools (Airflow).
• Experience with database development and optimization.
• Ability to design scalable solutions with minimal supervision.
• Strong collaboration and communication skills.
• Professional proficiency in English.

Responsibilities

• Design and develop scalable, reliable data platforms and pipelines for analytics and operations.
• Implement data processing workflows using distributed frameworks (Apache Spark/pySpark, Databricks).
• Evolve the organization’s cloud data platform leveraging Azure technologies (Data Factory, Synapse, Event Hub, Azure Data Lake Storage).
• Model data to support analytics, reporting, and downstream consumption.
• Integrate and process data from multiple sources ensuring quality and consistency.
• Monitor and optimize pipeline performance, ensuring reliability and scalability.
• Collaborate with analysts, scientists, and engineers to translate requirements into solutions.
• Improve data engineering standards, testing, and operational reliability.
• Evaluate and introduce new tools and technologies in the data engineering ecosystem.

Skills

SQL

Python

English

Collaboration

Tools

Apache Spark

pySpark

Databricks

Azure Data Factory

Azure Synapse

Azure Data Lake Storage

Airflow

Job description

Sigma Software in Warszawa is seeking a Data Engineer to design and develop scalable, high-performance data platforms that power analytics and decision-making.

You will build pipelines with Spark/pySpark and Databricks, shape cloud data solutions on Azure (Data Factory, Synapse, Data Lake Storage), and model data to support reporting. Collaboration with analysts and engineers is essential, with strong SQL and Python skills expected.