Data Engineer (DATABRICKS / PYSPARK)

Sigmasoftware2

Poland

On-site

PLN 120,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Sigmasoftware2 in Poland is looking for a Data Engineer to develop and maintain large-scale data pipelines. You will work with Databricks, PySpark, and SQL to transform, validate, and optimize data and help implement Data Lakehouse solutions following best practices.

The role requires hands-on experience with PySpark, Delta Lake, and Medallion Architecture, plus strong English skills and collaboration with cross-functional teams to deliver reliable data platforms.

Qualifications

  • 2+ years of experience in Big Data development and database design.
  • Strong hands-on experience with SQL.
  • Strong Python development skills.
  • Hands-on experience with PySpark.
  • Experience developing and maintaining data pipelines in Databricks.
  • Experience with Delta Lake.
  • Experience with Medallion Architecture (Bronze, Silver, Gold layers).
  • Strong analytical and problem-solving skills.
  • Intermediate or higher English level.

Responsibilities

  • Develop and maintain data pipelines for processing large volumes of data in batch and near real-time environments.
  • Work with Databricks, PySpark, and SQL to transform, validate, and optimize data.
  • Support implementation of Data Lakehouse solutions following engineering standards and best practices.
  • Build, test, and automate ETL processes and data workflows.
  • Improve data quality, organization, and reliability across platforms.
  • Collaborate with engineers, analysts, and stakeholders to deliver scalable solutions.
  • Troubleshoot, optimize, and monitor data pipelines.
  • Stay up to date with modern data engineering technologies.
  • Ensure deliverables meet quality standards and project requirements.

Skills

SQL
Python
PySpark
Databricks
Delta Lake
Medallion Architecture
Big Data
English (Intermediate+)
AWS S3
Data pipelines

Tools

Databricks
PySpark
SQL
Python
Delta Lake
Medallion Architecture
AWS S3

Job description

  • Develop and maintain data pipelines for processing large volumes of data in batch and near real-time environments
  • Work with Databricks, PySpark, and SQL to transform, validate, and optimize data
  • Support implementation of Data Lakehouse solutions following engineering standards and best practices
  • Build, test, and automate ETL processes and data workflows
  • Improve data quality, organization, and reliability across platforms
  • Collaborate with engineers, analysts, and stakeholders to deliver scalable solutions
  • Troubleshoot, optimize, and monitor data pipelines
  • Stay up to date with modern data engineering technologies
  • Ensure deliverables meet quality standards and project requirements
  • 2+ years of experience in Big Data development and database design
  • Strong hands-on experience with SQL
  • Strong Python development skills
  • Hands-on experience with PySpark
  • Experience developing and maintaining data pipelines in Databricks
  • Experience with Delta Lake
  • Experience with Medallion Architecture (Bronze, Silver, Gold layers)
  • Strong analytical and problem-solving skills
  • Intermediate or higher English level
  • WILL BE A PLUS
  • Experience with AWS services, including S3
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer (DATABRICKS / PYSPARK)
Data Engineer (DATABRICKS / PYSPARK)

Sigma Software • Warszawa

On-site
PLN 180,000 - 280,000
Databricks Data Engineer
Databricks Data Engineer

RemoDevs • Warszawa, Kraków

On-site
PLN 180,000 - 280,000
Senior Data Engineer (Databricks)
Senior Data Engineer (Databricks)

SNI • Wrocław

On-site
PLN 180,000 - 280,000
PySpark Data Engineer
PySpark Data Engineer

BraverIT • Kraków

Hybrid
PLN 180,000 - 240,000
Lead Data Engineer
Lead Data Engineer

SNI • Województwo mazowieckie

On-site
PLN 120,000 - 180,000
Data Engineer
Data Engineer

Sigma Software • Województwo mazowieckie

On-site
PLN 180,000 - 260,000
Senior Data Engineer
Senior Data Engineer

Backbase • Kraków

On-site
PLN 180,000 - 240,000
Senior Data Engineer (Investment Data)
Senior Data Engineer (Investment Data)

Luxoft • Polska

Hybrid
PLN 307,000 - 482,000
Junior Data Engineer (Databricks)
Junior Data Engineer (Databricks)

N-iX LTD • Kraków, Wrocław

On-site
PLN 120,000 - 190,000
Data Engineer with Databricks
Data Engineer with Databricks

ITConnect • Polska

Hybrid
PLN 180,000 - 240,000
Top locations