Senior Spark Data Engineer — Remote, Cloud & Big Data Impact

Addepto; Poznań; Hybrid; PLN 210,000 - 330,000; Full time

Benefits offered by this job

Flexible work arrangements

Training & conferences

Private medical care

Equipment provided

20 paid days off

Job summary

Addepto is looking for a Senior Data Engineer (Spark) in Poznań to design, build and optimize high-performance data platforms for automotive, aerospace, and telecom clients. You will work with Spark, Cloudera, Airflow, Iceberg, Python, and AWS to deliver scalable data solutions.

Join a supportive team in a flexible work environment offering remote or office work, competitive compensation, and opportunities to contribute to Databricks partnerships and internal AI initiatives.

Qualifications

• 5+ years of commercial experience with Big Data systems.
• Strong Python or Java/Scala coding skills and OOP.
• Hands-on with Spark, Cloudera, Airflow, Iceberg.
• Experience deploying solutions in cloud environments.
• Fluent English (at least C1).

Responsibilities

• Develop and maintain a high-performance data processing platform for automotive data, ensuring scalability and reliability.
• Design and implement data pipelines that process large volumes of data in both streaming and batch modes.
• Optimize data workflows to ensure efficient ingestion, processing, and storage using Spark, Cloudera, and Airflow.
• Work with data lake technologies (Iceberg) to manage structured and unstructured data efficiently.
• Collaborate with cross-functional teams to understand data requirements and ensure seamless integration of data sources.
• Monitor and troubleshoot the platform, ensuring high availability, performance, and accuracy of data processing.
• Leverage cloud services (AWS) for infrastructure management and scaling of processing workloads.
• Write and maintain high-quality Python (or Java/Scala) code for data processing tasks and automation.

Skills

Python

SQL

Spark

Airflow

AWS

Education

Bachelor's degree in technical or mathematical studies

Tools

Airflow

Cloudera

Iceberg

AWS

Databricks

Kafka

NiFi

Trino

Hudi

Docker

Kubernetes

Java

Scala

Job description

Addepto is looking for a Senior Data Engineer (Spark) in Poznań to design, build and optimize high-performance data platforms for automotive, aerospace, and telecom clients. You will work with Spark, Cloudera, Airflow, Iceberg, Python, and AWS to deliver scalable data solutions.

Join a supportive team in a flexible work environment offering remote or office work, competitive compensation, and opportunities to contribute to Databricks partnerships and internal AI initiatives.