Mid Data Engineer - Python, Spark & GCP Data Pipelines

Capco; Kraków; Hybrid; PLN 180,000 - 240,000; Full time

Job summary

Capco Poland is seeking a Mid Data Engineer to join our growing data engineering team and contribute to scalable data solutions for financial clients.

You will work with modern data technologies and cloud platforms, developing and maintaining data pipelines, processing large datasets, and supporting enterprise-scale data solutions.

This role is ideal for someone with hands-on experience in Python, Spark, Hadoop, Linux, and Google Cloud Platform while collaborating on international projects.

Qualifications

• 2–4+ years of commercial experience in Data Engineering or a similar role.
• Hands-on Python programming experience.
• Experience with Apache Spark and building data processing jobs.
• Experience with Hadoop or distributed data processing ecosystems.
• Strong Linux knowledge and CLI proficiency.
• Commercial experience with Google Cloud Platform (GCP).
• Understanding of ETL/ELT, data pipelines, and transformation concepts.
• Proficiency in SQL and relational data concepts.
• Familiarity with Git and modern software development practices.
• Ability to work in an Agile environment with distributed teams.
• Good communication in English (minimum B2).

Responsibilities

• Design, develop, and maintain scalable data pipelines and processing solutions.
• Build data transformation workflows using Python and Spark.
• Work with large-scale datasets in distributed environments like Hadoop.
• Develop cloud-based data solutions on Google Cloud Platform.
• Create reliable ingestion processes from multiple source systems.
• Implement data transformations, validation, and quality checks.
• Troubleshoot pipelines and optimize performance.
• Work with Linux-based environments, scripting, and deployment tasks.
• Collaborate with data engineers, architects, and analysts to translate requirements.
• Participate in code reviews and follow best practices in data engineering.
• Document data flows, dependencies, configurations, and operations.
• Support deployment, testing, stabilization, and maintenance of data solutions.

Skills

Python

Apache Spark

Hadoop

Linux

GCP

SQL

English (B2)

Git

Agile

Data pipelines

Tools

Google Cloud Platform (GCP)

Apache Airflow

Docker/Kubernetes

BigQuery

Dataproc/Dataflow

Job description

Capco Poland is seeking a Mid Data Engineer to join our growing data engineering team and contribute to scalable data solutions for financial clients.

You will work with modern data technologies and cloud platforms, developing and maintaining data pipelines, processing large datasets, and supporting enterprise-scale data solutions.

This role is ideal for someone with hands-on experience in Python, Spark, Hadoop, Linux, and Google Cloud Platform while collaborating on international projects.