Senior Data Engineer: PySpark & Python | ADF, Krakow Hybrid

Ampstek; Kraków; Hybrid; PLN 180,000 - 260,000; Full time

Job summary

Ampstek is seeking experienced Data Engineers in Kraków to design, build, and optimize scalable data pipelines using PySpark and Python. The role focuses on processing large-scale enterprise data with Azure Data Factory orchestration and strong data quality practices.

Ideal candidates bring 6–10 years IT experience, 4–5 years in PySpark/Python, and a solid foundation in modern data architectures. The team collaborates with data scientists, analysts, and architects in a hybrid Kraków office.

Qualifications

• 6–10 years of overall IT experience.
• 4–5 years hands-on PySpark and Python development.
• Strong understanding of data engineering principles and modern data pipeline architectures.
• PySpark (Spark SQL, DataFrames, performance tuning).
• Python scripting and application development.
• ADF orchestration and pipeline development.
• Strong knowledge of data optimization techniques: partitioning, caching, joins, and query optimization.
• Experience with large-scale distributed data processing systems.
• Strong analytical and problem-solving skills.
• Good understanding of SQL, database concepts, and data modeling.

Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and Python.
• Build and optimize ETL/ELT workflows for large data volumes.
• Write efficient, reusable, high-performance code with focus on optimization.
• Process and manage structured and unstructured data from multiple sources.
• Implement best practices related to data engineering, performance tuning, and code quality.
• Develop, orchestrate, and monitor data workflows using ADF.
• Collaborate with Data Scientists, Analysts, Solution Architects, and stakeholders.
• Ensure data quality, reliability, and integrity across data platforms.
• Troubleshoot and resolve performance bottlenecks in data processing pipelines.
• Contribute to data architecture discussions and continuous improvement initiatives.

Skills

PySpark

Python

Data engineering

SQL

Azure Data Factory

Azure Databricks

Data pipelines

Performance tuning

Tools

Azure Data Factory

Azure Databricks

Job description

Ampstek is seeking experienced Data Engineers in Kraków to design, build, and optimize scalable data pipelines using PySpark and Python. The role focuses on processing large-scale enterprise data with Azure Data Factory orchestration and strong data quality practices.

Ideal candidates bring 6–10 years IT experience, 4–5 years in PySpark/Python, and a solid foundation in modern data architectures. The team collaborates with data scientists, analysts, and architects in a hybrid Kraków office.