Hybrid Data Engineer: Spark, Python & BigQuery (GCP)

Albany Beck; Kraków; Hybrid; PLN 180,000 - 240,000; Full time

Job summary

Albany Beck in Kraków is seeking an experienced Data Engineer to join a cross-functional data team supporting a major banking client. Hybrid role with regular in-office days and remote collaboration.

You will design and optimize scalable data pipelines using Scala, Python and Spark, build in Google Cloud Platform BigQuery, and work with UK stakeholders to deliver reliable data solutions and high-quality analytics.

Qualifications

• Strong hands-on programming with Scala and/or Python.
• Proven experience using Apache Spark for large-scale data processing.
• Strong experience with Google Cloud Platform (GCP), including BigQuery.
• Strong SQL skills for data transformation and reporting.

Responsibilities

• Design, develop and maintain scalable data pipelines and ETL/ELT processes using Scala, Python and Apache Spark.
• Build and optimise data processing solutions within Google Cloud Platform (GCP), particularly BigQuery.
• Develop and maintain data integration processes across multiple data sources and enterprise platforms.
• Write efficient, maintainable SQL queries to support data transformation, validation and reporting requirements.
• Ensure data pipelines meet performance, scalability, reliability and data quality standards.
• Work closely with data architects, data modellers, analysts and business stakeholders to translate requirements into effective technical solutions.
• Apply SDLC best practices across version control, testing, documentation and deployment.
• Troubleshoot data processing and pipeline issues and identify opportunities to improve existing data engineering solutions.
• Contribute to the development of reusable data engineering frameworks, standards and best practices.
• Collaborate effectively across distributed technology teams and with UK-based stakeholders.

Skills

Scala

Python

Data pipelines

SQL

GCP

Tools

Apache Spark

BigQuery

Google Cloud Platform (GCP)

CI/CD

Job description

Albany Beck in Kraków is seeking an experienced Data Engineer to join a cross-functional data team supporting a major banking client. Hybrid role with regular in-office days and remote collaboration.

You will design and optimize scalable data pipelines using Scala, Python and Spark, build in Google Cloud Platform BigQuery, and work with UK stakeholders to deliver reliable data solutions and high-quality analytics.