Data Engineer

Albany Beck; Kraków; Hybrid; PLN 90,000 - 130,000; Full time

Job summary

Albany Beck is seeking an experienced Data Engineer in Kraków to support a major banking client within its Commercial Banking Data Technology function. The role is hybrid, requiring about 6 office days per month.

You will design, develop and optimise scalable data pipelines using Scala, Python, Spark and BigQuery, collaborating with UK stakeholders to drive data transformation and quality initiatives.

Qualifications

• Strong hands-on programming experience with Scala and/or Python.
• Experience with Google Cloud Platform (GCP), BigQuery.
• Strong SQL skills for data transformation and reporting.
• Experience designing, developing and implementing ETL/ELT processes and scalable data pipelines.
• Experience with large, complex datasets and enterprise-scale data platforms.
• Knowledge of SDLC best practices and modern engineering standards.
• Experience integrating data across multiple sources and systems.
• Experience with CI/CD and automated testing.
• Familiarity with Agile delivery environments.

Responsibilities

• Design, develop and maintain scalable data pipelines using Scala, Python and Apache Spark.
• Build and optimise data processing within Google Cloud Platform, especially BigQuery.
• Develop and maintain data integration across sources and platforms.
• Write efficient SQL queries to support transformation and reporting.
• Ensure pipelines meet performance, scalability, reliability and quality standards.
• Collaborate with data architects, analysts and stakeholders to translate requirements.
• Apply SDLC practices across version control, testing and deployment.
• Troubleshoot pipeline issues and improve engineering solutions.
• Contribute to reusable data engineering frameworks and best practices.
• Work with distributed teams including UK-based stakeholders.

Skills

Scala

Python

SQL

Data pipelines

ETL/ELT design

Analytical skills

Tools

Google Cloud Platform (GCP)

BigQuery

Apache Spark

Job description

Albany Beck is a consultancy specialising in delivering high-quality change, technology, data and regulatory solutions across financial services. We partner with leading banks, asset managers, insurers and other financial institutions to provide experienced consultants who can support complex business and transformation programmes.

Client Deployment Role Description

We are looking for an experienced Data Engineer to work with us here at Albany Beck, supporting one of our major banking clients within its Commercial Banking Data Technology function. Based in Kraków, Poland, this is a hybrid position requiring approximately 6 days per month in the office.

The successful candidate will join a cross-functional data team responsible for designing, developing and optimising data engineering solutions across multiple business and technology value streams.

The role requires a hands-on Data Engineer with strong programming capability and practical experience developing scalable data pipelines using technologies including Scala, Python and Apache Spark. Strong experience with Google Cloud Platform (GCP), particularly BigQuery, will also be important.

The successful candidate will contribute to wider data transformation, analytics and data quality initiatives while working closely with technical teams and UK-based stakeholders.

Key Responsibilities

• Design, develop and maintain scalable data pipelines and ETL/ELT processes using Scala, Python and Apache Spark.
• Build and optimise data processing solutions within Google Cloud Platform (GCP), particularly BigQuery.
• Develop and maintain data integration processes across multiple data sources and enterprise platforms.
• Write efficient, maintainable SQL queries to support data transformation, validation and reporting requirements.
• Ensure data pipelines meet required performance, scalability, reliability and data quality standards.
• Work closely with data architects, data modellers, analysts and business stakeholders to translate requirements into effective technical solutions.
• Apply software development lifecycle (SDLC) best practices across version control, testing, documentation and deployment.
• Troubleshoot data processing and pipeline issues and identify opportunities to improve existing data engineering solutions.
• Contribute to the development of reusable data engineering frameworks, standards and best practices.
• Collaborate effectively across distributed technology teams and with UK-based stakeholders.

Key Skills & Experience

• Strong hands-on programming experience with Scala and/or Python.
• Strong experience working with Google Cloud Platform (GCP), including BigQuery.
• Strong SQL skills, including query development, data transformation and optimisation.
• Demonstrable experience designing, developing and implementing ETL/ELT processes and scalable data pipelines.
• Experience working with large, complex datasets and enterprise-scale data platforms.
• Good understanding of software development lifecycle processes and modern engineering best practices.
• Experience integrating data across multiple sources, platforms and systems.
• Strong analytical, troubleshooting and problem-solving capabilities.
• Ability to collaborate effectively across cross-functional and geographically distributed teams.
• Previous experience within Financial Services, ideally Commercial or Corporate Banking.
• Experience working with cloud-based data architectures and modern enterprise data platforms.
• Knowledge of data governance, data quality and regulatory requirements.
• Experience with CI/CD pipelines and automated testing.
• Experience working within Agile delivery environments.
• Experience working within large, complex enterprise technology environments.