Principal Data Engineer IRC304741

GlobalLogic; Poland; On-site; PLN 140,000 - 190,000; Full time

Benefits offered by this job

Learning & Development support

Diversity & Inclusion

Career development

Flexible relocation options

Job summary

GlobalLogic, a Hitachi Group Company, is partnering with Barclays to migrate and modernize data assets from Teradata to a Databricks-based environment. You will transform legacy SQL scripts into dbt models, build scalable data pipelines, and support data migration across cloud platforms.

You will collaborate with technical leads and stakeholders, develop dbt and Python scripts, validate data quality, and contribute to documentation and pipeline architecture.

Qualifications

• Hands-on experience with dbt for data transformation and pipeline development.
• Strong Python programming skills for data processing and scripting.
• Experience with Databricks in a data engineering or analytics environment.
• Experience with Cloud Platforms (AWS or Azure).
• Experience migrating SQL-based systems from Teradata.
• Understanding of ETL/ELT pipelines and data transformation frameworks.
• Ability to collaborate with technical leads and external stakeholders.
• Good written and verbal English communication skills.

Responsibilities

• Develop, maintain, and execute dbt and Python scripts to migrate tables and views and integrate with Databricks.
• Participate in data migration activities, ensuring reliable transformation of legacy data assets.
• Work with Barclays stakeholders to operate and support DIH and other internal data migration tools.
• Assist in designing data transformation pipelines within the Databricks ecosystem.
• Validate migrated datasets and ensure data quality across migration processes.
• Troubleshoot and resolve data transformation, pipelines, and integration issues.
• Contribute to documentation on data migration processes, dbt models, and architecture.
• Collaborate with data engineers, architects, and business stakeholders to deliver migration tasks.

Skills

dbt

Python

Databricks

Cloud Platforms

SQL

ETL/ELT

English communication

Tools

Databricks

Teradata

dbt

AWS/Azure

Job description

Cloud Platforms, Databricks, Python, Scripting, Teradata, Transition and Migration

The Client is one of the major banks in the UK. The project focuses on migrating and modernizing data assets from legacy platforms to a Databricks-based data environment. The team works closely with the client to transform existing Teradata scripts into dbt models, implement scalable data pipelines and support data migration using internal tools and cloud services.

Requirements

• Hands-on experience with dbt (data build tool) for data transformation and pipeline development.
• Strong Python programming skills for data processing and scripting.
• Practical experience working with Databricks in a data engineering or analytics environment.
• Experience with Cloud Platforms (AWS or Azure).
• Experience working with SQL-based systems, including migration from legacy platforms such as Teradata.
• Understanding of data migration, ETL/ELT pipelines, and data transformation frameworks.
• Ability to work collaboratively with technical leads and external stakeholders.
• Good written and verbal English communication skills.

Job responsibilities

• Develop, maintain, and execute dbt and Python scripts to migrate database tables and views and integrate them with Databricks.
• Participate in data migration activities, ensuring reliable and efficient transformation of legacy data assets.
• Work closely with Barclays stakeholders to operate and support DIH and other internal data migration tools.
• Assist in the design and implementation of data transformation pipelines within the Databricks ecosystem.
• Validate migrated datasets and ensure data quality, consistency, and completeness throughout the migration process.
• Troubleshoot and resolve issues related to data transformation, pipelines, and integrations.
• Contribute to documentation related to data migration processes, dbt models, and pipeline architecture.
• Collaborate with cross-functional teams including data engineers, architects, and business stakeholders to deliver migration tasks.

What we offer

Empowering Projects: With 500+ clients spanning diverse industries and domains, we provide an exciting opportunity to contribute to groundbreaking projects that leverage cutting-edge technologies. As a team, we engineer digital products that positively impact people's lives.

Empowering Growth: We foster a culture of continuous learning and professional development. Our dedication is to provide timely and comprehensive assistance for every consultant through our dedicated Learning & Development team, ensuring their continuous growth and success.

DE&I Matters: At GlobalLogic, we deeply value and embrace diversity. We are dedicated to providing equal opportunities for all individuals, fostering an inclusive and empowering work environment.

Career Development: Our corporate culture places a strong emphasis on career development, offering abundant opportunities for growth. Regular interactions with our teams ensure their engagement, motivation, and recognition. We empower our team members to pursue their career goals with confidence and enthusiasm.

Comprehensive Benefits: In addition to equitable compensation, we provide a comprehensive benefits package that prioritizes the overall well-being of our consultants. We genuinely care about their health and strive to create a positive work environment.

Flexible Opportunities: At GlobalLogic, we prioritize work-life balance by offering flexible opportunities tailored to your lifestyle. Explore relocation and rotation options for diverse cultural and professional experiences in different countries with our company.

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world's largest and most forward-thinking companies. Since 2000, we've been at the forefront of the digital revolution - helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.