Principal Data Engineer IRC304740

Hitachi Vantara Corporation; Polska; Remote; PLN 180,000 - 260,000; Full time

Job summary

GlobalLogic, a Hitachi Group Company, is seeking a data engineer to join a dedicated Features Team partnering with Barclays' engineering leadership. You will help migrate legacy data infrastructure to a modern cloud environment, building scalable dbt and Python-based pipelines and integrating with Databricks.

You will design and implement complex data pipelines, optimize SQL workloads, and collaborate with stakeholders to translate business requirements into robust technical solutions, ensuring

Qualifications

• Strong hands-on data engineering experience delivering production-grade solutions.
• Ability to design, implement and optimise complex data pipelines independently.
• Strong SQL and programming (Python preferred); capable of building reusable and scalable code.

Responsibilities

• Develop, maintain, and execute dbt and Python scripts to migrate database tables and views and integrate them with Databricks.
• Participate in data migration activities, ensuring reliable and efficient transformation of legacy data assets.
• Work closely with Barclays stakeholders to operate and support DIH and other internal data migration tools.
• Assist in the design and implementation of data transformation pipelines within the Databricks ecosystem.
• Validate migrated datasets and ensure data quality, consistency, and completeness throughout the migration process.
• Troubleshoot and resolve issues related to data transformation, pipelines, and integrations.
• Contribute to documentation related to data migration processes, dbt models, and pipeline architecture.
• Collaborate with cross-functional teams including data engineers, architects, and business stakeholders to deliver migration tasks.

Skills

Data engineering

SQL

Python

Orchestration tools

Cloud platforms

Stakeholder communication

English communication

Tools

Databricks

dbt Core

Teradata

Hadoop

Job description

Description

The Client is one of the major banks in the UK. This project is a strategic initiative to migrate legacy data infrastructure, including approximately 500 BTEQ scripts and 1,100 tables, to a modern cloud environment. GlobalLogic is establishing a dedicated Features Team to partner with the Client's engineering leadership. Our team will focus on replatforming business logic, updating data pipelines and repointing SAS dependencies. Core technical requirements for the role include cloud stack knowledge, Python, SQL and DBT. We're interested in problem solvers with the right mindset and can-do attitude to shape a strong team and build a long-term collaborative partnership.

Requirements

• Strong hands-on data engineering experience delivering production-grade solutions.
• Ability to design, implement and optimise complex data pipelines independently.
• Strong SQL and programming (Python preferred); capable of building reusable and scalable code.
• Experience with modern orchestration tools (e.g. Airflow, Step Functions, etc.).
• Hands-on experience on any cloud platform (AWS preferred or equivalent).
• Ability to proactively analyse existing processes, suggest improvements, and drive technical solutions end-to-end.
• Comfortable engaging with stakeholders, understanding business requirements, and translating them into technical design.
• Good written and verbal English communication skills.

Good to have:

• Experience with dbt Core for data transformations.
• Exposure to migrating legacy data platforms (Teradata, Hadoop, SAS) into modern cloud architectures.
• Familiarity with Databricks or similar platforms for advanced analytics.
• Understanding of data security, regulatory, and risk management principles in banking.

Job responsibilities

• Develop, maintain, and execute dbt and Python scripts to migrate database tables and views and integrate them with Databricks.
• Participate in data migration activities, ensuring reliable and efficient transformation of legacy data assets.
• Work closely with Barclays stakeholders to operate and support DIH and other internal data migration tools.
• Assist in the design and implementation of data transformation pipelines within the Databricks ecosystem.
• Validate migrated datasets and ensure data quality, consistency, and completeness throughout the migration process.
• Troubleshoot and resolve issues related to data transformation, pipelines, and integrations.
• Contribute to documentation related to data migration processes, dbt models, and pipeline architecture.
• Collaborate with cross-functional teams including data engineers, architects, and business stakeholders to deliver migration tasks.

#LI-ZK1 #LI-Remote

What we offer

Empowering Projects: With 500+ clients spanning diverse industries and domains, we provide an exciting opportunity to contribute to groundbreaking projects that leverage cutting-edge technologies. As a team, we engineer digital products that positively impact people's lives.

Empowering Growth: We foster a culture of continuous learning and professional development. Our dedication is to provide timely and comprehensive assistance for every consultant through our dedicated Learning & Development team, ensuring their continuous growth and success.

DE&I Matters: At GlobalLogic, we deeply value and embrace diversity. We are dedicated to providing equal opportunities for all individuals, fostering an inclusive and empowering work environment.

Career Development: Our corporate culture places a strong emphasis on career development, offering abundant opportunities for growth. Regular interactions with our teams ensure their engagement, motivation, and recognition. We empower our team members to pursue their career goals with confidence and enthusiasm.

Comprehensive Benefits: In addition to equitable compensation, we provide a comprehensive benefits package that prioritizes the overall well-being of our consultants. We genuinely care about their health and strive to create a positive work environment.

Flexible Opportunities: At GlobalLogic, we prioritize work-life balance by offering flexible opportunities tailored to your lifestyle. Explore relocation and rotation options for diverse cultural and professional experiences in different countries with our company.

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world's largest and most forward-thinking companies. Since 2000, we've been at the forefront of the digital revolution - helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.