Databricks Consultant IRC284922

Hitachi Vantara Corporation; City of Edinburgh; On-site; GBP 50,000 - 70,000; Full time

Job summary

A digital engineering leader in the United Kingdom is seeking a disciplined Data Engineer for a high-priority architectural optimization project within a Databricks Lakehouse environment. The role focuses on enhancing environment efficiency, refining data governance, and achieving operational cost-intelligence. Ideal candidates will have expertise in SQL and Python, with demonstrable experience in Data Engineering, and a strong understanding of Cloud Data Warehouse administration.

Benefits

Inclusive culture of acceptance and belonging

Continuous learning and development opportunities

Work-life balance and flexibility

High-trust organization values

Qualifications

• Demonstrable experience in Data Engineering, focusing on cloud-scale environments.
• Expert-level command of SQL and Python.
• Understanding of Cloud Data Warehouse administration and Lakehouse design principles.
• Ability to document technical implementations and generate actionable insights.

Responsibilities

• Execute data review and cleansing operations for architectural integrity.
• Architect and validate scripts and workflows in Python and SQL.
• Implement archival and replication-control processes.
• Quantify financial and technical impacts of changes for reports.
• Support Pipeline Rebuild Proof of Concept for scalability analysis.
• Deliver comprehensive handover documentation for operational continuity.

Skills

SQL

Python

Data Engineering

Cloud-scale environments

Job description

Description

We are seeking a disciplined Data Engineer to lead a high-priority architectural optimization project within a Databricks Lakehouse environment. The primary objective of this engagement is to implement strategic recommendations aimed at enhancing environment efficiency, refining data governance, and achieving significant operational cost‑intelligence.

Requirements

• Demontrable experience in Data Engineering, with a specific focus on cloud-scale environments.
• Expert-level command of SQL and Python
• A robust understanding of Cloud Data Warehouse administration, compute management, and Lakehouse design principles.
• Proven ability to document technical implementations and extrapolate performance data into actionable business insights.

Job responsibilities

• Execute comprehensive data review and cleansing operations across diverse Databricks workspaces to ensure architectural integrity.
• Architect and validate sophisticated scripts and automated workflows in Python and SQL to enforce rigorous data‑retention and cluster‑usage protocols.
• Implement advanced archival and replication‑control processes.
• Quantify the financial and technical impact of environmental changes, contributing detailed analysis to the overall project Cost‑Optimization Reports.
• Support the Pipeline Rebuild Proof of Concept, specifically analyzing the impact of structural changes (e.g., SCD Type 1 vs. Type 2 migrations) to determine scalability and ROI across the wider data estate.
• Provide expert technical input during project reviews and deliver comprehensive handover documentation to ensure long‑term operational continuity.

What we offer

Culture of caring.

At GlobalLogic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you'll experience an inclusive culture of acceptance and belonging, where you'll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders.

Learning and development.

We are committed to your continuous learning and development. You'll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career at GlobalLogic. With our Career Navigator tool as just one example, GlobalLogic offers a rich array of programs, training curricula, and hands‑on opportunities to grow personally and professionally.

Interesting & meaningful work.

GlobalLogic is known for engineering impact for and with clients around the world. As part of our team, you'll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem‑solving skills as you help clients reimagine what's possible and bring new solutions to market. In the process, you'll have the privilege of working on some of the most cutting‑edge and impactful solutions shaping the world today.

Balance and flexibility.

We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!

High‑trust organization.

We are a high‑trust organization where integrity is key. By joining GlobalLogic, you're placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world's largest and most forward‑thinking companies. Since 2000, we've been at the forefront of the digital revolution - helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.