Azure Databricks Data Engineer — PySpark & ETL Expert

Techforce Group Limited; Hong Kong Island; On-site; HKD 480,000 - 720,000; Full time

Job summary

TransUnion Limited is seeking a data engineer to join a highly skilled team delivering a major enterprise transformation across a modern Azure data platform. You will work with experienced engineers on large-scale data initiatives to modernise reporting capabilities and build scalable cloud-based data solutions using Azure Databricks, PySpark and Azure Data Factory.

The role offers opportunities to tackle complex data challenges, collaborate with business stakeholders and contribute to a visible

Qualifications

• Hands-on experience with Azure Databricks and PySpark.
• Experience building data pipelines with Azure Data Factory and Azure Data Lake.
• Strong SQL skills with large-scale datasets.
• Experience with testing, data validation, troubleshooting or production support.
• Exposure to Power BI or other analytics platforms is advantageous.
• 4–6 years of experience in Data Engineering, ETL or Data Integration.

Responsibilities

• Design, build and maintain scalable ETL and data integration pipelines across multiple business domains.
• Develop and optimise data solutions using Azure Databricks, PySpark and Azure Data Factory.
• Support enterprise reporting and data transformation initiatives by migrating, validating and enhancing critical data assets.
• Collaborate with business stakeholders, analysts and technical teams to gather requirements and deliver scalable data solutions.
• Participate in testing, validation, troubleshooting and production support activities across data pipelines and reporting solutions.
• Contribute to architecture discussions, code reviews and continuous improvement of engineering standards.
• Support Power BI reporting, dashboard enhancements and analytics initiatives where required.
• Ensure data quality, integrity and reliability through validation, monitoring and issue resolution.

Skills

Azure Databricks

PySpark

Azure Data Factory

SQL

Power BI

Tools

Azure Data Lake

Job description

TransUnion Limited is seeking a data engineer to join a highly skilled team delivering a major enterprise transformation across a modern Azure data platform. You will work with experienced engineers on large-scale data initiatives to modernise reporting capabilities and build scalable cloud-based data solutions using Azure Databricks, PySpark and Azure Data Factory.

The role offers opportunities to tackle complex data challenges, collaborate with business stakeholders and contribute to a visible