Senior Data Engineer: Azure, Databricks & AI Pipelines

Techforce Group Limited; Hong Kong; On-site; HKD 600,000 - 900,000; Full time

Job summary

Techforce Group Limited is hiring a data engineer to design, build and operate scalable data pipelines on an Azure-based platform. You will work with Databricks and Python to ingest, transform and deliver enterprise data across multiple domains, while collaborating with analysts and AI teams on advanced analytics use cases.

The role requires 5+ years of data engineering experience, strong SQL and cloud skills, and familiarity with Power BI or similar BI tools.

Qualifications

• 5+ years of experience in data engineering.
• Strong hands-on experience with Databricks.
• Advanced proficiency in Python for data engineering and pipeline development.
• Strong SQL skills with experience working with large-scale datasets.
• Experience working within the Azure Data ecosystem, including services such as Azure Data Factory and cloud storage solutions.
• Experience with Power BI or other BI/reporting tools is advantageous.

Responsibilities

• Build scalable data pipelines to ingest, transform, and deliver enterprise data across multiple domains.
• Develop data solutions with Databricks and Python to process large datasets and support modern data products and reporting.
• Support enterprise transformation initiatives by ensuring data is migrated, transformed, and accessible for business use.
• Partner with business analysts and technical teams to translate requirements into scalable technical solutions.
• Own end-to-end data engineering delivery from requirements to deployment and support.
• Monitor and optimise data processing workloads for reliability, scalability and performance.
• Collaborate on platform best practices to enhance engineering standards and delivery quality.
• Support CI/CD, automation and platform engineering in a modern Azure-based data environment.
• Enable AI and advanced analytics use cases by building quality data foundations for ML/AI initiatives.
• Collaborate with AI engineering teams to prepare and operationalise data assets for AI-powered solutions.

Skills

Data engineering

Tools

Databricks

Python

SQL

Azure Data ecosystem

Power BI

Job description

Techforce Group Limited is hiring a data engineer to design, build and operate scalable data pipelines on an Azure-based platform. You will work with Databricks and Python to ingest, transform and deliver enterprise data across multiple domains, while collaborating with analysts and AI teams on advanced analytics use cases.

The role requires 5+ years of data engineering experience, strong SQL and cloud skills, and familiarity with Power BI or similar BI tools.