Data Engineer/ Senior Data Engineer - Insurance

EIRE Systems (Hong Kong) Limited; Hong Kong; On-site; HKD 420,000 - 650,000; Full time

Job summary

EIRE Systems (Hong Kong) Limited is seeking a skilled data engineer to design, develop, and maintain ETL/ELT pipelines on Microsoft Azure, including Azure Data Factory and Databricks. You will optimize SQL performance, collaborate with data modelers, and implement CI/CD deployment strategies using Azure DevOps.

You will monitor pipelines, address data quality issues, and coordinate with local IT teams while participating in Agile ceremonies and using JIRA and Confluence for collaboration.

Qualifications

• Over 2 years hands‑on experience with ETL/ELT tooling, Databricks, SQL, and stored procedures.
• Strong SQL tuning/optimization skills.
• Experience with Azure Data Factory and Databricks; familiarity with Azure SQL or SQL Managed Instance.
• Working knowledge of Azure DevOps (Repos, CI/CD pipelines).
• Understanding of data modeling and normalization.
• Experience with Agile methodologies and collaboration tools (JIRA, Confluence, Kanban).
• Vendor management: experience coordinating with external vendors, managing deliverables, and tracking SLAs; ability to engage vendors for data platform needs.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines on Microsoft Azure (Azure Data Factory, Databricks, Azure SQL / Azure SQL Managed Instance).
• Optimize SQL queries and stored procedures for performance, scalability, and reliability.
• Collaborate with data modelers to understand data structures, normalization, and data quality requirements.
• Implement CI/CD pipelines and deployment strategies using Azure DevOps (Repos, pipelines, release management).
• Monitor, troubleshoot, and improve data pipelines; address data quality issues and incidents.
• Coordinate with Office tech team and other local IT teams (architects, BAs, etc.) as needed.
• Participate in Agile ceremonies and use collaboration tools (JIRA, Confluence, Kanban boards).
• Vendor management: experience coordinating with external vendors, managing deliverables, and tracking SLAs; ability to engage vendors for data platform needs.

Skills

ETL/ELT design

SQL performance tuning

Agile collaboration

Vendor management

CI/CD practices

Tools

Azure Data Factory

Databricks

SQL Server/Azure SQL

Azure DevOps

JIRA

Confluence

Job description

Design, develop, and maintain ETL/ELT pipelines on Microsoft Azure (Azure Data Factory, Databricks, Azure SQL / Azure SQL Managed Instance).

Optimize SQL queries and stored procedures for performance, scalability, and reliability.

Collaborate with data modelers to understand data structures, normalization, and data quality requirements.

Implement CI/CD pipelines and deployment strategies using Azure DevOps (Repos, pipelines, release management).

Monitor, troubleshoot, and improve data pipelines; address data quality issues and incidents.

Coordinate with Office tech team and other local IT teams (architects, BAs, etc.) as needed.

Participate in Agile ceremonies and use collaboration tools (JIRA, Confluence, Kanban boards).

Qualifications:

Over 2 years of hands‑on experience with ETL/ELT tooling, Databricks, SQL, and stored procedures.

Strong SQL tuning/optimization skills.

Experience with Azure Data Factory and Databricks; familiarity with Azure SQL or SQL Managed Instance.

Working knowledge of Azure DevOps (Repos, CI/CD pipelines).

Understanding of data modeling and normalization.

Experience with Agile methodologies and collaboration tools (JIRA, Confluence, Kanban).

Vendor management: experience coordinating with external vendors, managing deliverables, and tracking SLAs; ability to engage vendors for data platform needs.