Devops Engineer - Data Automation

Don Nelson Recruitment Limited; Hong Kong; On-site; HKD 700,000 - 950,000; Full time

Job summary

Don Nelson Technology Limited and NP Solution Limited are seeking a senior Azure Databricks infra architect in Hong Kong to design scalable, secure platforms for enterprise insurance workloads. You will drive IaC, CI/CD, and governance across cross-functional teams.

You will implement Terraform-driven provisioning, automate deployments with GitHub Actions, and ensure regulatory compliance (RBAC, encryption, PDPO). Strong collaboration with security and data teams is essential.

Qualifications

• Bachelor’s degree in Computer Science, IT, or related discipline.
• 5+ years in Azure cloud platform design and administration, with a focus on Databricks for insurance data workloads.

Responsibilities

• Design & Manage Platforms: Build secure, scalable Azure Databricks environments for enterprise-wide insurance data transformation.
• Cross-Team Collaboration: Collaborate with architects, engineers, and security teams to define standards and integrate with legacy systems and third-party platforms.
• Infrastructure as Code: Use Terraform to automate provisioning and configuration of Azure and Databricks resources.
• Automation & Monitoring: Implement GitHub Actions to automate deployment, monitoring, and incident response.
• Performance Optimization: Monitor platform health, anticipate scaling needs, and tune data pipelines for analytics workloads.
• Security & Compliance: Enforce RBAC, managed identities, encryption, and policy compliance for regulated environments.
• Data Governance Integration: Oversee integration of Informatica tools for metadata management and data lineage.
• Documentation: Maintain architecture, network, security, and operational procedures for audits.
• Troubleshooting & Reliability: Diagnose issues and drive continuous improvements for platform stability.
• Innovation & Enhancement: Stay updated on Azure, Databricks, and DevOps advancements for Hong Kong’s insurance sector.

Skills

Azure Databricks

Terraform

GitHub Actions

Data Factory

Data Lake Storage Gen2

Informatica

RBAC

Key Vault

NSG

CI/CD

Incident response

Performance tuning

Education

Bachelor’s degree in Computer Science or related

Tools

Azure

Databricks

Job description

Design & Manage Platforms: Build secure, scalable, and high-performance Azure Databricks environments tailored for enterprise-wide insurance data transformation.

Cross-Team Collaboration: Work closely with architects, engineers, and security teams to define infrastructure standards and ensure seamless integration with legacy systems, cloud sources, and third-party platforms.

Infrastructure as Code: Use tools like Terraform to automate provisioning and configuration of Azure and Databricks resources, aligning with DevOps best practices.

Automation & Monitoring: Implement GitHub Actions to automate environment deployment, monitoring, and incident response for greater consistency and efficiency.

Performance Optimization: Monitor platform health and resource usage, anticipate scaling needs, and fine-tune performance for data pipelines and analytics workloads.

Security & Compliance: Enforce enterprise and regulatory standards such as RBAC, managed identities, encryption, PDPO, GDPR, and insurance-specific policies.

Data Governance Integration: Oversee integration of Informatica tools for metadata management, data lineage tracking, and compliance validation.

Documentation: Maintain detailed records of infrastructure architecture, network topology, security settings, and operational procedures to support audits and team handovers.

Troubleshooting & Reliability: Diagnose infrastructure issues, perform root‑cause analysis, and drive continuous improvements for platform stability.

Innovation & Enhancement: Stay updated on Azure, Databricks, and DevOps advancements, recommending upgrades to improve platform capabilities and support business goals in Hong Kong’s life and general insurance sectors.

Requirements:

Education: Bachelor’s degree in Computer Science, IT, or a related discipline.

Experience: 5+ years in Azure cloud platform design and administration, with a focus on Azure Databricks for insurance data workloads.

Technical Expertise:

Strong skills in provisioning and managing Databricks clusters and workspaces for various data types.

Experience integrating Azure Data Factory and Data Lake Storage Gen2 with Databricks.

Proficient in Terraform for infrastructure automation.

Familiarity with Informatica tools for data governance and cataloguing.

Deep understanding of security protocols (RBAC, NSG, managed identities, Key Vault), monitoring, and cost control in regulated environments.

Hands‑on experience with GitHub Actions for CI/CD automation.

Proven ability in incident response and performance tuning for critical data platforms.

Soft Skills: Excellent documentation, collaboration, and communication abilities to support both technical and business stakeholders.

**This position is offered through a strategic partnership between Don Nelson Technology Limited and NP Solution Limited.