Senior Data Engineer

Nexus Global Pty Limited; Hong Kong; On-site; HKD 900,000 - 1,200,000; Full time

Job summary

Nexus Global Pty Limited is seeking a Senior Data Engineer to deliver high-quality data solutions across diverse business needs. You will build and maintain batch and streaming pipelines, datasets, and data services that are reliable, secure, and easy to consume.

This hands-on role requires designing, testing, deploying, and supporting data products, implementing data quality checks, tuning performance, and collaborating with cross-functional teams while adhering to security and governance

Qualifications

• 8+ years hands-on data engineering experience.
• Proficient in Python and/or Java with advanced SQL.
• Experience with Spark and orchestration tools like Airflow.
• Experience with streaming platforms like Kafka or Pub/Sub.
• Strong engineering discipline: Git, automated testing, CI/CD, observability.
• Experience with cloud data platforms: Azure/AWS/GCP and lakehouse patterns.

Responsibilities

• Build and maintain batch and/or streaming data pipelines end-to-end.
• Develop reusable data transformation patterns and curated datasets for analytics and operations.
• Translate requirements into production-ready data solutions: design, build, test, deploy, support.
• Implement data quality checks, reconciliations, and monitoring/alerting.
• Optimize performance and cost via query tuning and partitioning.
• Maintain documentation, data definitions, and runbooks for pipelines.
• Troubleshoot production issues; perform root cause analyses and fixes.
• Collaborate with upstream/downstream teams to improve interfaces and contracts.
• Follow security and governance expectations for sensitive data and access controls.

Skills

Python

Java

Advanced SQL

Data modelling

Distributed processing

CI/CD

Tools

Spark

Airflow

Kafka

Pub/Sub

Git

CI/CD tooling

Job description

Role purpose: We're hiring a Senior Data Engineer to deliver high-quality data solutions across a range of business demands, building and maintaining pipelines, datasets, and data services that are reliable, secure, and easy to consume. This is a hands‑on engineering role.

Key responsibilities:

• Build and maintain batch and/or streaming data pipelines end‑to‑end: ingest, transform, validate, and publish.
• Develop reusable data transformation patterns and curated datasets for analytics and operational use cases.
• Work from requirements through to production delivery: design, build, test, deploy, and support.
• Implement data quality checks, reconciliations, and monitoring/alerting to keep data trustworthy.
• Optimize performance and cost through query tuning, partitioning, and efficient computer usage.
• Maintain clear documentation, data definitions, and runbook for supported pipelines.
• Troubleshoot production issues, perform root cause analysis, and implement permanent fixes.
• Collaborate with upstream/downstream teams to resolve data issues and improve interfaces/contracts.
• Follow security and governance expectations for sensitive data, access controls, and audibility.
  

Requirements

Required skills and experience:

• Minimum 8 years of strong hands‑on experience delivering data engineering solutions.
• Strong programming skills in Python and/or Java, experience with advanced SQL, and solid data modelling skills.
• Experience with distributed processing, e.g. Spark, and orchestration, e.g. Airflow or equivalent.
• Experience with streaming/event platforms, e.g. Kafka/PubSub, is beneficial; ability to learn quickly if not.
• Strong engineering discipline: Git, code reviews, automated testing, CI/CD, and observability.
• Experience working with cloud data platforms: Azure/AWS/GCP and lake/lake‑house/warehouse patterns.
• Proven ability to manage multiple data requests and priorities effectively and deliver at pace.