Senior Data Operations Engineer

AVN DIGITAL PTE. LTD.; Hong Kong; On-site; HKD 550,000 - 900,000; Full time

Benefits offered by this job

Competitive salary and benefits

Job summary

Avensys is a leading IT professional services company seeking a Senior Data Operations Engineer to support, monitor, troubleshoot, and optimize enterprise data platforms and pipelines across batch and real-time processing environments.

The role focuses on reliability, data quality, and performance, requiring collaboration with Data Engineers, cloud/infrastructure, and business teams to resolve production issues and implement permanent improvements. Occasional on-call support may be required.

Qualifications

• Strong hands-on experience with SQL and Python.
• Experience supporting ETL/ELT pipelines and data integration workflows.
• Experience with enterprise-scale data platforms in production environments.
• Familiarity with data lakes, data warehouses and lakehouse architectures.

Responsibilities

• Monitor and manage ETL/ELT pipelines and data workflows in production.
• Ensure SLA, availability, and performance of data pipelines.
• Troubleshoot pipeline and data quality issues; perform RCA and implement solutions.
• Collaborate with data engineers, cloud/infrastructure, applications, and business stakeholders.
• Develop automation scripts using Python, SQL, or shell scripting.

Skills

Data Operations

SQL & Python

ETL/ELT pipelines

Root cause analysis

Incident management

Tools

Apache Spark

Apache Airflow

Azure Data Factory

Databricks

Snowflake

Azure Synapse

BigQuery

Linux/Shell

Git / CI/CD

Jenkins / Azure DevOps

Splunk / Grafana / Prometheus

Cloud platforms (AWS/Azure/GCP)

Job description

Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success we have evolved to become one of the top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail, and supply chain.

We are currently looking to hire Senior Data Operations Engineer. This is an exciting opportunity to expand your skill set, achieve job satisfaction and work-life balance. More details as below.

Senior Data Operations Engineer – Job Description

Role Overview

We are looking for a Senior Data Operations Engineer to support, monitor, troubleshoot, and optimize enterprise data platforms and pipelines. The role focuses on ensuring the reliability, availability, data quality, and performance of data operations across batch and real-time processing environments.

Key Responsibilities

• Monitor and manage ETL/ELT pipelines, data workflows, scheduled jobs, and production data processes.
• Ensure data pipelines meet defined SLA, availability, and performance requirements.
• Troubleshoot and resolve pipeline failures, data quality issues, job failures, and production incidents.
• Perform root cause analysis (RCA) and implement permanent solutions for recurring issues.
• Monitor data platforms, applications, jobs, and infrastructure using appropriate monitoring and alerting tools.
• Support production deployments, releases, and data platform changes.
• Work closely with Data Engineers, Cloud/Infrastructure teams, Application teams, and business stakeholders to resolve production issues.
• Perform data validation, reconciliation, quality checks, and exception handling.
• Optimize data pipelines and SQL queries for improved performance and reliability.
• Develop automation scripts using Python, SQL, Shell scripting, or similar technologies.
• Maintain operational documentation, support procedures, and runbooks.
• Participate in incident, problem, and change management processes.
• Support batch and real-time data processing environments.
• Identify opportunities to automate repetitive operational tasks and improve platform stability.
• Participate in on-call/24x7 production support, where required.

Required Technical Skills

• Strong experience in Data Operations, Data Engineering, or Production Support.
• Strong hands-on experience with SQL and Python.
• Experience supporting ETL/ELT pipelines and data integration workflows.
• Experience with Apache Spark / PySpark.
• Experience with orchestration tools such as Apache Airflow, Azure Data Factory, Databricks Workflows, or equivalent.
• Good knowledge of Linux/Unix and Shell scripting.
• Experience with Azure, AWS, or GCP cloud environments.
• Experience with Databricks, Snowflake, Azure Synapse, BigQuery, or similar data platforms.
• Good understanding of Data Lakes, Data Warehouses, and Lakehouse architectures.
• Experience with Git, CI/CD, Jenkins, Azure DevOps, or equivalent.
• Familiarity with monitoring/logging tools such as Splunk, Grafana, Prometheus, CloudWatch, Azure Monitor, or equivalent.

Data Operations & Reliability

• Strong understanding of SLA/SLO, incident management, problem management, and change management.
• Experience with data pipeline monitoring, alerting, and failure recovery.
• Ability to analyze application and system logs to identify the root cause of issues.
• Experience with data reconciliation and data quality monitoring.
• Knowledge of backup, recovery, high availability, and disaster recovery concepts.
• Ability to handle multiple production incidents and prioritize issues based on business impact.

Preferred Skills

• Experience with Kafka or other real-time streaming technologies.
• Knowledge of Docker and Kubernetes.
• Experience with Terraform / Infrastructure as Code.
• Exposure to DataOps, MLOps, or LLMOps.
• Basic understanding of AI/ML data pipelines and Generative AI workloads.
• Knowledge of data governance, security, and compliance practices.

Experience

• 5–8+ years of experience in Data Operations, Data Engineering, Production Support, or a related role.
• Strong experience supporting enterprise-scale data platforms in production environments.
• Experience working in an operational/support environment with strict SLA and incident-resolution requirements.

WHAT’S ON OFFER

You will be remunerated with an excellent base salary and entitled to attractive company benefits. Additionally, you will get the opportunity to enjoy a fun and collaborative work environment, alongside a strong career progression.

Privacy Statement: Data collected will be used for recruitment purposes only. Personal data provided will be used strictly in accordance with the relevant data protection law and Avensys' privacy policy.