Senior Data Operations & Platform Reliability Engineer

AVN DIGITAL PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Benefits offered by this job

Attractive company benefits

Job summary

Avensys is seeking a Senior Data Operations Engineer to support, monitor, and optimize enterprise data platforms and pipelines in Singapore. You will ensure reliability, data quality, and performance across batch and real-time environments.

You will work with Data Engineers, Cloud/Infrastructure, and business teams to resolve production issues, automate tasks, and maintain runbooks, while participating in on-call support when required.

Qualifications

• Strong hands-on experience with SQL and Python.
• Experience supporting ETL/ELT pipelines and data integration workflows.
• Experience with Apache Spark / PySpark for large-scale data processing.
• Experience with orchestration tools such as Apache Airflow, Azure Data Factory, Databricks Workflows.
• Good knowledge of Linux/Unix and Shell scripting.
• Experience with cloud environments (Azure/AWS/GCP).
• Experience with Databricks, Snowflake, Azure Synapse, BigQuery or similar platforms.
• Good understanding of Data Lakes, Data Warehouses, and Lakehouse architectures.
• Experience with Git, CI/CD, Jenkins, Azure DevOps, or equivalent.
• Familiarity with monitoring/logging tools like Splunk, Grafana, Prometheus, CloudWatch, or Azure Monitor.

Responsibilities

• Monitor and manage ETL/ELT pipelines and data workflows.
• Ensure pipelines meet SLA, availability, and performance targets.
• Troubleshoot pipeline failures, data quality issues, and incidents.
• Perform root cause analysis and implement permanent solutions.
• Monitor data platforms and infrastructure using monitoring tools.
• Support production deployments and data platform changes.
• Collaborate with Data Engineers, Cloud/Infra teams, and stakeholders to resolve issues.
• Perform data validation, reconciliation, and quality checks.
• Optimize pipelines and SQL queries for performance and reliability.
• Develop automation scripts using Python, SQL, or Shell.
• Maintain runbooks and operational documentation.
• Participate in incident, problem, and change management.

Skills

SQL

Python

ETL/ELT

Spark / PySpark

Airflow / Data Factory

Linux / Shell

Cloud Platforms (Azure/AWS/GCP)

Databricks / Snowflake / Synapse / Big

Tools

Git

CI/CD (Jenkins, Azure DevOps)

Monitoring tools (Grafana/Splunk)

Databricks

Azure / AWS / GCP

Job description

Avensys is seeking a Senior Data Operations Engineer to support, monitor, and optimize enterprise data platforms and pipelines in Singapore. You will ensure reliability, data quality, and performance across batch and real-time environments.

You will work with Data Engineers, Cloud/Infrastructure, and business teams to resolve production issues, automate tasks, and maintain runbooks, while participating in on-call support when required.