DataOps Engineer

EFG International; Singapore; On-site; SGD 70,000 - 90,000; Full time

Job summary

EFG International is looking for a Data Ops Engineer in Singapore. This role is essential for operational ownership of data pipelines and services during Asian hours. Key responsibilities include designing, implementing, and optimizing data pipelines, and applying CI/CD practices. Ideal candidates will have strong experience in SQL, Python, and data engineering roles, along with a solid understanding of CI/CD practices and cloud data platforms like Azure. Join us to enhance our data operations environment and support mission-critical data workflows.

Qualifications

• Experience in data engineering and data operations roles.
• Proven hands-on experience with SQL, Python, PySpark, and Databricks.
• Knowledge of micro-services architecture, API management, and observability is highly desirable.
• Solid understanding of CI/CD platforms and processes.
• Familiarity with database design.

Responsibilities

• Take operational ownership of specific data services.
• Design, implement, and optimize data pipelines in batch and streaming mode.
• Collaborate with cross-functional teams to review governance.
• Maintain high standards of data quality, reliability and performance.

Skills

SQL

Python

Data Engineering

CI/CD

PySpark

Databricks

Micro-services Architecture

Azure DevOps

GitLab CI

GitHub Actions

Tools

Azure Cloud Platform

Job description

General Info

• Department: Data Ops Engineer
• Work time Percentage: 100%
• Location: Singapore

Team Overview

• DataOps Team is responsible for seamless integration, release and monitoring of mission critical data pipelines and workflows.
• Currently based in Geneva, we are expanding our global footprint by establishing a virtual team presence in Singapore.
• Reporting to the local IT Head of Applications, the role will be a key pillar in our follow‑the‑sun support model, ensuring continuous operational excellence across Asia and Europe time zones.
• Our data platform is evolving into a more converged stack, unifying data streams and batches. We are expanding into a cloud‑based lakehouse and a microservice‑based data streaming integration model supporting business critical integrations.
• To support team activity Python, SQL and CI/CD are essential skills. This role requires a rigorous approach to documentation and procedure development.
• The team is responsible for building, testing, deploying and monitoring the operating part of the platform.

Tasks and Responsibilities

• Take operational ownership of specific data services (change management, quality assurance, SLA, SOP).
• Track and ensure operations continuity of critical data pipelines across the group during Asian hours, adopting a follow‑the‑sun support model.
• Design, implement and optimise data pipelines in batch and streaming mode.
• Follow and apply CI/CD practices to automate and streamline deployments and integrations.
• Create, maintain and improve documentation and operational procedures as part of operational ownership.
• Collaborate with cross‑functional teams to review governance and improve integration operations.
• Maintain high standards of data quality, reliability and performance.
• Stay current with advancements in data engineering, of dataops tech stack, to support continuous improvement.

Qualifications

• Experience in data engineering and data operations roles.
• Proven hands‑on experience with SQL, Python, PySpark and Databricks.
• Knowledge of micro‑services architecture, API management and observability is highly desirable.
• Solid understanding of CI/CD platforms and processes (e.g., Azure DevOps, GitLab CI, GitHub Actions).
• Experience with cloud data platforms (Azure preferred).
• Demonstrated ability to produce rigorous, clear and comprehensive documentation and procedures.
• Familiarity with database design.
• Excellent problem‑solving skills and attention to detail.
• Effective communication and collaboration skills.

Personal Attributes

• Responsible and reliable, especially during critical operational periods.
• Rigorous and methodical in documentation and process creation.
• Motivated and goal‑oriented.
• Curious, enthusiastic, creative and proactive.
• Passionate about analytics and technology, with a strong desire to learn and grow.
• Fluent in spoken and written English.