DataOps Engineer

EFG International AG; Singapore; On-site; SGD 70,000 - 90,000; Full time

Job summary

A global financial services firm is seeking a DataOps professional in Singapore. The role involves operational ownership of data services, optimizing data pipelines, and collaborating with teams across time zones. Key skills include Python, SQL, and CI/CD practices. The ideal candidate has a solid background in data engineering and is rigorous in documentation. Candidates should be fluent in English and possess excellent problem-solving skills. The position supports a dynamic work environment focused on continuous improvement and operational excellence.

Qualifications

• Hands-on experience with SQL, Python, and data engineering.
• Knowledge of CI/CD platforms like Azure DevOps is required.
• Fluency in spoken and written English.

Responsibilities

• Take operational ownership of specific data services.
• Design and optimize data pipelines in batch and streaming mode.
• Collaborate with cross-functional teams to improve operations.

Skills

SQL

Python

CI/CD

Data engineering

PySpark

Databricks

Microservices architecture

API management

Observability

Cloud data platforms

Database design

Tools

Azure DevOps

GitLab CI

GitHub Actions

Cloud platforms

Job description

Job Description

The DataOps Team is responsible for seamless integration, release and monitoring of mission critical data pipelines and workflows. Currently based in Geneva, we are expanding our global footprint by establishing a virtual team presence in Singapore. Reporting to the local IT Head of Applications, the role will be a key pillar in our follow‑the‑sun support model, ensuring continuous operational excellence across Asia and Europe timezones. The data platform is evolving into a more converged stack, unifying data streams and batches, and we are expanding into a cloud based lakehouse and a microservice‑based data streaming integration model supporting business‑critical integrations. To support team activity, Python, SQL and CI/CD are essential skills. This role requires a rigorous approach to documentation and procedure development. The team is responsible for building, testing, deploying and monitoring the operating part of the platform.

Introduction to the Team

• DataOps Team is responsible for seamless integration, release and monitoring of mission critical data pipelines and workflows.
• Currently based in Geneva, we are expanding our global footprint by establishing a virtual team presence in Singapore.
• Reporting to the local IT Head of Applications, the role will be a key pillar in our follow‑the‑sun support model, ensuring continuous operational excellence across Asia and Europe timezones.
• Our data platform is evolving into a more converged stack, unifying data streams and batches. We are expanding into a cloud based lakehouse and a microservice‑based data streaming integration model supporting business‑critical integrations.
• To support team activity Python, SQL and CI/CD are essential skills. This role requires a rigorous approach to documentation and procedure development.
• The team is responsible for building, testing, deploying and monitoring the operating part of the platform.

Tasks and Responsibilities

• Take operational ownership of specific data services (change management, quality assurance, SLA, SOP).
• Track and ensure operations continuity of critical data pipelines across the group during Asian hours, adopting a follow‑the‑sun support model.
• Design, implement, and optimize data pipelines in batch and streaming mode.
• Follow and apply CI/CD practices to automate and streamline deployments and integrations.
• Create, maintain, and improve documentation and operational procedures as part of operational ownership.
• Collaborate with cross‑functional teams to review governance and improve integration operations.
• Maintain high standards of data quality, reliability, and performance.
• Stay current with advancements in data engineering and data‑ops tech stack to support continuous improvement.

Requirements and Qualifications

• Experience in data engineering and data operations roles.
• Proven hands‑on experience with SQL, Python, PySpark and Databricks.
• Knowledge of micro‑services architecture, API management and observability is highly desirable.
• Solid understanding of CI/CD platforms and processes (e.g., Azure DevOps, GitLab CI, GitHub Actions).
• Experience with cloud data platforms (Azure preferred).
• Demonstrated ability to produce rigorous, clear, and comprehensive documentation and procedures.
• Familiarity with database design.
• Excellent problem‑solving skills and attention to detail.
• Effective communication and collaboration skills.

Personal Attributes

• Responsible and reliable, especially during critical operational periods.
• Rigorous and methodical in documentation and process creation.
• Motivated and goal‑oriented.
• Curious, enthusiastic, creative, and proactive.
• Passionate about analytics and technology, with a strong desire to learn and grow.
• Fluent in spoken and written English.