Data Engineer (UK IT SAAS, Hybrid)

ConnectOS; Mandaluyong; On-site; PHP 900,000 - 1,400,000; Full time

Benefits offered by this job

Medical coverage

Paid vacation leave

Competitive salary package

Financial assistance program

13th month pay

Office perks

Job summary

ConnectOS is seeking a data engineer to design, develop, and support scalable data pipelines using Apache Spark and Databricks. You will manage data in Parquet and Delta Tables, participate in governance with Unity Catalog, and collaborate on data models with senior engineers.

You should be proficient in Python and familiar with Azure data services (ADF, ADLS, Synapse). The role emphasizes cloud fundamentals, security, and scalable architectures within a Monday–Friday schedule in Manila.

Qualifications

• Proven experience in data engineering, including the design, development, and support of scalable data pipelines.
• Strong understanding of Parquet, Delta Lake and Delta Tables formats.
• Hands-on experience with Apache Spark and DataFrame APIs for data processing and transformation.
• Familiarity with Databricks notebook development, workflows, and scheduled jobs.
• Knowledge of data governance and Unity Catalog is advantageous.
• Proficient in Python for clean, maintainable code and collaboration on codebases.
• Experience with Microsoft Azure data services (ADF, ADLS, Synapse, etc.).
• Solid cloud computing fundamentals including scalability, cost optimisation, and security.

Responsibilities

• Build and maintain data pipelines using Spark and Databricks.
• Work with Parquet and Delta Table formats for structured data.
• Assist with Unity Catalog governance and access control.
• Collaborate with architects to implement data models and transformation logic.
• Write maintainable Python code and participate in testing and reviews.
• Investigate data quality and performance issues with the team.

Skills

Data engineering

Apache Spark

Python

Databricks

Unity Catalog

Cloud fundamentals

Tools

Parquet

Delta Lake

Delta Tables

Databricks notebooks

Azure Data Factory

Azure Data Lake Storage

Synapse Analytics

Git

Azure DevOps

Job description

Schedule: Monday to Friday (11:00AM - 8:00PM PHT)

What are we looking for?

Skills Required:

• Proven experience in data engineering, including the design, development, and support of scalable data pipelines.
• Strong understanding of modern data storage formats, such as Parquet, with exposure to Delta Lake and Delta Tables.
• Hands-on experience with Apache Spark, including the use of DataFrame APIs for data processing and transformation.
• Familiarity with Databricks, including notebook development, workflow orchestration, and scheduled job management.
• Knowledge of data governance and cataloguing solutions, such as Unity Catalog or equivalent platforms, is advantageous.
• Proficient in Python, with the ability to develop clean, maintainable code, navigate existing codebases, and contribute effectively to ongoing development initiatives.
• Practical experience with Microsoft Azure data services, including Azure Data Factory, Azure Data Lake Storage, Synapse Analytics, or similar cloud-based solutions.
• Solid understanding of cloud computing fundamentals, including scalability, cost optimisation, security, and operational best practices.
• Experience using Azure DevOps to support software delivery processes, including build and release pipelines, deployment approvals, and release monitoring.

Nice to Have:

• Strong knowledge of CI/CD practices, including automated testing, code quality validation, environment promotion, release governance, deployment automation, and rollback strategies.
• Experience working in Agile environments, leveraging Git-based version control, pull requests, code reviews, and established branching and deployment standards.
• Desirable experience with C#/.NET, DuckDB, AWS services, streaming technologies such as Apache Kafka or Azure Event Hubs, and data transformation or data quality frameworks.

What will you do?

• Build and maintain data pipelines using Apache Spark and Databricks, following agreed designs and team standards.
• Work with structured and semi-structured data in Parquet and Delta Table formats.
• Support the management of data assets within Unity Catalogue, including basic governance, organisation, and access control.
• Collaborate with architects and senior engineers to implement data models, ingestion patterns, and transformation logic.
• Write clear, maintainable Python code and contribute to testing and code reviews.
• Investigate and help resolve data quality, pipeline, and performance issues, with support from the wider team.
• Take an active role in Azure DevOps delivery practices, including Git-based branching, pull requests, build and release pipelines, CI/CD deployment processes, and clear tracking of work through boards and delivery artefacts.
• Support the wider engineering team as required, and remain open to learning across different parts of the platform.

Join the awesome team and enjoy these benefits & perks

• Medical, Dental Coverage and Life insurance from day 1 of employment
• Paid Vacation and Sick Leave (with Quarterly Sick Leave Conversion)
• Competitive salary package and annual appraisal
• Financial Assistance Program
• Mandatory Government Benefits and 13th Month Pay
• Complimentary Sleeping Quarters, Coffee at no cost
• Complimentary Office Fitness and Wellness Facilities at no cost
• Regular Company Events, Work Life Balance, and Career growth opportunities
• Accessible location at the heart of Metro Manila --- the Mega Tower, EDSA

ConnectOS is certified as a Great Place to Work and is a top-rated Philippines employer of choice.

#ConnectOSCareers #JoinConnectOS #ConnectOSTech

Equal Employment Statement

Employment decisions at ConnectOS will be conducted without consideration of factors such as age', race, color, religion, gender, disability status, sexual orientation, gender identity or expression, genetic information, and marital status. ConnectOS ensures the full confidentiality of the data it processes.