Data Engineer III: End-to-End Pipelines (Databricks/Azure)

SID Global; Pasig; On-site; PHP 900,000 - 1,300,000; Full time

Job summary

SID Global in Pasig, Metro Manila, is seeking a data engineer to design and build data storage solutions, ingestion pipelines, and transformation processes. You will optimize jobs and ensure robust data operations.

You will work with SQL, Python (PySpark), Databricks, and Azure, contribute to data warehouse concepts, and support governance and SDLC compliance. Local reporting to the BDO office is preferred.

Qualifications

• Experience on Data projects is a MUST (at least 1 end to end project).
• Experience in using Databricks and Azure (certifications preferred).
• Experience in SQL, Python (Pyspark).
• Knowledge in Data Warehouse and Data Mart concepts and query optimization techniques.
• Preferably local resource that can report to BDO office.
• Nice-to-have: familiarity with Power BI.

Responsibilities

• Designs and builds data storage solutions including database objects and data structures, data ingestion pipelines.
• Develops data transformation, cleansing, and preparation processes.
• Perform job optimization/automation via code enhancement, configuration, or implementation of new tools/technology.
• Perform unit testing and system integration testing.
• Maintain and monitor platform stability and performance of EDP. Execute updates, patches, and other activities required to maintain and enhance operations.
• Ensures compliance with governance standards of the platform, security policies, and SDLC processes.
• Collaborate with cross-functional teams to identify data needs and opportunities for improvement
• Develop and maintain documentation related to data engineering and analytics processes and procedures
• Perform Proof of Concept on new integration and analytic patterns and solutions
• Contribute to best practices and standards for the data engineering team

Skills

Data projects

Databricks

Azure

SQL

Python

PySpark

Data Warehouse

Query optimization

End-to-end projects

Tools

Databricks

Azure

Job description

SID Global in Pasig, Metro Manila, is seeking a data engineer to design and build data storage solutions, ingestion pipelines, and transformation processes. You will optimize jobs and ensure robust data operations.

You will work with SQL, Python (PySpark), Databricks, and Azure, contribute to data warehouse concepts, and support governance and SDLC compliance. Local reporting to the BDO office is preferred.