Data Engineer L3

SID Global Solutions; Pasig; On-site; PHP 600,000 - 1,000,000; Full time

Job summary

SID Global Solutions in Pasig, Metro Manila, is seeking a data engineer to design and build data storage solutions, data structures, and ingestion pipelines. You will develop data transformation, cleansing, and preparation processes while ensuring governance and SDLC compliance.

You'll optimize automation, monitor platform performance, perform testing, and collaborate with cross-functional teams to identify data needs and opportunities for improvement.

Qualifications

• Experience on data projects (at least 1 end-to-end project).
• Proficiency with SQL and Python (PySpark).
• Experience with Databricks and Azure; certifications preferred.

Responsibilities

• Designs and builds data storage solutions including database objects and data structures.
• Develops data transformation, cleansing, and preparation processes.
• Perform job optimization/automation via code enhancement and new tools/technology.
• Maintain and monitor platform stability and performance of EDP; execute updates and patches.
• Ensures compliance with governance standards and SDLC processes.
• Collaborate with cross-functional teams to identify data needs and opportunities for improvement.
• Develop and maintain documentation related to data engineering and analytics processes.

Tools

Databricks

Azure

SQL

Python (PySpark)

Data Warehouse concepts

Job description

• Designs and builds data storage solutions including database objects and data structures, data ingestion pipelines
• Develops data transformation, cleansing, and preparation processes.
• Perform job optimization/automation via code enhancement, configuration, or implementation of new tools/technology
• Perform unit testing and system integration testing.
• Maintain and monitor platform stability and performance of EDP. Execute updates, patches, and other activities required to maintain and enhance operations.
• Ensures compliance with governance standards of the platform, security policies, and SDLC processes.
• Collaborate with cross-functional teams to identify data needs and opportunities for improvement
• Develop and maintain documentation related to data engineering and analytics processes and procedures
• Perform Proof of Concept on new integration and analytic patterns and solutions
• Contribute to best practices and standards for the data engineering team Must-Have Skills & Experience
• Experience on Data projects is a MUST (at least 1 end to end project)
• Experience in using Databricks and Azure (certifications preferred)
• Experience in SQL, Python (Pyspark)
• Knowledge in Data Warehouse and Data Mart concepts and query optimization techniques
• Preferably local resource that can report to BDO office Nice-To-Have Skills & Experience