Data Engineer L3

SID Global Solutions; Pasig; On-site; PHP 600,000 - 1,200,000; Full time

Job summary

SID Global Solutions is seeking a data engineer in the Philippines to design and build scalable data storage solutions, pipelines, and transformation processes. You will optimize jobs, automate tasks, and perform testing to ensure platform reliability.

You will collaborate with cross-functional teams and document analytics workflows to support governance and SDLC compliance. You will leverage Databricks and Azure, apply SQL and PySpark to data warehouse concepts, and contribute to best practices

Qualifications

• Experience on data projects is a MUST (at least 1 end-to-end project).
• Experience in using Databricks and Azure (certifications preferred).
• Experience in SQL, Python (PySpark).
• Knowledge in Data Warehouse and Data Mart concepts and query optimization techniques.

Responsibilities

• Designs and builds data storage solutions including database objects and data structures, data ingestion pipelines.
• Develops data transformation, cleansing, and preparation processes.
• Perform job optimization/automation via code enhancement, configuration, or implementation of new tools/technology
• Perform unit testing and system integration testing.
• Maintain and monitor platform stability and performance of EDP. Execute updates, patches, and other activities required to maintain and enhance operations.
• Ensures compliance with governance standards of the platform, security policies, and SDLC processes.
• Collaborate with cross-functional teams to identify data needs and opportunities for improvement
• Develop and maintain documentation related to data engineering and analytics processes and procedures
• Perform Proof of Concept on new integration and analytic patterns and solutions
• Contribute to best practices and standards for the data engineering team

Skills

Databricks

Azure

SQL

Python (PySpark)

Data Warehouse

End-to-end data projects

Query optimization

Tools

Databricks

Azure

Job description

• Designs and builds data storage solutions including database objects and data structures, data ingestion pipelines
• Develops data transformation, cleansing, and preparation processes.
• Perform job optimization/automation via code enhancement, configuration, or implementation of new tools/technology
• Perform unit testing and system integration testing.
• Maintain and monitor platform stability and performance of EDP. Execute updates, patches, and other activities required to maintain and enhance operations.
• Ensures compliance with governance standards of the platform, security policies, and SDLC processes.
• Collaborate with cross-functional teams to identify data needs and opportunities for improvement
• Develop and maintain documentation related to data engineering and analytics processes and procedures
• Perform Proof of Concept on new integration and analytic patterns and solutions
• Contribute to best practices and standards for the data engineering team Must-Have Skills & Experience
• Experience on Data projects is a MUST (at least 1 end to end project)
• Experience in using Databricks and Azure (certifications preferred)
• Experience in SQL, Python (Pyspark)
• Knowledge in Data Warehouse and Data Mart concepts and query optimization techniques
• Preferably local resource that can report to BDO office Nice-To-Have Skills & Experience