Data Engineer

Private Advertiser; Metro Manila; On-site; PHP 600,000 - 1,200,000; Full time

Job summary

Private Advertiser in Metro Manila is seeking a data engineer to design and build data storage solutions, including database objects and ingestion pipelines, and to develop data transformation, cleansing, and preparation processes.

You will perform automation and optimization through code, test integrations, monitor platform stability, and ensure governance, security, and SDLC compliance while collaborating with cross-functional teams. Local reporting to Makati/Ortigas is preferred.

Qualifications

• Experience on Data projects is a MUST (at least 1 end to end project).
• Experience in using Databricks and Azure (certifications preferred).
• Experience in SQL, Python (Pyspark).
• Knowledge in Data Warehouse and Data Mart concepts and query optimization techniques.
• Preferably local resource that can report to Makati/Ortigas office.

Responsibilities

• Designs and builds data storage solutions including database objects and data structures, data ingestion pipelines
• Develops data transformation, cleansing, and preparation processes
• Perform job optimization/automation via code enhancement, configuration, or implementation of new tools/technology
• Perform unit testing and system integration testing
• Maintain and monitor platform stability and performance of EDP. Execute updates, patches, and other activities required to maintain and enhance operations
• Ensures compliance with governance standards of the platform, security policies, and SDLC processes
• Collaborate with cross-functional teams to identify data needs and opportunities for improvement
• Develop and maintain documentation related to data engineering and analytics processes and procedures
• Perform Proof of Concept on new integration and analytic patterns and solutions
• Contribute to best practices and standards for the data engineering team

Skills

SQL

Python (PySpark)

Data pipelines

Data transformation

Automation

Collaboration

Power BI

Tools

Databricks

Azure

Job description

Qualifications:

1. Designs and builds data storage solutions including database objects and data structures, data ingestion pipelines

2. Develops data transformation, cleansing, and preparation processes.

3. Perform job optimization/automation via code enhancement, configuration, or implementation of new tools/technology

4. Perform unit testing and system integration testing.

5. Maintain and monitor platform stability and performance of EDP. Execute updates, patches, and other activities required to maintain and enhance operations.

6. Ensures compliance with governance standards of the platform, security policies, and SDLC processes.

7. Collaborate with cross-functional teams to identify data needs and opportunities for improvement

8. Develop and maintain documentation related to data engineering and analytics processes and procedures

9. Perform Proof of Concept on new integration and analytic patterns and solutions

10. Contribute to best practices and standards for the data engineering team

Must-Have Skills & Experience

1. Experience on Data projects is a MUST (at least 1 end to end project)

2. Experience in using Databricks and Azure (certifications preferred)

3. Experience in SQL, Python (Pyspark)

4. Knowledge in Data Warehouse and Data Mart concepts and query optimization techniques

5. Preferably local resource that can report to Makati/Ortigas office

Nice-to-Have Skills & Experience

1. Familiarity with Power BI