Data Engineer: ETL Pipelines, Cloud & Big Data

NCS Group; Taguig; On-site; PHP 900,000 - 1,500,000; Full time

Job summary

NCS Group in Metro Manila seeks a data engineer to design, build, and maintain scalable data pipelines and storage systems while ensuring data quality through ETL processes and regular checks. The role requires collaboration with cross-functional teams to gather data requirements and deliver ad hoc reports.

You will work with Python, SQL, and Spark, leveraging AWS/Azure/GCP cloud environments and BI tools to develop data models, automation scripts, and visualizations for stakeholders.

Qualifications

• Design, build, and maintain scalable, secure data pipelines and storage systems; ensure data quality through ETL processes and regular checks.
• Implement policies and practices to control, optimize, and secure data assets, ensuring data integrity and accessibility.
• Develop and maintain data models, structures, and databases to meet business needs; communicate data architecture effectively.
• Develop, test, and maintain scripts and programs to automate data processing and pipelines, adhering to industry standards.
• Create and operationalize data visualization solutions to simplify complex data for stakeholders and decision-making.
• Work with cross-functional teams to gather data requirements, optimize existing processes, and deliver ad hoc reports and insight.

Responsibilities

• Design, build, and maintain scalable, secure data pipelines and storage systems; ensure data quality through ETL processes and regular checks.
• Implement policies and practices to control, optimize, and secure data assets, ensuring data integrity and accessibility.
• Develop and maintain data models, structures, and databases to meet business needs; communicate data architecture effectively.
• Develop, test, and maintain scripts and programs to automate data processing and pipelines, adhering to industry standards.
• Create and operationalize data visualization solutions to simplify complex data for stakeholders and decision-making.
• Work with cross-functional teams to gather data requirements, optimize existing processes, and deliver ad hoc reports and insight.

Skills

Python

SQL

ETL/Data Flows

ASAP Starters

Data engineering

Data analytics

Pandas/Dplyr/Spark

Big data tools (MongoDB, Spark, Hive,;

Cloud platforms (AWS/Azure/GCP)

Apache NiFi

Data governance and security

Education

Bachelor's or Master's Degree in IT/CS/Engineering

Tools

Python

SQL

NoSQL

ETL tools

Job description

NCS Group in Metro Manila seeks a data engineer to design, build, and maintain scalable data pipelines and storage systems while ensuring data quality through ETL processes and regular checks. The role requires collaboration with cross-functional teams to gather data requirements and deliver ad hoc reports.

You will work with Python, SQL, and Spark, leveraging AWS/Azure/GCP cloud environments and BI tools to develop data models, automation scripts, and visualizations for stakeholders.