Data Engineer {Python & SQL}

NCS Group; Taguig; On-site; PHP 700,000 - 1,100,000; Full time

Job summary

NCS Group is seeking a Data Engineer to design and implement scalable data infrastructure and pipelines for analytics and operations. The role focuses on transforming raw data into actionable insights and building robust data solutions across platforms.

Responsibilities include ETL development, collaboration with cross-functional teams, and delivering ad hoc reports to stakeholders. Cloud-based expertise and strong SQL/NoSQL skills are essential.

Qualifications

• College graduate required with 2-3 years as Data Engineer.
• Proficiency in Python and data manipulation tools (Pandas, Dplyr, Spark).
• Experience with ETL processes, SQL and NoSQL queries.
• Exposure to cloud data services and big data storage/processing solutions.

Responsibilities

• Design and build scalable big data infrastructure on cloud resources.
• Create and maintain ETL processes and data pipelines for reporting and ML.
• Collaborate with cross-functional teams to satisfy data requirements.
• Optimize and automate current business processes and procedures.
• Create and present ad hoc reports to stakeholders.

Skills

Python

Pyspark

R

C++

Javascript

Java

Education

College Graduate

Tools

Pandas

Dplyr

Spark

SQL

NoSQL

MongoDB

Hive

Snowflake

Redshift

AWS Glue

AWS Lake Formation

Job description

General Responsibilities

The Data Engineer will focus on using various methods to design and implement an overall data infrastructure that will support current and future business needs. The data engineer is also tasked with creating data pipelines that transform raw data for analytical and operational processes.

Duties And Responsibilities

• Design and build scalable big data infrastructure and solutions, leveraging available cloud resources
• Design, create and maintain ETL processes and data pipelines for functions such as but not limited to reporting and machine learning
• Collaborate with different cross functional teams to determine and satisfy business data requirements taking into account various technology stacks
• Optimize and automate existing current business processes and procedures
• Create and present ad hoc reports to key stakeholders

Minimum Qualifications

• At least College Graduate
• With 2-3 years experience as Data Engineer
• Proficiency in Python
• Proficiency in data manipulation tools: Any of Pandas, Dplyr, Spark
• Experience with Extract, Transform and Load (ETL Processes)
• Experience in SQL and no SQl query languages
• Experience with any big data storage and processing solutions (SQL variants, MongoDb, Spark, Hive, Snowflake, Redshift, etc.)
• Experience with any cloud service or server based data processing.

Knowledge And Skills

• Proficiency in additional programming languages, particularly Pyspark, R, C++, Javascript, Java.
• Proficiency in AWS Cloud Services, particularly AWS Glue, AWS Lake Formation
• Familiarity with data warehousing services such as AWS Redshift, and Snowflake
• Familiarity in business intelligence tools: Any of Tableau, PowerBI, Quicksight, Google Data Studio.
• Familiarity in data visualization packages: Any of Dash, Plotly, Matplotlib, Ggplot, Folium.
• Familiarity in machine learning tools is a plus: Any of scikit-learn, caret, MATLAB, Julia.