Data Engineer {Python , SQL}

NCS Group; Taguig; On-site; PHP 900,000 - 1,400,000; Full time

Job summary

NCS Group is seeking a data engineer/Data Analytics specialist to design and maintain scalable data pipelines and storage systems. The role emphasizes ensuring data quality through ETL processes, collaborating with cross-functional teams, and delivering insights to support business decisions.

The ideal candidate has 5+ years of experience in data engineering/analytics, strong Python and Java skills, and hands-on experience with tools like Spark, pandas, and SQL/NoSQL databases.

Qualifications

• Bachelor’s or Master’s degree in IT, CS, Engineering, or related field.
• 5+ years in data engineering, data analytics, or related fields.
• Proficiency in Python and Java; experience in other languages a plus.
• Hands-on experience with data manipulation tools (pandas, dplyr, Spark).
• Proficiency in ETL processes for data pipelines.
• Expertise in SQL and NoSQL for database interaction and management.
• Experience with big data storage/processing (MongoDB, Spark, Hive, Snowflake, Redshift).
• Experience with cloud data processing environments (AWS/Azure/GCP).
• Nice to have experience with Apache NiFi.

Responsibilities

• Design, build, and maintain scalable data pipelines and storage systems; ensure data quality through ETL and checks.
• Implement data governance, security, and access controls for data assets.
• Develop data models and architectures to meet business needs; communicate data architecture clearly.
• Develop and maintain scripts to automate data processing and pipelines; adhere to standards.
• Create and operationalize data visualization solutions for stakeholders and decision makers.
• Collaborate with cross-functional teams to gather requirements and deliver ad hoc reports and insights.

Skills

Problem Solving

Communication

Collaboration

Time Management

Attention to Detail

Client Focus

Adaptability

Education

Bachelor or Master in IT/CS/Engineering

Tools

Python

Java

pandas

dplyr

Spark

SQL

NoSQL

MongoDB

Job description

Job Specifications

• Education – At least graduate with a Bachelor’s or Master’s Degree in IT, Computer Science, Engineering, or any related course.
• Related Work Experience – at least 5 years of experience in data engineering, data analytics, or related fields.
• Proficiency in Python and Java, with experience in other programming languages as a plus.
• Hands‑on experience with data manipulation tools (e.g., pandas, dplyr, or Spark).
• Proficiency in Extract, Transform, and Load (ETL) processes for efficient data pipeline management.
• Expertise in both SQL and NoSQL query languages for database interaction and management.
• Experience with big data storage and processing solutions, such as MongoDB, Spark, Hive, Snowflake, Redshift, or similar technologies.
• Experience with cloud‑based or server‑based data processing environments (e.g., AWS, Azure, GCP).
• Experience in Apache Nifi (nice to have)

Knowledge – Knowledgeable In The Following

• Comprehensive understanding of data manipulation tools such as pandas, dplyr, and Spark.
• In-depth knowledge of big data frameworks and tools like Apache Spark and Hadoop.
• Familiarity with data warehousing services like AWS Redshift, Snowflake, or similar solutions.
• Proficiency in AWS Cloud Services, particularly AWS Glue and AWS Lake Formation.
• Familiarity with business intelligence tools such as Tableau, Power BI, QuickSight, or Google Data Studio.
• Awareness of data visualization libraries and packages like Dash, Plotly, Matplotlib, ggplot, and Folium.
• Understanding of machine learning libraries and tools is a plus.
• Knowledge of data governance, quality control, and security best practices.

Skills

• Problem‑Solving: Ability to address technical challenges and deliver efficient data solutions.
• Communication: Clear and concise communication skills for collaborating with team members and stakeholders.
• Collaboration: Ability to work effectively within a team environment to achieve shared goals.
• Time Management: Capacity to manage tasks and meet deadlines in a structured and timely manner.
• Attention to Detail: Careful and accurate handling of data to ensure quality and integrity.
• Client‑Focus: Ability to understand business needs and align data solutions to support decision‑making and strategic objectives.
• Adaptability: Flexible and open to learning new tools, technologies, and processes in a rapidly changing environment.

Minimum Qualifications

• Design, build, and maintain scalable, secure data pipelines and storage systems; ensure data quality through ETL processes and regular checks.
• Implement policies and practices to control, optimize, and secure data assets, ensuring data integrity and accessibility.
• Develop and maintain data models, structures, and databases to meet business needs; communicate data architecture effectively.
• Develop, test, and maintain scripts and programs to automate data processing and pipelines, adhering to industry standards.
• Create and operationalize data visualization solutions to simplify complex data for stakeholders and decision‑making.
• Work with cross‑functional teams to gather data requirements, optimize existing processes, and deliver ad hoc reports and insights.