Senior Data Engineer

APAR TECHNOLOGIES PTE. LTD.; Singapore; On-site; SGD 60,000 - 90,000; Full time

Job summary

A technology solutions provider in Singapore is seeking a skilled professional to develop and support data pipelines. The successful candidate will need at least 3 years of experience focusing on data ingestion and management, with proficiency in Python and SQL. Responsibilities include collaborating with data analysts, ensuring compliance with IT security standards, and providing production support. Experience with cloud environments and CI/CD is essential for success in this role.

Qualifications

• At least 3 years of experience in development and support of data pipelines.
• Experience with continuous integration and continuous deployment (CICD) using GitHub.
• Strong communication and collaboration skills.

Responsibilities

• Work closely with data stewards and analysts to implement data solutions.
• Design and build scalable data ingestion solutions for multiple data sources.
• Provide BAU support in terms of production job monitoring and issue resolution.

Skills

Python

SQL

Agile methodologies

Data warehousing concepts

Problem-solving skills

Communication skills

Collaboration skills

Education

Degree in Computer Science/Information Technology or related fields

Tools

Snowflake

AWS

GitHub

Job description

Responsibilities

• Work closely with data stewards, data analysts and business end‑users to implement and support data solutions.
• Design and build robust and scalable data ingestion and data management solutions for batch‑loading and streaming from multiple data sources using Python via different mechanisms such as API, Files transfer, direct interface with Oracle and MSSQL databases.
• Familiar with SDLC process: Requirement gathering, design and development, SIT testing, support UAT and CICD deployment using Github for enhancement and new ingestion pipeline.
• Ensure compliance with IT security standards, policies, and procedures.
• Provide BAU support in terms of production job monitoring, issue resolution, and bug fixes.
• Enable ingestion checks and data quality checks for all data sets in the data platform and ensure the data issues are actively detected, tracked, and fixed without breaching SLA

Skillset

• Possess a degree in Computer Science/Information Technology or related fields.
• At least 3 years of experience in a role focusing on development and support of data pipelines.
• Experience with building on data platforms, e.g. Snowflake.
• Proficient in SQL and Python.
• Experience with Cloud environments (e.g. AWS).
• Experience with continuous integration and continuous deployment (CICD) using GitHub.
• Experience with Software Development Life Cycle (SDLC) methodology.
• Experience with data warehousing concepts.
• Strong problem‑solving and troubleshooting skills.
• Strong communication and collaboration skills.
• Able to design and implement solution and perform code review independently.
• Able to provide production support independently.
• Agile, fast learner and able to adapt to changes.