Senior Data Engineer — Python & SQL Pipelines

ITCAN PTE. LIMITED; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

ITCAN PTE. LIMITED is seeking a Data Engineer to design, build, and maintain robust data infrastructure supporting statistical production processes.

You will lead data pipelines, ETL processes, and data architecture while guiding engineering standards across the team. You will translate business needs into robust technical solutions, modernising legacy workflows and ensuring outputs align with production results.

Qualifications

• Proficient in Python and SQL for complex data transformations and quality monitoring.
• Experience designing and implementing production-grade data solutions at scale.
• Strong ETL, batch processing, and data pipeline architecture skills.
• Proficient in Linux/Unix shell scripting and CLI tools.

Responsibilities

• Lead the architecture, design and implementation of ETL processes and data pipelines across multiple sources.
• Build and maintain large-scale batch and real-time data pipelines with proper failure handling and monitoring.
• Develop production-quality code for statistical production processes and modernise legacy workflows.
• Lead data model design, schema design and performance optimisation for large datasets.
• Promote reusable components, libraries, and configuration frameworks to standardise workflows.
• Establish CI/CD for data workflows and manage environments (Development, UAT, Production).
• Oversee version control with GitLab, code reviews, and documentation of architectures.
• Troubleshoot production incidents and optimise system performance for large-scale data.
• Provide mentoring to data engineers and guide solution designs and implementation choices.
• Collaborate with business users to translate requirements into robust technical solutions.

Skills

Python

SQL

Data pipelines

ETL

Data architecture

Code reviews

CI/CD

Tools

GitLab

CI/CD tooling

Linux

Job description

ITCAN PTE. LIMITED is seeking a Data Engineer to design, build, and maintain robust data infrastructure supporting statistical production processes.

You will lead data pipelines, ETL processes, and data architecture while guiding engineering standards across the team. You will translate business needs into robust technical solutions, modernising legacy workflows and ensuring outputs align with production results.