Senior Data Engineer & Production Pipelines Lead

JOBSTER PRIVATE LTD.; Singapore; On-site; SGD 110,000 - 170,000; Full time

Job summary

JOBSTER PRIVATE LTD. in Singapore seeks an experienced Data Engineer to design, build, and maintain the data infrastructure needed to support rigorous statistical production processes.

The role centres on building reliable and maintainable data pipelines, validation and frameworks that support statistical production processes, while providing technical leadership across the engineering team. You will work closely with statisticians and analytics teams to translate business needs into robust

Qualifications

• 7+ years of data engineering or related software engineering experience.
• Strong proficiency in Python and SQL with complex transformations and quality monitoring.
• Experience with batch processing, ETL, and data pipeline architecture.
• Linux/Unix, shell scripting, and command-line tooling for data processing.
• Understanding of software engineering practices: modular design, logging, testing, and documentation.
• Experience with cloud platforms and orchestration/CI-CD tooling is preferred.

Responsibilities

• Leads the architecture, design, and implementation of ETL processes and data pipelines from multiple sources.
• Builds and maintains large-scale batch and real-time data pipelines with monitoring and failure handling.
• Develops production-quality code for statistical processes and modernisation of legacy pipelines.
• Leads database and data model design and performance optimisation for large datasets.
• Designs reusable data engineering components and standardised configurations.
• Implements CI/CD for data workflows and manages Development, UAT, and Production environments.
• Configures complex pipeline workflows and schedules using enterprise tools.
• Establishes GitLab version control, code review practices, and architecture documentation.
• Troubleshoots production incidents and optimises pipeline performance.
• Mentors data engineers and provides technical guidance on design and implementation decisions.
• Collaborates with business and technical stakeholders to translate needs into robust technical solutions.
• Identifies risks and opportunities for improvements and recommend approaches.

Skills

Python

SQL

ETL pipelines

Data modeling

Linux/Unix

CI/CD

Git

Cloud platforms

Code reviews

Mentoring

Troubleshooting

Performance optimization

Tools

GitLab

CI/CD tooling

Job description

JOBSTER PRIVATE LTD. in Singapore seeks an experienced Data Engineer to design, build, and maintain the data infrastructure needed to support rigorous statistical production processes.

The role centres on building reliable and maintainable data pipelines, validation and frameworks that support statistical production processes, while providing technical leadership across the engineering team. You will work closely with statisticians and analytics teams to translate business needs into robust