Senior Data Engineer: Build Production-Grade Pipelines

DCI CONSULTANTS PRIVATE LIMITED; Singapore; Presencial; SGD 120.000 - 180.000; Jornada completa

Descripción de la vacante

DCI CONSULTANTS PRIVATE LIMITED is seeking a seasoned Data Engineer to design, build, and maintain data infrastructure for statistical production processes. You will lead data pipelines, ETL workflows, and data models, partnering with statisticians and analytical teams to ensure reliable, scalable solutions.

You will mentor engineers, establish coding standards, and drive CI/CD adoption across data engineering workflows, including development, UAT, and production environments.

Formación

• 7+ years in data engineering or related software engineering.
• Proficiency in Python and SQL for complex transformations.
• Experience with batch processing, ETL, data integration and data pipeline architecture.
• Linux/Unix knowledge, shell scripting and data processing tools.
• Strong software engineering practices: modular design, logging, testing, and documentation.
• Experience with data pipeline migration or modernisation initiatives.
• Experience with code reviews and mentoring.
• Git with branching strategies, merge requests, and CI/CD for automated testing/deployment.
• Cloud platforms and orchestration/CI-CD tooling preferred.
• Excellent problem-solving, analytical, and communication skills in an agile team.

Responsabilidades

• Lead architecture, design, and implementation of ETL processes and data pipelines.
• Build and maintain large-scale batch and real-time data pipelines with monitoring and fault handling.
• Develop production-quality code for statistical processes while preserving business logic.
• Lead database and data model design for large-scale datasets.
• Promote reusable data engineering components and standardised practices across the team.
• Implement CI/CD for data engineering workflows and environment separation.
• Manage version control with GitLab and code review practices.
• Troubleshoot production incidents and optimise pipeline performance.
• Mentor and guide data engineers in coding practices and design decisions.
• Collaborate with business users to translate requirements into robust solutions.

Conocimientos

Python

SQL

ETL pipelines

Data orchestration

Linux/Unix

CI/CD tooling

Code reviews

Mentoring

Software design

Herramientas

Git

GitLab

CI/CD pipelines

Descripción del empleo

DCI CONSULTANTS PRIVATE LIMITED is seeking a seasoned Data Engineer to design, build, and maintain data infrastructure for statistical production processes. You will lead data pipelines, ETL workflows, and data models, partnering with statisticians and analytical teams to ensure reliable, scalable solutions.

You will mentor engineers, establish coding standards, and drive CI/CD adoption across data engineering workflows, including development, UAT, and production environments.