Senior Data Engineer: Build Production-Grade Data Pipelines

dci consultants private limited; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

dci consultants private limited is seeking a Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. You will lead ETL workflows, ensure data quality, and guide the team in modernising existing processes while preserving business logic and outputs.

Collaboration with statisticians and stakeholders will shape robust technical solutions, with emphasis on production-quality delivery and operational reliability across large datasets.

Qualifications

• 7+ years of professional experience in data engineering or related software engineering roles.
• Proficiency in Python and SQL with complex data transformations and monitoring.
• Strong experience with batch processing, ETL and data pipeline architecture.
• Solid knowledge of Linux/Unix environments, shell scripting and CLI tools.
• Experience applying modular design, configuration management, logging, testing and documentation.
• Experience with Git, branching strategies, merge requests and CI/CD pipelines.
• Familiarity with cloud platforms and orchestration/CI-CD tooling.

Responsibilities

• Lead ETL architecture, design, and implementation of data pipelines across multiple sources.
• Build and maintain large-scale batch and real-time data pipelines with monitoring and failure handling.
• Develop production-quality code for statistical processes and modernise legacy pipelines.
• Lead data model and schema design for large-scale datasets.
• Drive reusable data engineering components and standardised tooling across the team.
• Implement CI/CD for data workflows and manage environments (Dev/UAT/Prod).
• Provide mentoring and technical guidance to data engineers and review designs.

Skills

Python

SQL

ETL

Linux/Unix

Software engineering practices

Git & CI/CD

Cloud platforms

Job description

dci consultants private limited is seeking a Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. You will lead ETL workflows, ensure data quality, and guide the team in modernising existing processes while preserving business logic and outputs.

Collaboration with statisticians and stakeholders will shape robust technical solutions, with emphasis on production-quality delivery and operational reliability across large datasets.