Senior Data Engineer: Pipelines, Modernisation & Reliability

HCL Technologies Limited; Singapore; On-site; SGD 110,000 - 150,000; Full time

Job summary

HCL Technologies Limited in Singapore is seeking a Data Engineer to design, build, and maintain data infrastructure supporting statistical and analytical production processes. You will lead in developing reliable data pipelines, validate data, and ensure outputs reconcile with production results, while guiding solution design and engineering standards.

Collaborating with statisticians and business stakeholders, you will modernize legacy processes, implement scalable batch and real-time

Qualifications

• 7+ years in data engineering or related software engineering roles with production-grade data solutions.
• Strong Python and SQL skills for complex data transformations, analysis, and quality monitoring.
• Experience with batch processing, ETL, data integration, and data pipeline architecture.
• Proficiency with Linux/Unix, shells scripting, and command-line tools for data processing.
• Knowledge of software engineering practices: modular design, logging, testing, and documentation.
• Experience with cloud platforms and orchestration/CI-CD tooling is preferred.
• Ability to lead or mentor data engineers and provide technical guidance.

Responsibilities

• Lead the architecture, design, and implementation of ETL processes and data pipelines from multiple sources.
• Build and maintain large-scale batch and real-time data pipelines with proper monitoring and failure handling.
• Develop production-quality code for statistical production processes, modernising legacy pipelines while preserving logic.
• Lead database/data-model design and performance optimisations for large datasets.
• Promote reusable data engineering components and standardised configurations across the team.
• Design CI/CD for data workflows and manage development, UAT, and production environments.
• Oversee complex pipeline workflows and scheduling using enterprise tools.
• Establish version control structures (GitLab) and code review practices.
• Troubleshoot production incidents and continuously optimise pipeline performance.
• Provide technical mentoring to data engineers and guidance on best practices.
• Collaborate with business users to translate requirements into robust technical solutions.
• Identify risks and opportunities and recommend design or implementation approaches.

Skills

Python

SQL

ETL

Data pipelines

Linux/Unix

Git

CI/CD

Cloud platforms

Tools

GitLab

Job description

HCL Technologies Limited in Singapore is seeking a Data Engineer to design, build, and maintain data infrastructure supporting statistical and analytical production processes. You will lead in developing reliable data pipelines, validate data, and ensure outputs reconcile with production results, while guiding solution design and engineering standards.

Collaborating with statisticians and business stakeholders, you will modernize legacy processes, implement scalable batch and real-time