Senior Data Engineer

Talentvis Singapore Pte Ltd.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Talentvis Singapore Pte Ltd. is seeking an experienced Senior Data Engineer to design, develop, and maintain reliable data pipelines and processing systems in Singapore.

The role focuses on building scalable data solutions, improving existing systems, and driving performance improvements while ensuring maintainability. You will provide technical guidance to the engineering team, mentor other engineers, and collaborate with stakeholders to translate business requirements into effective technical

Qualifications

• At least 7 years of relevant experience in data engineering, data platform development, or software engineering.
• Strong proficiency in Python and SQL.
• Experience in ETL, data integration, and data pipeline development.
• Good knowledge of Linux/Unix environments and shell scripting.
• Strong understanding of software engineering practices, including testing, logging, error handling, and documentation.
• Experience in system migration, modernisation, and large-scale data processing.
• Experience with Git/GitLab, code reviews, and CI/CD pipelines.
• Ability to design solutions that balance performance, scalability, maintainability, and reliability.
• Experience providing technical guidance or mentoring other engineers.
• Familiarity with cloud platforms and workflow orchestration tools would be an advantage.
• Strong analytical, problem-solving, and communication skills.

Responsibilities

• Design, develop, and maintain data pipelines, ETL processes, and data integration workflows.
• Build and manage large-scale data processing workflows, including scheduling, monitoring, error handling, and recovery.
• Improve and modernise existing systems while ensuring data accuracy and consistency.
• Design and optimise databases, data models, and data processing workflows.
• Develop reusable tools and components to improve development efficiency.
• Implement automated testing and deployment processes using CI/CD tools.
• Manage source code, conduct code reviews, and maintain technical documentation.
• Monitor system performance, troubleshoot production issues, and implement improvements.
• Provide technical guidance, review solution designs, and mentor other engineers.
• Work with stakeholders to translate business requirements into effective technical solutions.

Skills

Python

SQL

ETL

Data pipelines

CI/CD

Git/GitLab

Linux/Unix

Cloud platforms

Workflow orchestration

Mentoring

Testing/Logging

Communication

Tools

Git

GitLab

CI/CD tools

Job description

We are looking for an experienced Senior Data Engineer to design, develop, and maintain reliable data pipelines and processing systems.

The role involves building scalable data solutions, improving existing systems, optimising performance, and ensuring data processing workflows are reliable and maintainable. You will also provide technical guidance to the engineering team and drive improvements in development practices.

Key Responsibilities

• Design, develop, and maintain data pipelines, ETL processes, and data integration workflows.
• Build and manage large-scale data processing workflows, including scheduling, monitoring, error handling, and recovery.
• Improve and modernise existing systems while ensuring data accuracy and consistency.
• Design and optimise databases, data models, and data processing workflows.
• Develop reusable tools and components to improve development efficiency.
• Implement automated testing and deployment processes using CI/CD tools.
• Manage source code, conduct code reviews, and maintain technical documentation.
• Monitor system performance, troubleshoot production issues, and implement improvements.
• Provide technical guidance, review solution designs, and mentor other engineers.
• Work with stakeholders to translate business requirements into effective technical solutions.

Requirements

• At least 7 years of relevant experience in data engineering, data platform development, or software engineering.
• Strong proficiency in Python and SQL.
• Experience in ETL, data integration, and data pipeline development.
• Good knowledge of Linux/Unix environments and shell scripting.
• Strong understanding of software engineering practices, including testing, logging, error handling, and documentation.
• Experience in system migration, modernisation, and large-scale data processing.
• Experience with Git/GitLab, code reviews, and CI/CD pipelines.
• Ability to design solutions that balance performance, scalability, maintainability, and reliability.
• Experience providing technical guidance or mentoring other engineers.
• Familiarity with cloud platforms and workflow orchestration tools would be an advantage.
• Strong analytical, problem-solving, and communication skills.

**We regret to inform that only shortlisted candidates would be notified**

EA License No: 04C3537

EA Personnel No: R22106683

EA Personnel Name: Yang Hui Shan, Sherri