Senior Data Engineer

AIM Global Talent; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

AIM Global Talent is seeking an experienced Data Engineer for a government-related technology project in Singapore. You will design, develop, and optimise large-scale data pipelines and processing workflows using Python and SQL, delivering scalable, production-ready data solutions.

You will collaborate with data analysts, engineers, and business stakeholders, provide guidance on architecture, and contribute to engineering standards while modernising legacy systems and implementing CI/CD,

Qualifications

• 5–8 years of experience in Data Engineering or related software roles.
• Strong hands-on Python and SQL with data transformation and quality validation.
• Experience designing ETL pipelines, batch processing, and data integration.
• Familiarity with Linux/Unix, scripting, and command-line tools.
• Solid software fundamentals: modular design, logging, testing, and documentation.
• Hands-on experience with Git/GitLab, code reviews, and CI/CD pipelines.
• Experience in technical solution design or legacy modernisation projects.
• Ability to mentor engineers and set engineering best practices.

Responsibilities

• Design, develop, and maintain scalable ETL pipelines and data workflows.
• Build and optimise batch and real-time pipelines for reliability and performance.
• Develop robust data transformations using Python and SQL.
• Design and optimise data models and storage for large datasets.
• Implement monitoring, error handling, recovery, and performance tuning.
• Modernise legacy data processing systems while preserving business logic.
• Create reusable components and utilities to improve maintainability.
• Establish CI/CD and deployment workflows across environments.
• Conduct code reviews and share engineering best practices.
• Troubleshoot production issues and drive long-term improvements.

Skills

Python

SQL

ETL pipelines

Data quality

Linux/Unix

CI/CD

Code reviews

Git/GitLab

Tools

Apache Airflow

Job description

Our client is supporting a government-related technology project in Singapore, focused on modernising data infrastructure and enhancing large-scale data processing capabilities.

This is a long-term contract opportunity (approximately 29 months) involving the development and modernisation of enterprise data pipelines, statistical data processing systems, and engineering frameworks.

The successful candidate will work closely with technical teams, data analysts, and business stakeholders to deliver scalable, reliable, and production-ready data solutions.

About the Role

We are looking for an experienced Data Engineer with strong Python and SQL expertise to design, develop, and optimise large-scale data pipelines and processing workflows.

The role involves building reliable ETL pipelines, modernising legacy data processing systems, and implementing engineering best practices to support complex statistical and business operations.

Beyond hands-on development, you will also provide technical guidance on solution architecture, code quality, and engineering standards, working closely with other engineers and stakeholders to deliver robust data solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines and data processing workflows.
• Build and optimise batch and real-time data pipelines, ensuring reliability, performance, and data quality.
• Develop robust data transformation and integration solutions using Python and SQL.
• Design and optimise database schemas, data models, and storage structures for large datasets.
• Implement pipeline monitoring, error handling, recovery mechanisms, and performance optimisation.
• Modernise legacy data processing systems while preserving existing business logic and ensuring data accuracy.
• Develop reusable engineering components, frameworks, and utilities to improve maintainability and efficiency.
• Implement automated testing, CI/CD pipelines, and deployment workflows across Development, UAT, and Production environments.
• Establish and maintain version control, code review, and engineering best practices using Git/GitLab.
• Troubleshoot production issues, investigate root causes, and implement long-term improvements.

Technical Leadership & Collaboration

• Provide technical guidance on system architecture, solution design, and implementation approaches.
• Conduct code reviews and mentor other data engineers to maintain high engineering standards.
• Collaborate with analysts, business users, and technical stakeholders to translate business requirements into scalable technical solutions.
• Identify technical risks, recommend improvements, and contribute to engineering decisions.

Requirements

Must-Have Qualifications

• 5–8 years of experience in Data Engineering, Data Platform Development, or related Software Engineering roles.
• Strong hands-on proficiency in Python and SQL, including complex data transformations, query optimisation, and data quality validation.
• Solid experience designing and building ETL pipelines, batch processing systems, and data integration workflows.
• Strong understanding of data pipeline architecture, database design, and performance optimisation.
• Experience working with Linux/Unix environments, shell scripting, and command-line tools.
• Good software engineering fundamentals, including modular design, exception handling, logging, automated testing, and documentation.
• Hands-on experience with Git/GitLab, code reviews, and CI/CD pipelines.
• Experience in technical solution design, system migration, or legacy modernisation projects.
• Ability to provide technical guidance, review code, and contribute to engineering best practices.
• Strong problem-solving and communication skills.

Nice to Have

• Experience with cloud platforms such as AWS, Azure, or GCP.
• Familiarity with data orchestration tools such as Apache Airflow or similar workflow scheduling platforms.
• Experience working with large-scale statistical datasets or complex data processing systems.
• Previous experience in government, public sector, or enterprise-scale technology projects.
• Experience leading technical initiatives or mentoring junior engineers.

Why Join This Project?

• Long-Term Opportunity: Approximately 29-month contract supporting a government-related technology project in Singapore.
• Meaningful Technical Challenges: Work on large-scale data infrastructure, complex processing workflows, and system modernisation.
• Technical Ownership: Contribute to architecture decisions, engineering standards, and technical improvements.
• Collaborative Environment: Work alongside experienced engineers, analysts, and business stakeholders.

Interested?

If you have a strong background in Python, SQL, and data engineering, and enjoy building reliable, scalable data solutions, we'd love to hear from you.

AIM Global Talent Pte. Ltd. | EA Licence No. 25C3207