Consultant Data Engineer

Thoughtworks Inc.; Singapore; On-site; SGD 60,000 - 100,000; Full time

Job summary

A leading technology consultancy in Singapore seeks a Data Engineer to build and maintain software architectures for data applications. This role involves developing data processing pipelines, collaborating with data scientists, and applying modern data engineering tools. The ideal candidate has strong programming skills, particularly in Python, and familiarity with AWS services. Join us to help revolutionize tech solutions in a vibrant, inclusive environment.

Benefits

Personalized career development path

Interactive learning tools

Collaborative work environment

Qualifications

• Hands-on experience with data modeling and modern data engineering tools.
• Knowledge of data governance, security, and privacy strategies.
• Experience with various databases (SQL, NoSQL).

Responsibilities

• Design intricate data processing pipelines to solve client challenges.
• Collaborate with data scientists to implement scalable models.
• Write clean, iterative code leveraging TDD for data pipelines.

Skills

Data modeling

Data engineering tools

Python

Data visualization

Stakeholder management

Resilience

Adaptability

Tools

AWS RDS

Redshift

Glue

Dagster

Job description

Data engineers at Thoughtworks are engineers who build, maintain, and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities, including technical and functional data platforms. They support functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks, and offerings (data mesh, etc.), while also enabling credible and collaborative problem solving to execute on a strategy.

Due to project requirements, candidates must be Singaporean citizens or already hold Singaporean Permanent Residency (PR) at the time of application.

Job responsibilities

• Collaborate with team members to design intricate data processing pipelines, addressing clients' most challenging problems.
• Collaborate with data scientists to design scalable implementations of their models.
• Write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support, and operate data pipelines.
• Apply different standard models for big data and create data models for at least one type of modeling technique.
• Incorporate data quality into your day-to-day work.
• Familiar with AWS RDS, Redshift, Glue, Dagster. Good to have: General AWS knowledge, SageMaker, Qlik or QuickSight, Talend, Terraform.
• Python coding experience is a must.

Job qualifications

Technical Skills

• Hands-on experience with data modeling and modern data engineering tools and platforms.
• Experience in writing clean, high-quality code using preferred programming languages.
• Awareness of building data pipelines and data-centric applications using distributed storage and processing platforms in a production setting.
• Knowledge of data visualization techniques and ability to communicate insights effectively.
• Understanding of data governance, security, and privacy strategies to solve business problems.
• Experience with various types of databases (SQL, NoSQL, etc.).

Professional Skills

• Stakeholder management skills, liaising effectively between clients and key stakeholders.
• Resilience in ambiguous situations and adaptability to approach challenges from multiple perspectives.
• Willingness to manage risks and conflicts skillfully.
• Ability to influence others and advocate for technical excellence, while being open to change.

Other things to know

Learning & Development

Thoughtworks offers a personalized career development path supported by interactive tools, development programs, and collaborative teammates. We value helping each other grow and empower employees in their career journeys.

About Thoughtworks

Thoughtworks is a vibrant, inclusive community of innovative colleagues revolutionizing tech. As a leading technology consultancy for over 30 years, we deliver impactful solutions to complex business problems, leveraging technology as a strategic differentiator. Join us with your expertise and passion for continuous learning. Let’s be extraordinary together.

Sign up for our monthly careers newsletter