T&T Consultant - Engineering - Data Engineer - SG

Deloitte SEA; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Deloitte Singapore is seeking a data engineer to design, build, and maintain scalable data pipelines and data-driven products. You will work across data warehouses, data lakes, and data virtualization to ensure accurate data delivery and governance.

You will collaborate with stakeholders on backend APIs, databases, and cloud services, contributing to agile delivery and continuous improvement in a dynamic environment.

Qualifications

• Has 4-6 years of data engineer experience.
• Proficient in SQL, Pandas, and R for data cleaning and transformation.
• Experience building ETL/ELT pipelines with SSIS, DMS, Python, and AWS services.
• Proficient in databases including SQL, PostgreSQL, and AWS S3/Athena.
• Familiar with cloud platforms such as AWS, Azure, Google Cloud.
• Knowledge of data warehousing and Data Lake concepts.
• Familiar with big data tools (Hadoop, Spark, Kafka).
• Experience with web scraping and REST APIs.

Responsibilities

• Design, develop and deploy data tables, views and marts in data warehouses, data lake and data virtualization.
• Perform data extraction, cleaning, transformation, and flow; web scraping may be part of data extraction.
• Design, build, launch and maintain large-scale batch and real-time data pipelines.
• Integrate data silos in scalable, compliant manner.
• Collaborate with Project Manager, Data Architect, Analysts and Developers to build data-driven products.
• Develop backend APIs and work on databases to support applications.
• Work in an Agile environment with CI/CD; pair programming and code reviews.

Skills

SQL

Pandas

Python

ETL

Data modelling

Big data

Spark

REST API

Tools

SSIS

AWS DMS

AWS Lambda

ECS

AWS Glue

Selenium

Job description

Are you ready to unleash your potential?

At Deloitte, our purpose is to make an impact that matters for our clients, our people, and the communities we serve.

We believe we have a responsibility to be a force for good, and WorldImpact is our portfolio of initiatives focused on making a tangible impact on society’s biggest challenges and creating a better future. We strive to advise clients on how to deliver purpose-led growth and embed more equitable, inclusive as well as sustainable business practices.

Hence, we seek talented individuals driven to excel and innovate, working together to achieve our shared goals.

We are committed to creating positive work experiences that foster a culture of respect and inclusion, where diverse perspectives are celebrated, and everyone is recognised for their contributions.

Ready to unleash your potential with us? Join the winning team now!

Work you’ll do:

• Design, develop and deploy data tables, views and marts in data warehouses, operational data store, data lake and data virtualization.
• Perform data extraction, cleaning, transformation, and flow. Web scraping may be also a part of the work scope in data extraction.
• Design, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks.
• Integrate and collate data silos in a manner which is both scalable and compliant.
• Collaborate with Project Manager, Data Architect, Business Analysts, Frontend Developers, Designers and Data Analyst to build scalable data-driven products.
• Be responsible for developing backend APIs & working on databases to support the applications.
• Work in an Agile Environment that practices Continuous Integration and Delivery.
• Work closely with fellow developers through pair programming and code review process.

Your role as a leader:

• Demonstrate a strong commitment to personal learning and development.
• Understand how our daily work contributes to the priorities of the team and business.
• Understand the set expectations and demonstrate accountability in keeping personal performance on track.
• Actively focus on developing effective communications and relationship-building skills with stakeholders, clients and team.
• Demonstrate an appreciation for working with others.
• Understand what is fundamental to Deloitte’s success as a business.
• Demonstrate integrity and an awareness of strengths, differences, and personal impact.
• Develop their understanding of Deloitte and offer a fresh perspective.

Requirements:

• Has 4-6 years of relevant working experience as a data engineer.
• Proficient in general data cleaning and transformation (e.g. SQL, pandas, R, etc) to ensure data accuracy and consistency.
• Proficient in building ETL pipeline (eg. SQL Server Integration Services (SSIS), AWS Database Migration Services (DMS), Python, AWS Lambda, ECS Container task, Eventbridge, AWS Glue, Spring).
• Proficient in database design and various databases (e.g. SQL, PostgreSQL, AWS S3, Athena, mongodb, postgres/gis, mysql, sqlite, voltdb, cassandra, etc).
• Experience in cloud technologies such as GPC, GCC (i.e. AWS, Azure, Google Cloud).
• Experience and passion for data engineering in a big data environment using Cloud platforms such as GPC, GCC (i.e. AWS, Azure, Google Cloud).
• Experience with building production-grade data pipelines, ETL/ELT data integration.
• Knowledge about system design, data structure and algorithms.
• Familiar with data modelling, data access, and data storage infrastructure like Data Mart, Data Lake, Data Virtualisation and Data Warehouse for efficient storage and retrieval.
• Familiar with rest api and web requests/protocols in general.
• Familiar with big data frameworks and tools (eg. Hadoop, Spark, Kafka,RabbitMQ).
• Familiar with W3C Document Object Model and customized web scraping (e.g. BeautifulSoup, CasperJS, PhantomJS, Selenium, Nodejs, etc).
• Familiar with data governance policies, access control and security best practices.
• Comfortable in at least one scripting language (eg. SQL,Python).
• Comfortable in both windows and linux development environments.
• Interest in being the bridge between engineering and analytics.

Due to volume of applications, we regret that only shortlisted candidates will be notified.

Please note that Deloitte will never reach out to you directly via messaging platforms to offer you employment opportunities or request for money or your personal information. Kindly apply for roles that you are interested in via this official Deloitte website.

#LI-HI