Data Engineer

RESOURCE CONSULTING PTE. LTD.; Singapore; On-site; SGD 70,000 - 110,000; Full time

Job summary

RESOURCE CONSULTING PTE. LTD. is seeking a Data Engineer in Singapore to design, develop, and maintain scalable data pipelines and analytics capabilities. You will work with cross-functional teams to deliver reliable data architectures and practical insights across multiple business domains.

You will optimize data delivery, ensure data quality, and implement secure data platforms using AWS technologies and modern big data tooling. A strong SQL background and 3+ years of experience are required.

Qualifications

• Bachelor’s degree in CS/SE/IT or related field.
• 3 years of software development experience.
• Strong analytical and problem-solving skills.
• Advanced SQL knowledge with relational databases and query authoring.
• Experience building and optimizing big data pipelines and datasets.
• Ability to perform root cause analysis on data and processes.
• Experience with data transformation, metadata, and workload management.
• Familiarity with big data tools and cloud services (AWS).

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures.
• Build and manage large datasets ensuring data quality, reliability, and accessibility.
• Automate workflows and optimize data delivery for scalability and performance.
• Develop ETL processes using SQL and AWS big data technologies.
• Create analytics solutions leveraging datapipelines to generate insights.
• Collaborate with executives, product, data, and design teams.
• Design secure, distributed data architectures across regions and centers.
• Develop tools enabling analytics and data science teams to explore data.
• Partner with data teams to enhance data systems' functionality and reliability.
• Champion best practices for scalable and secure data platforms.

Skills

Analytical mindset

Problem solving

Advanced SQL

Big data pipelines

Relational databases

NoSQL databases

Python

Java

Scala

AWS

Education

Bachelor's degree in Computer Science / Software Engineering / IT

Tools

Hadoop

Spark

Kafka

SQL

NoSQL

AWS

Job description

Our client, an IT services, software development, and dataengineering consulting company, is looking for a Data Engineer to join their team.

Responsibilities:

• Design,develop, and maintain scalable and high-performancedata pipeline architectures that support business and analytical requirements.
• Build andmanage large, complex datasets that meet functionaland non-functional business requirements, ensuring data quality, reliability,and accessibility.
• Identify andimplement process improvements by automating manualworkflows, optimizing data delivery, and redesigning infrastructure to improvescalability, efficiency, and performance.
• Develop robustdata infrastructure for the extraction,transformation, and loading (ETL) of data from diverse sources using SQL andAWS big data technologies.
• Developanalytics solutions and tools that leverage datapipelines to generate actionable insights into customer acquisition,operational efficiency, and other key business performance metrics.
• Collaboratecross-functionally with Executive, Product, Data,and Design teams to resolve data-related technical challenges and supportevolving data infrastructure requirements.
• Design andimplement secure, distributed data architecturesthat ensure data is appropriately segregated and protected across nationalboundaries, data centers, and AWS regions.
• Develop datatools and platforms that enable analytics and datascience teams to efficiently explore, analyze, and optimize data to supportproduct innovation and business growth.
• Partner withdata and analytics specialists to continuouslyenhance the functionality, reliability, scalability, and performance of datasystems.
• Champion dataengineering best practices, ensuring that dataplatforms and pipelines are scalable, secure, maintainable, and aligned withevolving business needs.

Requirements:

• Bachelor's Degree in Computer Science, Software Engineering, Information Technology, Information Systems, or a related discipline.
• Around 3 years of software development experience
• Strong analytical and problem-solving skills.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Experience building and optimising big data pipelines, architectures and data sets
• Experience in performing root cause analysis on internal and external data and processes to address specific business questions and identify opportunities for improvement
• Build processes supporting data transformation, data structures, metadata, dependency and workload management
• Experience in manipulating, processing and extracting value from large disconnected datasets
• Knowledge of message queuing, stream processing, and highly scalable 'big data' data stores
• Experience with big data tools: Hadoop, Spark, Kafka, etc., relational SQL and NoSQL databases, data pipeline and workflow management tools, AWS cloud services, stream processing systems and object-oriented/object function scripting languages such as Python, Java, C++, Scala, etc.

We regret that only shortlisted candidates will be notified.

EALicense No.: 08C3209

RegistrationNo.: R1101742