Data Engineer

RESOURCE CONSULTING PTE. LTD.; Singapore; On-site; SGD 90,000 - 140,000; Full time

Job summary

RESOURCE CONSULTING PTE. LTD. is seeking a Data Engineer to design and maintain scalable data pipelines. You will build large datasets and automate workflows to improve reliability and performance, using SQL and AWS big data technologies.

You will collaborate with cross-functional teams to develop analytics solutions and support data infrastructure needs across the organization.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, IT, or related field.
• Around 3 years of software development experience.
• Strong analytical and problem-solving skills.
• Advanced SQL knowledge with relational databases and query authoring.
• Experience building and optimising big data pipelines and datasets.
• Familiarity with data transformation, metadata, and workload management.

Responsibilities

• Design, develop, and maintain scalable data pipeline architectures.
• Build and manage large datasets ensuring quality and accessibility.
• Automate workflows and optimize data delivery for efficiency.
• Develop ETL processes using SQL and AWS big data tools.
• Create analytics solutions leveraging datapipelines for insights.
• Collaborate across teams to support evolving data infrastructure.

Skills

SQL

Data pipelines

Big data concepts

Problem solving

Relational databases

Analytical thinking

Education

Bachelor's degree in Computer Science / IT / related

Tools

Hadoop

Spark

Kafka

AWS

NoSQL databases

Python

Java

Job description

Our client, an IT services, software development, and dataengineering consulting company, is looking for a Data Engineer to join their team.

Responsibilities:

• Design,develop, and maintain scalable and high-performancedata pipeline architectures that support business and analytical requirements.
• Build andmanage large, complex datasets that meet functionaland non-functional business requirements, ensuring data quality, reliability,and accessibility.
• Identify andimplement process improvements by automating manualworkflows, optimizing data delivery, and redesigning infrastructure to improvescalability, efficiency, and performance.
• Develop robustdata infrastructure for the extraction,transformation, and loading (ETL) of data from diverse sources using SQL andAWS big data technologies.
• Developanalytics solutions and tools that leverage datapipelines to generate actionable insights into customer acquisition,operational efficiency, and other key business performance metrics.
• Collaboratecross-functionally with Executive, Product, Data,and Design teams to resolve data-related technical challenges and supportevolving data infrastructure requirements.
• Design andimplement secure, distributed data architecturesthat ensure data is appropriately segregated and protected across nationalboundaries, data centers, and AWS regions.
• Develop datatools and platforms that enable analytics and datascience teams to efficiently explore, analyze, and optimize data to supportproduct innovation and business growth.
• Partner withdata and analytics specialists to continuouslyenhance the functionality, reliability, scalability, and performance of datasystems.
• Champion dataengineering best practices, ensuring that dataplatforms and pipelines are scalable, secure, maintainable, and aligned withevolving business needs.

Requirements:

• Bachelor's Degree in Computer Science, Software Engineering, Information Technology, Information Systems, or a related discipline.
• Around 3 years of software development experience
• Strong analytical and problem-solving skills.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Experience building and optimising big data pipelines, architectures and data sets
• Experience in performing root cause analysis on internal and external data and processes to address specific business questions and identify opportunities for improvement
• Build processes supporting data transformation, data structures, metadata, dependency and workload management
• Experience in manipulating, processing and extracting value from large disconnected datasets
• Knowledge of message queuing, stream processing, and highly scalable 'big data' data stores
• Experience with big data tools: Hadoop, Spark, Kafka, etc., relational SQL and NoSQL databases, data pipeline and workflow management tools, AWS cloud services, stream processing systems and object-oriented/object function scripting languages such as Python, Java, C++, Scala, etc.

We regret that only shortlisted candidates will be notified.

EALicense No.: 08C3209

RegistrationNo.: R1101742