Data Engineer: Build Scalable Pipelines with AWS & PySpark

BASE CAMP DIGITAL PTE. LTD.; Singapore; On-site; SGD 70,000 - 100,000; Full time

Job summary

A leading technology company in Singapore is seeking a Data Engineer to design and manage data pipelines while leveraging AWS services. The role involves optimizing workflows and collaborating with teams to apply data solutions effectively. The ideal candidate should possess strong skills in AWS, Python, PySpark, and SQL to ensure high-performance data processing. Familiarity with Databricks is a plus. Join us to enhance our data capabilities in a dynamic environment.

Qualifications

• Practical experience working with core AWS services used in data engineering.
• Strong programming skills for data processing, automation, and scripting.
• In-depth knowledge of Spark and distributed data processing.
• Ability to write complex SQL queries and optimize database performance.

Responsibilities

• Design, build, and manage robust data pipelines and ETL workflows using PySpark.
• Develop and deploy scalable data solutions leveraging AWS services.
• Optimize data processing workflows for performance, reliability, and efficiency.
• Collaborate with team members to deliver scalable data solutions.
• Maintain data security and ensure compliance with standards.

Skills

AWS

Python

PySpark

SQL

Tools

Databricks

Job description

A leading technology company in Singapore is seeking a Data Engineer to design and manage data pipelines while leveraging AWS services. The role involves optimizing workflows and collaborating with teams to apply data solutions effectively. The ideal candidate should possess strong skills in AWS, Python, PySpark, and SQL to ensure high-performance data processing. Familiarity with Databricks is a plus. Join us to enhance our data capabilities in a dynamic environment.