Software Developer

ABS CONNECT PTE. LTD.; Serangoon Garden Circus; On-site; SGD 80,000 - 120,000; Full time

Job summary

A leading data engineering firm in Singapore is seeking a skilled Software Developer – PySpark to enhance their data solutions. The successful candidate will design and implement data processing pipelines while collaborating with business users. Candidates should have a minimum of 5 years of experience with PySpark, strong skills in Python and SQL, and familiar with Agile methodologies. This is a full-time role with opportunities to leverage Big Data technologies in a dynamic environment.

Qualifications

• Minimum 5 years of professional experience as a Software Developer focused on PySpark.
• Hands-on experience with Big Data technologies and distributed data processing.
• Strong proficiency in Python and SQL.

Responsibilities

• Design, develop, and implement scalable data processing pipelines using PySpark.
• Collaborate with business users to gather and understand requirements.
• Optimize applications using Python and PySpark.

Skills

PySpark

Python

SQL

Debugging

Data Processing

Git

CI/CD

Tools

Spark

Big Data technologies

Job description

Job Description

We are seeking a skilled Software Developer – PySpark to join our data engineering team. The ideal candidate will have strong hands‑on experience in building, optimizing, and maintaining large‑scale data processing systems. You will work as an individual contributor and collaborate closely with business users, stakeholders, and cross‑functional teams to deliver high‑quality data solutions.

Key Responsibilities

• Design, develop, and implement scalable data processing pipelines using PySpark.
• Work as an individual contributor owning end‑to‑end development and delivery.
• Collaborate with business users and stakeholders to gather and understand requirements.
• Develop and optimize applications using Python and PySpark.
• Perform performance tuning and optimization of large‑scale Spark workloads.
• Write and optimize complex SQL queries.
• Support data modeling and schema design activities.
• Debug, troubleshoot, and resolve issues in distributed systems.
• Follow Agile/Scrum methodologies and participate in sprint activities.
• Use Git for version control and contribute to CI/CD pipelines as part of DevOps practices.

Required Skills & Qualifications

• Minimum 5 years of professional experience as a Software Developer with strong focus on PySpark.
• Hands‑on experience with Big Data technologies and distributed data processing.
• Strong proficiency in Python.
• Excellent working knowledge of SQL.
• Solid understanding of Spark concepts (RDDs, Data Frames, partitions, joins, shuffles).
• Experience in Spark performance tuning and optimization.
• Experience using Git and CI/CD pipelines.
• Strong debugging, analytical, and problem‑solving skills.
• Good communication skills and ability to work with stakeholders.