PySpark Data Engineer: ETL & Pipelines

Infosight Consulting Limited

Hong Kong

On-site

HKD 360,000 - 720,000

Full time

5 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Infosight Consulting Limited is seeking a data engineer in Hong Kong to develop, test, and maintain data processing pipelines using PySpark and related technologies. The role requires 1–3 years of Python experience, strong SQL, and a good understanding of Apache Spark.

Proficiency in Pandas and ETL processes, plus English and Cantonese communication, is essential; Putonghua is a plus. The candidate will contribute to data extraction, transformation, and loading from multiple sources, participate

Qualifications

1–3 years of experience in Python and data engineering.
Strong knowledge of Spark architecture and components (RDDs, DataFrames).
Proficient in SQL for data querying and manipulation.
Experience with ETL pipelines using PySpark.
Fluent in English and Cantonese; Putonghua is a plus.

Responsibilities

Develop, test, and maintain data processing applications and pipelines using PySpark and related technologies.
Perform data extraction, transformation, and loading (ETL) from multiple sources into target systems.
Participate in code reviews, documentation, and continuous improvement of data processes.
Troubleshoot and resolve issues in data processing and integration environments.
Support the deployment, monitoring, and maintenance of data solutions in production.