Data Engineer - Hong Kong Conglomerate

TEKsystems; Hong Kong; In loco; HKD 600.000 - 1.000.000; Tempo pieno

Descrizione del lavoro

TEKsystems is seeking an experienced Data Engineer to join a dedicated Reporting & Downstream squad supporting a major enterprise data transformation programme. The role focuses on building an AWS-based data platform, creating scalable data pipelines and consolidating data domains for reporting and analytics.

You will design, ingest, and transform data using AWS S3, AWS Glue, Spark and Python, leveraging PySpark and Spark SQL for large-scale processing.

Competenze

• Experience with AWS data services and Spark.
• Proficient in Python and PySpark.
• Hands-on with Spark SQL.
• Experience with data lakes and ETL/ELT.
• Experience with data ingestion and pipeline development.

Mansioni

• Design, build and maintain scalable data pipelines.
• Ingest and transform data from multiple source systems into the enterprise data platform.
• Develop solutions using AWS S3, AWS Glue, Spark and Python.
• Work with PySpark and Spark SQL for large-scale data processing and transformation.
• Support the consolidation of different data domains into a unified data platform.
• Prepare data for downstream Power BI reporting and analytics.
• Enable analysis across business performance, P&L and different business segments.
• Work closely with Data QA, Product Owner, Business Analyst, Scrum Master and Technical Lead.
• Follow strong engineering practices around automation, testing, governance and documentation.
• Deliver within a fully Agile squad environment.

Conoscenze

AWS

Amazon S3

AWS Glue

Apache Spark

Python / PySpark

Spark SQL

Data pipelines

ETL / ELT

Data ingestion

Data transformation

Strumenti

Python

Spark

Descrizione del lavoro

TEKsystems is looking for experienced Data Engineer to join a dedicated Reporting & Downstream squad supporting a major enterprise data transformation programme. This is a long-term capability build focused on developing and enhancing an AWS-based data platform, building scalable data pipelines and bringing together multiple data domains to support reporting, analytics and business performance insights.

Key responsibilities

Design, build and maintain scalable data pipelines

Ingest and transform data from multiple source systems into the enterprise data platform

Develop solutions using AWS S3, AWS Glue, Spark and Python

Work with PySpark and Spark SQL for large-scale data processing and transformation

Support the consolidation of different data domains into a unified data platform

Prepare data for downstream Power BI reporting and analytics

Enable analysis across business performance, P&L and different business segments

Work closely with Data QA, Product Owner, Business Analyst, Scrum Master and Technical Lead

Follow strong engineering practices around automation, testing, governance and documentation

Deliver within a fully Agile squad environment

About you

Strong experience with AWS, Amazon S3 AWS Glue, Apache Spark

Strong experience with Python / PySpark

Strong experience with Spark SQL

Experience with data lakes

Experience with ETL / ELT

Experience with data ingestion and transformation

Experience with data pipeline development