Data Engineer – AWS Pipelines & Analytics

TEKsystems; Hong Kong; Presencial; HKD 600.000 - 1.000.000; Jornada completa

Descripción de la vacante

TEKsystems is seeking an experienced Data Engineer to join a dedicated Reporting & Downstream squad supporting a major enterprise data transformation programme. The role focuses on building an AWS-based data platform, creating scalable data pipelines and consolidating data domains for reporting and analytics.

You will design, ingest, and transform data using AWS S3, AWS Glue, Spark and Python, leveraging PySpark and Spark SQL for large-scale processing.

Formación

• Experience with AWS data services and Spark.
• Proficient in Python and PySpark.
• Hands-on with Spark SQL.
• Experience with data lakes and ETL/ELT.
• Experience with data ingestion and pipeline development.

Responsabilidades

• Design, build and maintain scalable data pipelines.
• Ingest and transform data from multiple source systems into the enterprise data platform.
• Develop solutions using AWS S3, AWS Glue, Spark and Python.
• Work with PySpark and Spark SQL for large-scale data processing and transformation.
• Support the consolidation of different data domains into a unified data platform.
• Prepare data for downstream Power BI reporting and analytics.
• Enable analysis across business performance, P&L and different business segments.
• Work closely with Data QA, Product Owner, Business Analyst, Scrum Master and Technical Lead.
• Follow strong engineering practices around automation, testing, governance and documentation.
• Deliver within a fully Agile squad environment.

Conocimientos

AWS

Amazon S3

AWS Glue

Apache Spark

Python / PySpark

Spark SQL

Data pipelines

ETL / ELT

Data ingestion

Data transformation

Herramientas

Python

Spark

Descripción del empleo

TEKsystems is seeking an experienced Data Engineer to join a dedicated Reporting & Downstream squad supporting a major enterprise data transformation programme. The role focuses on building an AWS-based data platform, creating scalable data pipelines and consolidating data domains for reporting and analytics.

You will design, ingest, and transform data using AWS S3, AWS Glue, Spark and Python, leveraging PySpark and Spark SQL for large-scale processing.