ETL Developer

Referensiin_Aja; Jakarta Selatan; On-site; IDR 360,000,000 - 540,000,000; Full time

Benefits offered by this job

12 months contract

Job summary

Referensiin_Aja is seeking a skilled ETL Developer for a 12-month, on-site role in Jakarta. You will design, build, and monitor end-to-end ETL pipelines using Tencent Cloud WeData and DLC, leveraging Spark for processing.

You will optimize SQL-based ETL jobs, perform extractions, transformations, and load data into a lakehouse, and ensure real-time monitoring and reliability. The position requires 3+ years of hands-on ETL experience, strong SQL and Spark skills, and a Bachelor's degree in

Qualifications

• Minimum 3+ years of hands-on ETL development experience (build, schedule, and monitor pipelines).
• Direct and proven experience with Tencent Cloud WeData (data integration, orchestration, scheduling).
• Direct and proven experience with Tencent Cloud DLC (Data Lake Compute) – SQL-based lake processing.
• Strong proficiency in SQL and Spark (DLC uses Spark for backend ETL processing).
• Bachelor's degree in Computer Science or related fields

Responsibilities

• Design, build, schedule, and monitor end-to-end ETL pipelines using Tencent Cloud WeData.
• Develop and optimize SQL-based ETL jobs on DLC (Data Lake Compute) with Spark engine.
• Perform data extraction, transformation, cleaning, and loading from various source systems into data lakehouse.
• Implement incremental loading, scheduling, orchestration, and real-time monitoring of pipelines.
• Troubleshoot pipeline failures and optimize performance (Spark tuning, SQL optimization).
• Collaborate with data architects and business teams to understand data requirements and deliver reliable solutions

Skills

SQL

Spark

ETL

Data pipelines

Problem solving

Education

Bachelor's degree in Computer Science or related fields

Tools

Tencent Cloud WeData

Tencent Cloud DLC

Hive

Hadoop

Iceberg

Python/Scala scripting

Ab Initio

Job description

From this Platform, we want to help our partners in spreading job vacancy below :

Key Responsibilities

• Design, build, schedule, and monitor end-to-end ETL pipelines using Tencent Cloud WeData
• Develop and optimize SQL-based ETL jobs on DLC (Data Lake Compute) with Spark engine
• Perform data extraction, transformation, cleaning, and loading from various source systems into data lakehouse
• Implement incremental loading, scheduling, orchestration, and real-time monitoring of pipelines
• Troubleshoot pipeline failures and optimize performance (Spark tuning, SQL optimization)
• Collaborate with data architects and business teams to understand data requirements and deliver reliable solutions

Required Qualifications

• Minimum 3+ years of hands-on ETL development experience (build, schedule, and monitor pipelines)
• Direct and proven experience with Tencent Cloud WeData (data integration, orchestration, scheduling)
• Direct and proven experience with Tencent Cloud DLC (Data Lake Compute) – SQL-based lake processing
• Strong proficiency in SQL and Spark (DLC uses Spark for backend ETL processing)
• Bachelor's degree in Computer Science or related fields

Preferred Qualifications

• Experience with Hive, Hadoop, Iceberg, Lakehouse architecture
• Previous experience with Ab Initio or other legacy ETL tools
• Familiarity with other Tencent Cloud products: EMR, COS, TencentDB, CLS
• Proficiency in Python or Scala scripting for ETL automation
• Background in telecom, data warehouse, or large-scale data migration projects
• Joining: Immediate joiners are highly preferable

Industry : Tech

Location : Jakarta

Contract : 12 Months, WFO