ETL Developer - RA

Axonect; Kebayoran Baru; On-site; IDR 167,400,000 - 390,600,000; Full time

Job summary

Axonect, located in Jakarta, seeks an experienced ETL Developer to design, build, and maintain high-performance ETL pipelines on Tencent Cloud platforms, especially using WeData for integration and orchestration and DLC for SQL-based lake processing. The role requires strong hands-on experience with Spark underneath.

You will transform data from various sources into a robust data lakehouse, implement incremental loading, and monitor pipelines with real-time insights.

Qualifications

• 3+ years hands-on ETL development experience.
• Direct experience with Tencent Cloud WeData (data integration, orchestration, scheduling).
• Direct experience with Tencent Cloud DLC (Data Lake Compute) – SQL-based lake processing.
• Bachelor's degree in Computer Science or related field.

Responsibilities

• Design, build, schedule, and monitor end-to-end ETL pipelines using Tencent Cloud WeData.
• Develop and optimize SQL-based ETL jobs on DLC (Data Lake Compute) with Spark engine.
• Perform data extraction, transformation, cleaning, and loading into data lakehouse from multiple sources.
• Implement incremental loading, scheduling, orchestration, and real-time monitoring of pipelines.
• Troubleshoot pipeline failures and optimize Spark and SQL performance.
• Collaborate with data architects and business teams to deliver reliable data solutions.

Skills

ETL development

SQL

Spark

Education

Bachelor's degree in Computer Science or related fields

Tools

Tencent Cloud WeData

Tencent Cloud DLC

Hive

Hadoop

Iceberg

Ab Initio

Python/Scala

Job description

Role Summary

We are seeking a skilled ETL Developer to design, develop, and maintain high-performance ETL pipelines on Tencent Cloud platforms, especially using WeData for data integration and orchestration, and DLC (Data Lake Compute) for SQL-based lake processing. The role requires strong hands-on experience in building, scheduling, and monitoring ETL data flows with Spark underneath.

Key Responsibilities

• Design, build, schedule, and monitor end-to-end ETL pipelines using Tencent Cloud WeData
• Develop and optimize SQL-based ETL jobs on DLC (Data Lake Compute) with Spark engine
• Perform data extraction, transformation, cleaning, and loading from various source systems into data lakehouse
• Implement incremental loading, scheduling, orchestration, and real-time monitoring of pipelines
• Troubleshoot pipeline failures and optimize performance (Spark tuning, SQL optimization)
• Collaborate with data architects and business teams to understand data requirements and deliver reliable solutions

Person Specifications

• Minimum 3+ years of hands-on ETL development experience (build, schedule, and monitor pipelines)
• Direct and proven experience with Tencent Cloud WeData (data integration, orchestration, scheduling)
• Direct and proven experience with Tencent Cloud DLC (Data Lake Compute) – SQL-based lake processing
• Strong proficiency in SQL and Spark (DLC uses Spark for backend ETL processing)
• Bachelor's degree in Computer Science or related fields

Preferred Qualifications

• Experience with Hive, Hadoop, Iceberg, Lakehouse architecture
• Previous experience with Ab Initio or other legacy ETL tools
• Familiarity with other Tencent Cloud products: EMR, COS, TencentDB, CLS
• Proficiency in Python or Scala scripting for ETL automation
• Background in telecom, data warehouse, or large-scale data migration projects
• Joining: Immediate joiners are highly preferable

Contract Duration - 06 months