Lead ETL Engineer - Ab Initio, Python & Spark

PT IDstar Cipta Teknologi (IDstar); Jakarta Pusat; On-site; IDR 500,000,000 - 850,000,000; Full time

Job summary

PT IDstar Cipta Teknologi (IDstar) is seeking an experienced ETL Developer to design, build, and maintain data pipelines for enterprise clients.

The role centers on ETL development with Ab Initio, Python, and Apache Spark, ensuring data quality, performance, and reliable reporting across systems.

Applicants should have 4–8 years in ETL/data engineering, strong SQL skills, and collaboration in Jakarta.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Information Systems, or a related field.
• 4-8 years of experience as an ETL Developer, Data Engineer, or in a similar role.
• Hands-on experience with Ab Initio for ETL development and data integration.
• Proficiency in Python for data processing, scripting, and automation.
• Experience with Apache Spark for distributed data processing and large-scale data transformation.
• Strong understanding of ETL concepts, data warehousing, data integration, and data quality management.
• Experience working with SQL and relational databases.
• Strong analytical, problem-solving, and troubleshooting skills.
• Good communication skills and the ability to collaborate effectively within a team.

Responsibilities

• Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into target systems.
• Develop and optimize data integration workflows using Ab Initio, Python, and Apache Spark.
• Build, schedule, and monitor data pipelines using Apache Airflow.
• Perform data transformation, cleansing, validation, and reconciliation to ensure data accuracy and consistency.
• Optimize ETL workflows and data processing performance to handle large-scale datasets efficiently.
• Troubleshoot data pipeline issues and implement solutions to improve reliability and performance.
• Collaborate with data engineers, business analysts, and other stakeholders to support data integration and reporting requirement.
• Maintain technical documentation for ETL processes, data pipelines, and workflows.

Skills

Python

Apache Spark

ETL concepts

Data warehousing

SQL

Data quality

Teamwork

Problem solving

4-8 years experience

Education

Bachelor's degree

Tools

Ab Initio

Job description

PT IDstar Cipta Teknologi (IDstar) is seeking an experienced ETL Developer to design, build, and maintain data pipelines for enterprise clients.

The role centers on ETL development with Ab Initio, Python, and Apache Spark, ensuring data quality, performance, and reliable reporting across systems.

Applicants should have 4–8 years in ETL/data engineering, strong SQL skills, and collaboration in Jakarta.