Data Engineer: Spark, AWS & ETL Pipeline Architect

Arbeit Infotech; Jakarta Selatan; On-site; IDR 180,000,000 - 300,000,000; Full time

Job summary

Arbeit Infotech in Indonesia is seeking a Data Engineer to design and maintain scalable ETL/ELT pipelines, integrating multi-source data into centralized data lakes/warehouses. You will collaborate with BI and Data Science teams to deliver clean, modeling-ready datasets and optimize performance across cloud resources.

The role requires 2+ years in data engineering, strong Python/SQL, and experience with Spark, Hadoop, Kafka, and Apache Airflow. On-site in Jakarta Selatan.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, or Informatics.
• Minimum 2 years experience as Data Engineer.
• Strong proficiency in Python and SQL.
• Big Data & Architecture: Spark, Hadoop, Kafka, Data Lakehouse, Apache Iceberg.
• Cloud & DevOps (AWS): S3, Redshift, Glue, EC2, EKS, Git (GitHub/GitLab), CI/CD (Jenkins).
• Orchestration & Modeling: Apache Airflow, Data Warehousing, Dimensional Modeling (Star/Snowflake).
• Governance & Compliance: Data Contracts, Data Entropy (schema change management), privacy laws (GDPR, UU PDP).
• Design, build, and maintain scalable ETL/ELT pipelines integrating multi-source data into centralized data lakes/warehouses.
• Partner with BI, Data Science, and Analyst teams to deliver clean, modeling-ready datasets.
• Optimize query performance, manage cloud storage/compute costs, monitor pipelines, and troubleshoot bottlenecks.
• Implement data validation/cleansing, maintain technical docs (schemas, data dictionaries), and enforce data security.
• Adhere to SOPs, HSE standards, audit remediations, risk controls, and drive continuous process improvements

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines integrating multi-source data into centralized data lakes/warehouses.
• Partner with BI, Data Science, and Analyst teams to deliver clean, modeling-ready datasets.
• Optimize query performance, monitor pipelines, and troubleshoot bottlenecks.
• Implement data validation/cleansing and maintain data dictionaries and schemas.
• Adhere to SOPs, HSE standards, audit remediations, and risk controls.

Skills

Python

SQL

Big Data

Cloud & DevOps

Orchestration & Modeling

Governance & Compliance

ETL/ELT pipelines

Data Quality & Security

Cross-functional collaboration

Performance optimization

Education

Bachelor's degree in Computer Science / Information Systems / Informatics

Tools

Spark

Hadoop

Kafka

Data Lakehouse

Apache Iceberg

AWS (S3, Redshift, Glue, EC2, EKS)

Git (GitHub/GitLab), Jenkins

Apache Airflow

Job description

Arbeit Infotech in Indonesia is seeking a Data Engineer to design and maintain scalable ETL/ELT pipelines, integrating multi-source data into centralized data lakes/warehouses. You will collaborate with BI and Data Science teams to deliver clean, modeling-ready datasets and optimize performance across cloud resources.

The role requires 2+ years in data engineering, strong Python/SQL, and experience with Spark, Hadoop, Kafka, and Apache Airflow. On-site in Jakarta Selatan.