Data Engineer: Scalable Pipelines & ML Readiness

MateCareer; Jawa; On-site; IDR 450,450,450 - 720,720,720; Full time

Job summary

MateCareer is seeking a skilled Data Engineer in Indonesia, Jawa, to design and maintain scalable data infrastructure. This role requires expertise in building ETL/ELT pipelines and integrating data from multiple sources for analytics and machine learning.

The ideal candidate will work collaboratively to ensure data reliability and quality, implementing best practices in pipeline management and orchestration. Passion for data and a hands-on approach in a dynamic environment are essential.

Qualifications

• Experience in designing and building ETL/ELT pipelines.
• Proficient in data ingestion from diverse sources.
• Ability to transform raw data into production-ready datasets.

Responsibilities

• Design and build robust ETL/ELT pipelines for both batch and real-time processing.
• Support and deploy machine learning-ready pipelines.
• Implement comprehensive data quality checks across all pipelines.

Skills

ETL/ELT pipeline design

Data processing

API integration

Cloud platforms (AWS, GCP, Azure)

Automated testing

Docker and Kubernetes

Tools

Apache Airflow

Prefect

Dagster

Job description

MateCareer is seeking a skilled Data Engineer in Indonesia, Jawa, to design and maintain scalable data infrastructure. This role requires expertise in building ETL/ELT pipelines and integrating data from multiple sources for analytics and machine learning.

The ideal candidate will work collaboratively to ensure data reliability and quality, implementing best practices in pipeline management and orchestration. Passion for data and a hands-on approach in a dynamic environment are essential.