Lead Data Engineer: Scalable Pipelines & Data Strategy

Artefact; Jakarta Pusat; On-site; IDR 350,000,000 - 550,000,000; Full time

Job summary

Artefact is seeking a Senior Data Engineer to join our fast-growing team in Jakarta. You will design, build, and maintain scalable data pipelines and collaborate with stakeholders to translate business needs into technical solutions.

You will lead a team of data engineers, implement CI/CD, enforce data governance, and help optimise data retrieval with dashboards and reports for business units.

Qualifications

• 6+ years of industry experience in data engineering with a strong technical proficiency in SQL, Python, and big data technologies.
• Certification in AWS and/or GCP.
• Proven leadership skills and experience managing data engineering teams.

Responsibilities

• Design, build, and maintain scalable and robust data pipelines using SQL, Python, Databricks, Snowflake, Azure Data Factory, AWS Glue, Apache Airflow and Pyspark.
• Lead the integration of complex data systems and ensure consistency and accuracy of data across multiple platforms.
• Implement continuous integration and continuous deployment (CI/CD) practices for data pipelines to improve efficiency and quality of data processing.
• Work closely with data architects, analysts, and other stakeholders to understand business requirements and translate them into technical implementations.
• Oversee and manage a team of data engineers, providing guidance and mentorship to ensure high‑quality project deliverables.
• Develop and enforce best practices in data governance, security, and compliance within the organisation.
• Optimise data retrieval and develop dashboards and reports for business teams.
• Continuously evaluate new technologies and tools to enhance the capabilities of the data engineering function.

Skills

SQL

Python

Databricks

Snowflake

CI/CD

DevOps

Leadership

Data governance

Education

Bachelor's or Master’s in CS/Engineering

Tools

AWS

GCP

Azure Data Factory

Airflow

Pyspark

Databricks

Job description

Artefact is seeking a Senior Data Engineer to join our fast-growing team in Jakarta. You will design, build, and maintain scalable data pipelines and collaborate with stakeholders to translate business needs into technical solutions.

You will lead a team of data engineers, implement CI/CD, enforce data governance, and help optimise data retrieval with dashboards and reports for business units.