Senior Data Engineer: On-Prem Data Platform & Pipelines

PT. LOTTE INNOVATE INDONESIA; Cilegon; On-site; IDR 200.000.000 - 300.000.000; Full time

Job summary

A leading technology company in Indonesia is looking for a Data Engineer with over 5 years of experience. The role involves designing and building a Data Management System, developing data ingestion pipelines, and maintaining data lake architecture. Required skills include strong proficiency in Python and SQL, along with experience in using Kafka and Docker. Candidates should also have hands-on experience with on-premise data systems. This position offers opportunities to work on AI and data-driven applications.

Qualifications

• 5+ years of experience in Data Engineering / Data Platform roles.
• Strong proficiency in Python and SQL.
• Hands-on experience with on-premise data systems.
• Experience with data lakes and ETL pipelines.
• Experience with Kafka or streaming platforms.
• Working knowledge of Docker and Linux.

Responsibilities

• Design and build an on-premise Data Management System.
• Develop and operate data ingestion pipelines for structured/unstructured data.
• Build and maintain data lake architecture using object storage.
• Develop ETL/ELT pipelines to ensure data quality.
• Implement streaming data pipelines using Kafka.
• Deploy and operate data platform components using Docker.
• Prepare and manage data for AI and RAG-based applications.
• Document data pipelines, data models, and system architecture.

Skills

Data Engineering

Python

SQL

Kafka

Docker

Linux

Tools

MinIO

Job description

A leading technology company in Indonesia is looking for a Data Engineer with over 5 years of experience. The role involves designing and building a Data Management System, developing data ingestion pipelines, and maintaining data lake architecture. Required skills include strong proficiency in Python and SQL, along with experience in using Kafka and Docker. Candidates should also have hands-on experience with on-premise data systems. This position offers opportunities to work on AI and data-driven applications.