Senior Data Engineer

PT. LOTTE INNOVATE INDONESIA; Cilegon; On-site; IDR 200.000.000 - 300.000.000; Full time

Job summary

A leading technology company in Indonesia is looking for a Data Engineer with over 5 years of experience. The role involves designing and building a Data Management System, developing data ingestion pipelines, and maintaining data lake architecture. Required skills include strong proficiency in Python and SQL, along with experience in using Kafka and Docker. Candidates should also have hands-on experience with on-premise data systems. This position offers opportunities to work on AI and data-driven applications.

Qualifications

• 5+ years of experience in Data Engineering / Data Platform roles.
• Strong proficiency in Python and SQL.
• Hands-on experience with on-premise data systems.
• Experience with data lakes and ETL pipelines.
• Experience with Kafka or streaming platforms.
• Working knowledge of Docker and Linux.

Responsibilities

• Design and build an on-premise Data Management System.
• Develop and operate data ingestion pipelines for structured/unstructured data.
• Build and maintain data lake architecture using object storage.
• Develop ETL/ELT pipelines to ensure data quality.
• Implement streaming data pipelines using Kafka.
• Deploy and operate data platform components using Docker.
• Prepare and manage data for AI and RAG-based applications.
• Document data pipelines, data models, and system architecture.

Skills

Data Engineering

Python

SQL

Kafka

Docker

Linux

Tools

MinIO

Job description

Design and build an on-premise Data Management System from scratch.

Develop and operate data ingestion pipelines for structured and unstructured data.

Build and maintain data lake architecture using object storage (MinIO).

Develop ETL/ELT pipelines to ensure data quality, consistency, and usability.

Implement streaming data pipelines using Kafka where required.

Deploy and operate data platform components using Docker-based deployment.

Prepare and manage data for AI and RAG-based applications.

Document data pipelines, data models, and system architecture.

Collaborate with developers, AI engineers, and IT infrastructure teams.

Job Requirements

• 5+ years of experience in Data Engineering / Data Platform roles.
• Strong proficiency in Python and SQL.
• Hands-on experience with on-premise data systems (non-cloud environments).
• Experience with data lakes, object storage (MinIO / S3-compatible), and ETL pipelines.
• Experience with Kafka or streaming platforms.
• Working knowledge of Docker and Linux.
• Experience supporting AI or data-driven applications is a plus.