Data Engineer: Real-Time Pipelines & Data Marts

PT Sea Group; Jakarta Pusat; Presencial; IDR 167 400 000 - 334 800 000; Tempo integral

Resumo da oferta

Monee is seeking engineers to work on core data platforms, scaling infrastructure and building new markets and products. You will develop batch and real-time feature pipelines with Spark/Flink, craft Data Marts, and optimize ETL processes to ensure data quality and reliability across regulated environments.

Ideal candidates have 3+ years in data engineering, strong SQL and Python/Scala/Java skills, and hands-on experience with data warehousing, Kafka, Hive, and Airflow.

Qualificações

• 3+ years of experience in data engineering or big data development.
• Strong SQL and Python/Scala/Java skills.
• Experience with Spark/Flink for batch and stream processing.
• Solid understanding of data warehousing and Data Mart development.
• Familiarity with Kafka, Hive, and Airflow.

Responsabilidades

• Develop, optimize, and maintain batch and real-time feature pipelines using Spark/Flink.
• Design, build, and maintain business Data Marts, including data modeling, ETL development, and performance optimization.
• Ensure data quality, accuracy, and pipeline reliability, continuously improving data processing efficiency.
• Collaborate with DS, policy, risk and business teams to support feature engineering and data requirements.

Conhecimentos

SQL

Python

Scala

Java

Spark

Flink

Data modeling

ETL development

Data warehousing

Ferramentas

Kafka

Hive

Airflow

Descrição da oferta de emprego

Monee is seeking engineers to work on core data platforms, scaling infrastructure and building new markets and products. You will develop batch and real-time feature pipelines with Spark/Flink, craft Data Marts, and optimize ETL processes to ensure data quality and reliability across regulated environments.

Ideal candidates have 3+ years in data engineering, strong SQL and Python/Scala/Java skills, and hands-on experience with data warehousing, Kafka, Hive, and Airflow.