Data Engineer - Real-Time Pipelines & Cloud Stack

MateCareer; Jakarta Barat, Jakarta Selatan; On-site; IDR 250,000,000 - 450,000,000; Full time

Job summary

PT Sigma Global Teknologi in Kota Jakarta Barat, DKI Jakarta, Indonesia, is seeking a Data Engineer to design and optimize data pipelines and architectures. You will work with SQL databases, streaming data, and cloud-native tools to ensure reliable data flows.

Applicants should have hands-on experience with Python and SQL, distributed storage and processing, and data wrangling with Pandas or similar libraries, along with tools like Kafka, Airflow, and Airbyte.

Qualifications

• Phyton and advanced SQL with subqueries and window functions.
• Experience with MySQL, PostgreSQL, Oracle, Snowflake and unstructured data.
• Knowledge of distributed data storage and processing architectures.
• Distributed data processing, streaming real-time and batch processing.
• Data pipelines and automation using Airbyte; ingestion via queues; data wrangling with Pandas/NumPy.

Tools

Airbyte

Message Queues

Pandas

NumPy

BeautifulSoup

lxml

Scrapy

APIs

Logging

Dask

Multiprocessing

Apache Kafka

Airflow

Docker

Kubernetes

Qlikview

Tableau

Job description

PT Sigma Global Teknologi in Kota Jakarta Barat, DKI Jakarta, Indonesia, is seeking a Data Engineer to design and optimize data pipelines and architectures. You will work with SQL databases, streaming data, and cloud-native tools to ensure reliable data flows.

Applicants should have hands-on experience with Python and SQL, distributed storage and processing, and data wrangling with Pandas or similar libraries, along with tools like Kafka, Airflow, and Airbyte.