Real-Time Data Engineer: CDC & Streaming Pipelines

PT ABISHAR TECHNOLOGIES INDONESIA; Jakarta Utara; On-site; IDR 300,000,000 - 420,000,000; Full time

Job summary

PT ABISHAR TECHNOLOGIES INDONESIA is seeking an experienced Data Engineer to design, deploy, and maintain production-grade CDC and real-time data integration pipelines using Debezium, Python, Kubernetes, and Oracle On-Premises ODS.

You will monitor Debezium CDC connectors, optimize Python consumers, support Kubernetes deployments, and ensure data transformations into Oracle ODS with reliable error handling and solid documentation.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field, or equivalent professional experience.
• 5+ years of experience in Data Engineering or Backend Development.
• 2+ years of experience with Debezium, including CDC connector configuration for Oracle, PostgreSQL, or SQL Server.
• 2+ years of Python experience developing data pipelines or consumer applications, including asynchronous programming and error handling.
• 1+ year of Kubernetes experience, including deployments, pods, services, ConfigMaps, secrets, resource limits, and troubleshooting.
• 2+ years of RDBMS experience, including SQL queries, data loading, and performance tuning.
• Strong understanding of ETL/ELT, schema evolution, SQL DML, and Python DataFrames.
• Experience with Docker, CI/CD, Git, and monitoring tools such as Prometheus, Grafana, or ELK.

Responsibilities

• Monitor and maintain Debezium CDC connectors for capturing database changes.
• Troubleshoot and optimize Python consumer applications processing Solace messages.
• Support data transformation and loading into Oracle On-Premises ODS.
• Troubleshoot pipeline failures, performance issues, and bottlenecks.
• Support Kubernetes deployments, scaling, and service health checks.
• Maintain operational runbooks and technical documentation.

Skills

Data engineering

Backend development

Python

Debezium

Kubernetes

RDBMS

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Docker

CI/CD

Git

Prometheus

Grafana

ELK

Oracle

Job description

PT ABISHAR TECHNOLOGIES INDONESIA is seeking an experienced Data Engineer to design, deploy, and maintain production-grade CDC and real-time data integration pipelines using Debezium, Python, Kubernetes, and Oracle On-Premises ODS.

You will monitor Debezium CDC connectors, optimize Python consumers, support Kubernetes deployments, and ensure data transformations into Oracle ODS with reliable error handling and solid documentation.