Data Engineer

PT ABISHAR TECHNOLOGIES INDONESIA; Jakarta Utara; On-site; IDR 162,000,000 - 198,000,000; Full time

Job summary

PT ABISHAR TECHNOLOGIES INDONESIA is seeking an experienced Data Engineer to monitor Debezium CDC connectors and optimize Python-based data processing pipelines. The role involves supporting Solace message flows, Oracle On-Prem data delivery, and resolving pipeline bottlenecks within a Kubernetes environment.

The ideal candidate has 4+ years in data engineering, with at least 2 years on Debezium and Python, and 1+ year in Kubernetes.

Qualifications

• Minimum 4 years experience in Data Engineer.
• Debezium: 2+ years with CDC connector configuration and source connectors (Oracle, PostgreSQL, SQL Server).
• Python: 2+ years developing data pipelines, consumer applications, async programming, and error handling.
• Kubernetes: 1+ years with pod management, deployments, services, ConfigMaps, secrets, resource limits, and troubleshooting.
• RDBMS: 2+ years with SQL query handling, data loading (SQL*Loader, INSERT/UPDATE scripts), and performance tuning.

Responsibilities

• Monitor and maintain Debezium CDC connectors capturing database changes.
• Troubleshoot and optimize Python consumer applications processing Solace messages.
• Troubleshoot and support transformed data into Oracle On-Premises ODS.
• Troubleshoot and resolve pipeline failures and performance bottlenecks.
• Support Kubernetes deployment, scaling, and health checks for consumer services.
• Maintain runbooks and operational documentation.

Skills

Python development

Async programming

Troubleshooting

Data processing

Tools

Debezium

Kubernetes

Oracle

PostgreSQL

SQL Server

SQL*Loader

Job description

Minimum 4 years experience in Data Engineer. Monitor and maintain Debezium CDC connectors capturing database changes Troubleshoot and optimize Python consumer applications processing Solace messages Troubleshoot and support transformed data into Oracle On-Premises ODS Troubleshoot and resolve pipeline failures and performance bottlenecks Support Kubernetes deployment, scaling, and health checks for consumer services Maintain runbooks and operational documentation . Debezium: 2+ years with CDC connector configuration, source connectors (Oracle, PostgreSQL, SQL Server) Python: 2+ years developing data pipelines, consumer applications, async programming, and error handling Kubernetes: 1+ years with pod management, deployments, services, ConfigMaps, secrets, resource limits, and troubleshooting RDBMS: 2+ years with SQL Query Handling, data loading (SQL*Loader, INSERT/UPDATE scripts), and performance tuning

Computer Software & Networking 51-100 employees

About us

We are a Technology focused company HQ in India, with a mission to assist our Customers to unleash the power of business transformation through effective use of latest technology. We offer full spectrum of services, Consulting - Design - Development - Support services; to provide Turn Key solutions that address the business needs of our Customer organization. Our business operations across geographies are ably supported by our offices in Pune(India), Gurgaon(India), and Jakarta(Indonesia).

Our Core Values

Integrity – We do right things Commitment – We Keep our words Excellence – We give our best

Our Culture

We are passionate about what we do. We encourage our team to be energetic, passionate and motivated. This attitude is exhibited in our culture and our many satisfied customers. Some of the things we'd like to highlight about our culture are Friendly & Open Culture Individual Responsibility No Hierarchy Global Exposure