Senior Python Data Engineer - Scalable ETL Pipelines (Hybrid)

ENVISION DIGITAL TECHNOLOGIES SDN BHD; Kuala Lumpur; Hybrid; MYR 150,000 - 200,000; Full time

Job summary

A technology solutions firm in Kuala Lumpur seeks a Senior Python Developer to design and optimize ETL pipelines for large-scale data processing. The ideal candidate should have substantial experience in Python and Django, as well as expertise in handling high-volume datasets. Responsibilities include developing back-end services and integrating APIs for data collection. This role offers a dynamic work culture and flexible arrangements, emphasizing continuous improvement and collaboration.

Benefits

13th Month Salary (AWS)

Flexi Allowance

Insurance, Medical, Dental & Optical Coverage

Parking & Transport Support

Hybrid Work Arrangement

Office Near LRT

Dynamic & Supportive Environment

Qualifications

• More than 2 years of professional experience in Python, focusing on data processing.
• Hands-on experience with Scrapy or similar frameworks for ETL systems.
• Excellent communication skills for stakeholder coordination.

Responsibilities

• Design and develop ETL pipelines using Python and Scrapy.
• Integrate external APIs and develop backend services using Django and Spring Boot.
• Monitor and optimize pipeline performance with automated alerts.

Skills

Python

Django

Java Spring Boot

RESTful API integration

SQL (MySQL, PostgreSQL)

Scrapy

Data validation

Communication

Tools

Linux

Docker

Airflow

Job description

A technology solutions firm in Kuala Lumpur seeks a Senior Python Developer to design and optimize ETL pipelines for large-scale data processing. The ideal candidate should have substantial experience in Python and Django, as well as expertise in handling high-volume datasets. Responsibilities include developing back-end services and integrating APIs for data collection. This role offers a dynamic work culture and flexible arrangements, emphasizing continuous improvement and collaboration.