Senior Python Data Pipelines Engineer

Envision Digital; Kuala Lumpur; On-site; MYR 80,000 - 110,000; Full time

Job summary

A leading tech company in Kuala Lumpur is seeking an experienced Senior Python Developer to design and implement large-scale data ingestion and processing pipelines. The role requires proficiency in Python and Django, as well as experience with large datasets and APIs. Ideal candidates should have over 2 years of experience with a strong focus on data processing and ETL systems. The position offers opportunities for collaboration with internal teams and external partners in a vibrant work environment.

Qualifications

• More than 2 years of professional experience in Python and Django.
• Strong programming experience with Java Spring Boot.
• Hands-on experience with data ingestion frameworks like Scrapy.

Responsibilities

• Design and develop ETL pipelines for data ingestion and transformation.
• Integrate external APIs for structured data collection.
• Develop backend services for processing and storing large datasets.

Skills

Python

Django

Java Spring Boot

Scrapy

SQL

RESTful API integration

Linux

Tools

Docker

Airflow

Grafana

Job description

A leading tech company in Kuala Lumpur is seeking an experienced Senior Python Developer to design and implement large-scale data ingestion and processing pipelines. The role requires proficiency in Python and Django, as well as experience with large datasets and APIs. Ideal candidates should have over 2 years of experience with a strong focus on data processing and ETL systems. The position offers opportunities for collaboration with internal teams and external partners in a vibrant work environment.