Data Engineer (Python, ETL)

PowTech Solution (M) Sdn. Bhd; Kuala Lumpur; Remote; MYR 368,000 - 613,000; Part time

Job summary

PowTech Solution (M) Sdn. Bhd is seeking a skilled Data Engineer to design, build, and maintain ETL connectors and data pipelines using a Python-based framework. The role emphasizes API integration, data engineering principles, and test-driven development in a remote setting (AU/NZ timezone).

The contract spans 12 months with renewal, focusing on cloud data warehouses and enterprise SaaS data flows, requiring strong Python skills and collaboration with an AU/NZ based team.

Qualifications

• 3 to 7 years proven experience in data engineering or software development.
• Strong, hands-on Python skills with solid ETL/ELT knowledge.
• Experience with API interactions and cloud data warehouse platforms.
• Familiarity with test-driven development practices.
• Good command of English, written and spoken, to work with AU/NZ team.
• Excellent problem-solving and ability to work independently.

Responsibilities

• Design, develop, and maintain ETL pipelines and connectors to SaaS apps using an in-house Python framework.
• Build and maintain data pipeline logic using Python with cloud data warehousing exposure.
• Use AI coding tools to prototype pipelines while ensuring quality and adjustments.
• Work with APIs to handle data exchange and secure communications.
• Manipulate data using Python dataframes and third-party packages.
• Conduct testing and QA to keep pipelines reliable and scalable.
• Adapt to enterprise B2B data systems to build effective solutions.

Skills

Python

ETL/ELT

APIs

Dataframes

Cloud data warehouses

Test-driven development

English communication

Education

Bachelor's degree in Computer Science or related field

Tools

GitHub Copilot

LLM-based agents

Job description

We are seeking a skilled Data Engineer with strong Python fundamentals and hands-on ETL experience. The successful candidate will be instrumental in developing and maintaining ETL connectors and data pipelines using our proprietary Python-based framework. This role requires a solid understanding of API integration, data engineering principles, and a commitment to test-driven development.

Job Type: Contract (12 Months, renewable)
Location: Remote (AU/NZ timezone)

Responsibilities

Design, develop, and maintain ETL pipelines and connectors to SaaS applications using an in-house Python-based framework.

Build and maintain data pipeline logic using Python, with exposure to cloud data warehouse platforms.

Use AI coding tools like GitHub Copilot and other LLM-based agents to prototype pipelines faster, while assessing quality and making adjustments as needed.

Work with APIs to handle data exchange, implementing authentication methods and secure communications.

Manipulate and manage data using Python dataframes and third-party Python packages.

Conduct testing and quality assurance to keep pipelines reliable and scalable.

Quickly adapt to and understand enterprise B2B data systems to build effective solutions.

Qualifications

Qualifications in Computer Science, Engineering, or a related field.

3to 7 years proven experience in data engineering or software development, with very solid, hands-on Python skills.

Strong familiarity with data engineering concepts, ETL/ELT processes, and pipeline design.

Experience with API interactions and protocols.

Experience with cloud data warehouse platforms (Snowflake, BigQuery, Redshift, or similar) is a plus.

Knowledge of test-driven development practices.

Good command of English, written and spoken, to work closely with an AU/NZ based team.

Strong soft skills alongside strong hard skills. Excellent problem-solving ability and capacity to work independently.

Why Join Us?

We are a small, friendly team building a great product that customers love. We are a customer-funded, profitable company with achievable growth plans, led by product and engineering founders.