Data Pipeline Engineer (Python) & APIs

The Consensus; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Kpler in Singapore is seeking a Software Engineer to join the Cargo Movements team. You will contribute to backend data pipelines, APIs, and front-end/backend capabilities, ensuring system reliability and high availability while aligning with requirements and designs.

You'll write clean, tested code, participate in design discussions, and collaborate with product managers, engineers, analysts, and data scientists to deliver robust product features.

Qualifications

• Proven experience building data processing, transformation, or integration workflows with Python.
• Strong understanding of data integration and ETL concepts (batch, streaming, asynchronous).
• Proficient in SQL and relational databases; API/back-end development experience.
• Familiarity with modern development practices: Git, code reviews, automated testing, CI/CD.
• Ability to write clean, maintainable, well-tested code aligned with engineering standards.
• Basic awareness of containerisation (Docker) and cloud platforms.
• Curious, eager to learn new technologies, and able to collaborate across cross-functional teams.

Responsibilities

• Develop, maintain, and enhance backend services, data pipelines, APIs, and features.
• Write clean, secure, well-tested code following team standards and best practices.
• Contribute to technical design discussions and review discussions constructively.
• Investigate issues in development and production using logs, metrics, and debugging tools.
• Support reliability and performance through monitoring, testing, deployment, and ops improvements.
• Collaborate with product, engineering, analytics, and data science to deliver reliable capabilities.
• Document technical decisions, features, and operational processes as needed.

Skills

Python

SQL

APIs

Git

CI/CD

Testing

Debugging

Communication

Collaboration

English fluency

Tools

Docker

Kafka

Elasticsearch

AWS

Vue.js

TypeScript

JavaScript

Job description

Kpler in Singapore is seeking a Software Engineer to join the Cargo Movements team. You will contribute to backend data pipelines, APIs, and front-end/backend capabilities, ensuring system reliability and high availability while aligning with requirements and designs.

You'll write clean, tested code, participate in design discussions, and collaborate with product managers, engineers, analysts, and data scientists to deliver robust product features.