Data Engineer: Python, SQL & AWS Pipelines

TRUST RECRUIT PTE. LTD.; Singapore; Presencial; SGD 39 000 - 78 000; Tempo integral

Resumo da oferta

TRUST RECRUIT PTE. LTD. is seeking a data engineer to assist in developing and maintaining data pipelines for DRUMS and remote monitoring systems in a Singapore-based role.

You will process time-series sensor data, implement ETL/ELT pipelines, and work with AWS services like S3, RDS, Lambda, and Glue. Proficiency in Python, SQL, and pandas/NumPy is required, with exposure to Docker, Airflow, and Linux beneficial.

Qualificações

• Degree or Diploma in Computer Science, Data Engineering, IT, or related field.
• Strong Python skills and good working knowledge of SQL for database management, data processing, and API development.
• Understanding of ETL/ELT pipelines, data integration, data transformation, and database optimization.
• Hands-on experience with pandas, NumPy, and SQL databases such as MySQL or PostgreSQL.
• Familiarity with AWS cloud services (S3, RDS, Lambda, AWS Glue).
• Able to use AI coding assistants (e.g. Claude Code, Codex, Cursor) effectively to speed up development while reviewing code.
• Comfortable with Linux, Git, and basic scripting.
• Basic understanding of real-time data pipelines, Docker, Apache Airflow or data streaming technologies is an advantage.

Responsabilidades

• Assist the data engineering team in developing and maintaining data pipelines for DRUMS and remote monitoring applications.
• Support collection, cleaning, transformation, and processing of time-series sensor data from shipboard machinery.
• Assist in developing and testing ETL/ELT processes for reliable data ingestion, storage, and retrieval.
• Work with the team to support AWS cloud services, including S3, RDS, Lambda, and AWS Glue.
• Assist with database operations, SQL queries, data validation, and data quality checks under guidance of senior team members.
• Support the development and testing of APIs and backend services using Python and SQL for AI/ML applications and web platforms.
• Help monitor data pipelines, troubleshoot issues, and improve data processing efficiency with guidance from the team.
• Assist in preparing technical documentation, test reports, and data processing procedures.
• Collaborate with other data engineers and team members on ongoing projects and technical tasks.
• Perform other duties and ad-hoc assignments as directed by the team lead and department manager.

Conhecimentos

Python

SQL

Pandas

NumPy

Git

Linux

Scripting

AI coding assistants usage

Formação académica

Degree/Diploma in Computer Science, Data Engineering, IT

Ferramentas

MySQL

PostgreSQL

AWS

Docker

Apache Airflow

Descrição da oferta de emprego

TRUST RECRUIT PTE. LTD. is seeking a data engineer to assist in developing and maintaining data pipelines for DRUMS and remote monitoring systems in a Singapore-based role.

You will process time-series sensor data, implement ETL/ELT pipelines, and work with AWS services like S3, RDS, Lambda, and Glue. Proficiency in Python, SQL, and pandas/NumPy is required, with exposure to Docker, Airflow, and Linux beneficial.