Data Engineer (Python / SQL / AWS)

TRUST RECRUIT PTE. LTD.; Singapore; Presencial; SGD 39 000 - 78 000; Tempo integral

Resumo da oferta

TRUST RECRUIT PTE. LTD. is seeking a data engineer to assist in developing and maintaining data pipelines for DRUMS and remote monitoring systems in a Singapore-based role.

You will process time-series sensor data, implement ETL/ELT pipelines, and work with AWS services like S3, RDS, Lambda, and Glue. Proficiency in Python, SQL, and pandas/NumPy is required, with exposure to Docker, Airflow, and Linux beneficial.

Qualificações

• Degree or Diploma in Computer Science, Data Engineering, IT, or related field.
• Strong Python skills and good working knowledge of SQL for database management, data processing, and API development.
• Understanding of ETL/ELT pipelines, data integration, data transformation, and database optimization.
• Hands-on experience with pandas, NumPy, and SQL databases such as MySQL or PostgreSQL.
• Familiarity with AWS cloud services (S3, RDS, Lambda, AWS Glue).
• Able to use AI coding assistants (e.g. Claude Code, Codex, Cursor) effectively to speed up development while reviewing code.
• Comfortable with Linux, Git, and basic scripting.
• Basic understanding of real-time data pipelines, Docker, Apache Airflow or data streaming technologies is an advantage.

Responsabilidades

• Assist the data engineering team in developing and maintaining data pipelines for DRUMS and remote monitoring applications.
• Support collection, cleaning, transformation, and processing of time-series sensor data from shipboard machinery.
• Assist in developing and testing ETL/ELT processes for reliable data ingestion, storage, and retrieval.
• Work with the team to support AWS cloud services, including S3, RDS, Lambda, and AWS Glue.
• Assist with database operations, SQL queries, data validation, and data quality checks under guidance of senior team members.
• Support the development and testing of APIs and backend services using Python and SQL for AI/ML applications and web platforms.
• Help monitor data pipelines, troubleshoot issues, and improve data processing efficiency with guidance from the team.
• Assist in preparing technical documentation, test reports, and data processing procedures.
• Collaborate with other data engineers and team members on ongoing projects and technical tasks.
• Perform other duties and ad-hoc assignments as directed by the team lead and department manager.

Conhecimentos

Python

SQL

Pandas

NumPy

Git

Linux

Scripting

AI coding assistants usage

Formação académica

Degree/Diploma in Computer Science, Data Engineering, IT

Ferramentas

MySQL

PostgreSQL

AWS

Docker

Apache Airflow

Descrição da oferta de emprego

• Location: Tuas West Rd MRT

• Working hrs: Mon - Fri, 9am - 5.30pm

Key Responsibilities:

• Assist the data engineering team in developing and maintaining data pipelines for DRUMS and remote monitoring applications.

• Support the collection, cleaning, transformation, and processing of time-series sensor data from shipboard machinery.

• Assist in developing and testing ETL/ELT processes for reliable data ingestion, storage, and retrieval.

• Work with the team to support AWS cloud services, including S3, RDS, Lambda, and AWS Glue.

• Assist with database operations, SQL queries, data validation, and data quality checks under the guidance of senior team members.

• Support the development and testing of APIs and backend services using Python and SQL for AI/ML applications and web platforms.

• Help monitor data pipelines, troubleshoot issues, and improve data processing efficiency with guidance from the team.

• Assist in preparing technical documentation, test reports, and data processing procedures.

• Collaborate with other data engineers and team members on ongoing projects and technical tasks.

• Perform otherduties and ad-hoc assignments as directed by the team lead and department manager.
  

Requirements:

• Degree / Diploma in Computer Science, Data Engineering, Data Science, IT, or a related field.

• Strong Python skills and good working knowledge of SQL for database management, data processing, and API development.

• Understanding of data engineering fundamentals, including ETL/ELT pipelines, data integration, data transformation, and database optimization.

• Hands‑on experience with pandas, NumPy, and SQL databases such as MySQL or PostgreSQL.

• Familiarity with AWS cloud services, particularly S3, RDS, Lambda, and AWS Glue, gained through coursework, FYP, internships, or personal projects.

• Able to use AI coding assistants (e.g. Claude Code, Codex, Cursor) effectively to speed up development, while reviewing and testing generated code rather than accepting it blindly.

• Comfortable working with Linux, Git, and basic scripting.

• Basic understanding of real-time data pipelines, Docker, Apache Airflow, or data streaming technologies is an advantage; training will be provided.

We regret only shortlisted candidates will be notified.

Important Note: Trust Recruit Pte Ltd is committed to safeguarding your personal data in accordance with the Personal Data Protection Act (PDPA).

Please read our privacy statement on our corporate website www.trustrecruit.com.sg.