SQL Developer

ELLIOTT MOSS CONSULTING PTE. LTD.; Singapore; On-site; SGD 60,000 - 80,000; Full time

Job summary

A leading consulting firm in Singapore is seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and database solutions. The ideal candidate will focus on developing ETL/ELT processes, optimizing database performance, and ensuring data quality through thorough verification and validation. Strong analytical skills and the ability to work independently in a fast-paced environment are essential. This role requires proficiency in SQL and familiarity with cloud data platforms like AWS, Azure, or GCP.

Qualifications

• Strong experience in ETL/ELT development and data pipeline management.
• Proficiency in SQL, database design, and performance optimization.
• Familiarity with data integration tools and technologies.

Responsibilities

• Develop and maintain ETL/ELT processes to extract, transform, and load data.
• Write, optimize, and maintain complex SQL queries.
• Perform end-to-end verification and validation of data pipelines.

Skills

ETL/ELT development

SQL

Database design

Data pipeline management

Data integration tools

Tools

AWS

Azure

GCP

Python

Shell

Job description

Job Description

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and database solutions. The ideal candidate will be responsible for developing ETL/ELT processes, optimizing database performance, ensuring data quality through verification and validation, and creating comprehensive technical documentation. This role requires strong analytical skills, attention to detail, and the ability to work independently in a fast-paced environment.

Key Responsibilities

1. ETL / Data Pipeline Development

• Develop and maintain ETL/ELT processes to extract, transform, and load data from various sources.
• Implement and manage data integration workflows.
• Ensure pipelines are efficient, reliable, and well-documented.
• Automate data movement and transformation tasks to improve efficiency.

2. Database Development & Performance Optimization

• Write, optimize, and maintain complex SQL queries, stored procedures, and scripts.
• Monitor and tune database performance, indexing, and query execution plans.
• Manage data versioning, schema evolution, and migrations.
• Ensure database integrity, security, and effective backup processes.

3. Verification & Validation

• Perform end-to-end verification and validation of data pipelines and outputs to ensure accuracy and reliability.

4. Documentation & Knowledge Transfer

• Prepare detailed technical documentation, including architecture diagrams, deployment guidelines, and operational procedures.
• Develop user manuals and administrative guides for internal teams.

Requirements

Technical Skills

• Strong experience in ETL/ELT development and data pipeline management.
• Proficiency in SQL, database design, and performance optimization.
• Familiarity with data integration tools and technologies.
• Understanding of data modelling, schema design, and version control.
• Experience with database security, backup, and recovery processes.

Preferred Qualifications (Optional)

• Experience with cloud data platforms (AWS, Azure, GCP).
• Knowledge of scripting languages such as Python or Shell.
• Experience with CI/CD pipelines or DevOps practices.