SQL Developer

ELLIOTT MOSS CONSULTING PTE. LTD.; Singapore; On-site; SGD 60,000 - 90,000; Full time

Job summary

A consulting firm in Singapore is seeking a skilled Data Engineer to design and maintain data pipelines. Responsibilities include developing ETL/ELT processes, optimizing databases, and ensuring data quality through validation. The ideal candidate should have experience in data pipeline management and proficiency in SQL. A background in cloud platforms and scripting is preferred. This role offers a dynamic work environment and opportunities for continuous learning.

Qualifications

• Experience in ETL/ELT development and data pipeline management required.
• Strong proficiency in SQL and database optimization essential.
• Familiarity with data integration tools preferred.

Responsibilities

• Develop and maintain ETL/ELT processes for data extraction and transformation.
• Optimize and monitor database performance.
• Perform verification and validation of data outputs.
• Prepare detailed technical documentation.

Skills

ETL/ELT development

SQL

Database design

Data pipeline management

Data validation

Tools

AWS

Azure

GCP

Python

Shell scripting

Job description

Job Description

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and database solutions. The ideal candidate will be responsible for developing ETL/ELT processes, optimizing database performance, ensuring data quality through verification and validation, and creating comprehensive technical documentation. This role requires strong analytical skills, attention to detail, and the ability to work independently in a fast-paced environment.

Key Responsibilities

1. ETL / Data Pipeline Development

• Develop and maintain ETL/ELT processes to extract, transform, and load data from various sources.
• Implement and manage data integration workflows.
• Ensure pipelines are efficient, reliable, and well-documented.
• Automate data movement and transformation tasks to improve efficiency.

2. Database Development & Performance Optimization

• Write, optimize, and maintain complex SQL queries, stored procedures, and scripts.
• Monitor and tune database performance, indexing, and query execution plans.
• Manage data versioning, schema evolution, and migrations.
• Ensure database integrity, security, and effective backup processes.

3. Verification & Validation

• Perform end-to-end verification and validation of data pipelines and outputs to ensure accuracy and reliability.

4. Documentation & Knowledge Transfer

• Prepare detailed technical documentation, including architecture diagrams, deployment guidelines, and operational procedures.
• Develop user manuals and administrative guides for internal teams.

Requirements

Technical Skills

• Strong experience in ETL/ELT development and data pipeline management.
• Proficiency in SQL, database design, and performance optimization.
• Familiarity with data integration tools and technologies.
• Understanding of data modelling, schema design, and version control.
• Experience with database security, backup, and recovery processes.

Preferred Qualifications (Optional)

• Experience with cloud data platforms (AWS, Azure, GCP).
• Knowledge of scripting languages such as Python or Shell.
• Experience with CI/CD pipelines or DevOps practices.