Senior Data Engineer: Scalable Pipelines & Cloud Data

Horizon Computer Management; Singapore; On-site; SGD 120,000 - 160,000; Full time

Job summary

Horizon Computer Management in Singapore is seeking an experienced Data Engineer with 7+ years to design, build, and maintain scalable data pipelines and infrastructure. You will develop ETL/ELT processes, manage large datasets, and support analytics and BI initiatives.

You will work with cloud platforms, data warehouses, and streaming technologies to ensure data quality, governance, and reliable data delivery for data scientists and business stakeholders.

Qualifications

• Bachelor's degree in Computer Science, IT, Data Engineering, or related field.
• Minimum 7 years of relevant experience in Data Engineering.
• Proven experience developing and managing enterprise-scale data pipelines.
• Experience with cloud data platforms and big data technologies.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data integration solutions.
• Build and manage ETL/ELT workflows for structured and unstructured data.
• Develop data models and optimise data warehouse solutions.
• Integrate data from multiple sources, including databases, APIs, and cloud platforms.
• Implement data processing solutions using batch and real-time streaming technologies.
• Ensure data quality, accuracy, consistency, and reliability.
• Work with data scientists, analysts, architects, and business stakeholders.
• Develop and optimise SQL queries and database performance.
• Implement data governance, security, and access control practices.
• Monitor, troubleshoot, and resolve data pipeline failures and performance issues.
• Work with cloud-based data platforms and distributed processing frameworks.
• Maintain technical documentation and follow software development best practices.

Skills

SQL

Python

ETL/ELT

Data pipelines

Spark/PySpark

Airflow

Cloud platforms

Snowflake/Redshift/BigQuery

SQL tuning

Kafka

Education

Bachelor's degree in CS/IT/Data Engineering

Tools

Airflow

Git

CI/CD

Hadoop

Spark

PySpark

Job description

Horizon Computer Management in Singapore is seeking an experienced Data Engineer with 7+ years to design, build, and maintain scalable data pipelines and infrastructure. You will develop ETL/ELT processes, manage large datasets, and support analytics and BI initiatives.

You will work with cloud platforms, data warehouses, and streaming technologies to ensure data quality, governance, and reliable data delivery for data scientists and business stakeholders.