Data Engineer

HORIZON COMPUTER MANAGEMENT PTE. LTD.

Singapore

On-site

SGD 90,000 - 150,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Horizon Computer Management Pte. Ltd. is seeking an experienced Data Engineer with 7+ years to design, develop, and maintain scalable data pipelines and data infrastructure.

You will build ETL/ELT processes, manage large datasets, optimise data workflows, and support analytics and BI initiatives. The role requires strong SQL/Python, hands-on experience with Spark/Hadoop, Airflow, and cloud data platforms such as Snowflake, Redshift, BigQuery, or Synapse.

Qualifications

  • 7+ years of data engineering experience in designing scalable pipelines and data infrastructure.
  • Experience building and maintaining ETL/ELT processes for structured and unstructured data.
  • Proficiency in SQL and Python with strong data modelling skills.
  • Experience with cloud data platforms (AWS/Azure/GCP) and big data technologies.
  • Knowledge of data governance, security, and quality frameworks; ability to implement data quality controls.
  • Excellent collaboration with data scientists, analysts, architects, and stakeholders.

Responsibilities

  • Design, develop, and maintain scalable data pipelines and data integration solutions.
  • Build and manage ETL/ELT workflows for structured and unstructured data.
  • Develop data models and optimize data warehouse solutions.
  • Integrate data from databases, APIs, and cloud platforms.
  • Implement data processing with batch and real-time streaming technologies.
  • Ensure data quality, accuracy, consistency, and reliability.
  • Collaborate with data scientists, analysts, architects, and business stakeholders.
  • Develop and optimize SQL queries and database performance.
  • Implement data governance, security, and access controls.
  • Monitor, troubleshoot, and resolve pipeline failures and performance issues.
  • Work with cloud-based data platforms and distributed processing frameworks.
  • Maintain technical documentation and follow software development best practices.

Skills

SQL
Python
ETL/ELT tools
Apache Spark
PySpark
Hadoop
Airflow
Snowflake
Amazon Redshift
Google BigQuery
Azure Synapse
AWS
Azure
NoSQL databases
Kafka
Git
CI/CD
data governance
data security
APIs

Education

Bachelor's degree in Computer Science/Information Technology/Data Engineering

Tools

Apache Airflow
Snowflake
Amazon Redshift
Google BigQuery
Azure Synapse
AWS
Azure
Cloud platforms (AWS/Azure/GCP)
Kafka
CI/CD

Job description

Job Summary

We are looking for an experienced Data Engineer with 7+ years of experience in designing, developing, and maintaining scalable data pipelines and data infrastructure. The candidate will be responsible for building ETL/ELT processes, managing large datasets, optimising data workflows, and supporting data analytics and business intelligence initiatives.

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines and data integration solutions.
  • Build and manage ETL/ELT workflows for structured and unstructured data.
  • Develop data models and optimise data warehouse solutions.
  • Integrate data from multiple sources, including databases, APIs, and cloud platforms.
  • Implement data processing solutions using batch and real-time streaming technologies.
  • Ensure data quality, accuracy, consistency, and reliability.
  • Work with data scientists, analysts, architects, and business stakeholders.
  • Develop and optimise SQL queries and database performance.
  • Implement data governance, security, and access control practices.
  • Monitor, troubleshoot, and resolve data pipeline failures and performance issues.
  • Work with cloud-based data platforms and distributed processing frameworks.
  • Maintain technical documentation and follow software development best practices.
Technical Skills & Requirements
  • Strong proficiency in SQL and Python.
  • Hands-on experience with ETL/ELT tools and data pipeline development.
  • Experience with Apache Spark, PySpark, and Hadoop.
  • Knowledge of Apache Airflow or similar workflow orchestration tools.
  • Experience with data warehouses such as Snowflake, Amazon Redshift, Google BigQuery, or Azure Synapse.
  • Hands-on experience with AWS, Microsoft Azure, or Google Cloud Platform.
  • Knowledge of relational and NoSQL databases.
  • Experience with data integration, data modelling, and data transformation.
  • Familiarity with Kafka or other real-time data streaming technologies.
  • Experience with Git, CI/CD, and automated deployment processes.
  • Understanding of data governance, data security, and data quality frameworks.
Education & Experience
  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related discipline.
  • Minimum 7 years of relevant experience in Data Engineering.
  • Proven experience developing and managing enterprise-scale data pipelines.
  • Experience working with cloud data platforms and big data technologies.
Required Skills
  • Strong analytical and problem-solving abilities.
  • Excellent SQL and programming skills.
  • Ability to handle large and complex datasets.
  • Strong communication and collaboration skills.
  • Ability to work independently and manage multiple priorities.
Preferred Certifications
  • AWS Certified Data Engineer.
  • Microsoft Certified: Azure Data Engineer Associate.
  • Google Cloud Professional Data Engineer.
  • Databricks Data Engineer Certification.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Horizon Computer Management • Singapore

On-site
SGD 120,000 - 160,000
Data Engineer
Data Engineer

ZENITH INFOTECH (S) PTE LTD. • Singapore

On-site
SGD 120,000 - 180,000
Data Engineer
Data Engineer

Merquri • Singapore

On-site
SGD 70,000 - 110,000
Data Engineer
Data Engineer

CHARLES & KEITH GROUP • Singapore

On-site
SGD 60,000 - 90,000
Data Engineer
Data Engineer

Zenith-Infotech • Singapore

On-site
SGD 120,000 - 180,000
Data Engineer
Data Engineer

ARYAN SOLUTIONS PTE. LTD. • Singapore

On-site
SGD 90,000 - 150,000
Data Engineer
Data Engineer

TOPPAN Ecquaria Pte Ltd • Singapore

On-site
SGD 90,000 - 130,000
Data Engineer
Data Engineer

User Experience Researchers Pte.Ltd • Singapore

On-site
SGD 90,000 - 150,000
Data Engineer
Data Engineer

RAPSYS TECHNOLOGIES PTE. LTD. • Singapore

On-site
SGD 90,000 - 140,000
Data Engineer
Data Engineer

FPT Asia Pacific • Singapore

On-site
SGD 70,000 - 110,000