Data Engineer

SPRINGFIELD CONSULTING PTE. LTD.; Singapore; On-site; SGD 70,000 - 90,000; Full time

Job summary

A consulting firm in Singapore is seeking a skilled Data Engineer to design and maintain efficient data pipelines, integrate multiple data sources, and work with cloud platforms. The ideal candidate will have over 5 years of experience, strong skills in SQL and programming languages, and a solid understanding of data warehousing and ETL processes.

Qualifications

• Proven experience of 5-6+ years as a Data Engineer or in a similar role.
• Strong programming skills in Python, Java, or Scala preferred.
• Familiarity with data warehousing concepts and technologies.

Responsibilities

• Design, build, and maintain efficient, scalable data pipelines.
• Integrate data from multiple sources ensuring accuracy.
• Develop and optimize ETL processes for large datasets.

Skills

SQL

Data modeling

ETL processes

Python

Data privacy

Problem-solving

Education

Bachelor’s degree in computer science or related field

Tools

AWS

GCP

Azure

PostgreSQL

Hadoop

Spark

Kafka

Airflow

Job description

Key Responsibilities:

• Design, build, and maintain efficient, reliable, and scalable data pipelines.
• Integrate data from multiple data sources, ensuring accuracy and consistency.
• Develop and optimize ETL (Extract, Transform, Load) processes for large datasets.
• Implement data models and structures that enable efficient querying and reporting.
• Work with cloud platforms (AWS, GCP, Azure) to manage data storage and processing solutions.
• Collaborate with data scientists and analysts to understand data requirements and provide high-quality datasets.
• Troubleshoot and optimize data workflows and processes.
• Ensure data privacy and security standards are maintained.

Required Qualifications:

• Bachelor’s degree in computer science, Engineering, Mathematics, or a related field.
• Should have proven experience of 5-6+yrs as a Data Engineer or in a similar role, with a strong portfolio of work.
• Proficiency in SQL and experience working with relational databases (e.g., PostgreSQL, NoSQL, MySQL).
• Strong programming skills in Python, Java, or Scala would be preferred.
• Experience with big data technologies like Hadoop, Spark, or Kafka.
• Experience working with cloud platforms (AWS, GCP, or Azure).
• Familiarity with data warehousing concepts and technologies (e.g., Redshift, Snowflake).
• Knowledge of data pipeline orchestration tools like Airflow, Prefect, or Dagster.
• Understanding of data modeling, ETL processes, and data integration.
• Strong problem-solving skills and attention to detail.