Senior Data Engineer

SPRINGFIELD CONSULTING PTE. LTD.; Singapore; On-site; SGD 80,000 - 100,000; Full time

Job summary

A consulting firm in Singapore is seeking a skilled Data Engineer to design and maintain data pipelines. The role requires 7+ years of experience, proficiency in SQL, and familiarity with big data technologies and cloud platforms like AWS, GCP, or Azure. Ideal candidates will have a strong educational background and problem-solving skills, ensuring secure and efficient data workflows.

Qualifications

• 7-8+ years of experience as a Data Engineer or in a similar role.
• Strong portfolio of work demonstrating data engineering capabilities.
• Familiarity with data modeling and integration.

Responsibilities

• Design, build, and maintain efficient data pipelines.
• Integrate data from multiple sources for accuracy.
• Develop ETL processes for large datasets.
• Manage data storage and processing in cloud platforms.

Skills

Data pipeline design

ETL processes

SQL proficiency

Python programming

Big data technologies (Hadoop, Spark, Kafka)

Education

Bachelor’s degree in computer science, Engineering, Mathematics, or related field

Tools

PostgreSQL

MySQL

AWS

GCP

Azure

Airflow

Snowflake

Job description

Key Responsibilities

• Design, build, and maintain efficient, reliable, and scalable data pipelines.
• Integrate data from multiple data sources, ensuring accuracy and consistency.
• Develop and optimize ETL (Extract, Transform, Load) processes for large datasets.
• Implement data models and structures that enable efficient querying and reporting.
• Work with cloud platforms (AWS, GCP, Azure) to manage data storage and processing solutions.
• Collaborate with data scientists and analysts to understand data requirements and provide high-quality datasets.
• Troubleshoot and optimize data workflows and processes.
• Ensure data privacy and security standards are maintained.

Required Qualifications

• Bachelor’s degree in computer science, Engineering, Mathematics, or a related field.
• Should have proven experience of min 7-8+yrs as a Data Engineer or in a similar role, with a strong portfolio of work.
• Proficiency in SQL and experience working with relational databases (e.g., PostgreSQL, NoSQL, MySQL).
• Strong programming skills in Python, Java, or Scala would be preferred.
• Experience with big data technologies like Hadoop, Spark, or Kafka.
• Experience working with cloud platforms (AWS, GCP, or Azure).
• Familiarity with data warehousing concepts and technologies (e.g., Redshift, Snowflake).
• Knowledge of data pipeline orchestration tools like Airflow, Prefect, or Dagster.
• Understanding of data modeling, ETL processes, and data integration.
• Strong problem-solving skills and attention to detail.