Data Engineer

EPERGNE SOLUTIONS PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

A prestigious technology firm in Singapore is seeking a knowledgeable Data Engineer with over 10 years of experience. The ideal candidate will have strong expertise in AWS, Databricks, and Informatica IDMC, along with proficiency in programming languages like Python, Java, or Scala for building data pipelines. Excellent problem-solving skills and experience with SQL and NoSQL databases are essential. AWS certifications and familiarity with data governance tools are preferred.

Qualifications

• Minimum 10 years of experience in data engineering.
• Expertise in AWS services, Databricks, and/or Informatica IDMC.
• Strong problem-solving and analytical skills.

Skills

AWS services

Databricks

Informatica IDMC

Python

Java

Scala

SQL

NoSQL databases

Data modeling

Schema design

Pyspark

Data governance tools

Data cataloguing tools

Tableau

Docker

Kubernetes

Git

CI/CD pipelines

Education

Bachelor’s or master’s degree in computer science or related field

Job description

Epergne Solutions is looking for Data Engineer

Requirements / Qualifications

• Bachelor’s or master’s degree in computer science, data engineering, or a related field.
• Minimum 10 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC.
• Proficiency in programming languages such as Python, Java, or Scala for building data pipelines.
• Evaluate potential technical solutions and make recommendations to resolve data issues especially on performance assessment for complex data transformations and long running data processes.
• Strong knowledge of SQL and NoSQL databases.
• Familiarity with data modeling and schema design.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• AWS certifications (e.g., AWS Certified Data Analytics - Specialty, AWS Certified Data Analytics - Specialty), Databricks certifications, and Informatica certifications are a plus.

Preferred Skills:

• Experience with Pyspark on Databricks
• Knowledge of data governance and data cataloguing tools, especially Informatica IDMC.
• Familiarity with data visualization tools like Tableau.
• Knowledge of containerization and orchestration tools like Docker and Kubernetes.
• Understanding of DevOps principles for managing and deploying data pipelines.
• Experience with version control systems (e.g., Git) and CI/CD pipelines.