Data Engineer Consultant: AWS + Databricks Pipelines

Zenika Singapore; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Zenika Singapore is seeking an experienced Data Engineer Consultant to design and implement scalable data platforms for public sector and enterprise clients. You’ll work hands-on with AWS, Databricks, and PySpark, collaborating with cross-functional teams to deliver production-ready data solutions.

Responsibilities include building enterprise data architectures, real-time streaming pipelines, and cost-efficient data transformations while ensuring security and governance.

Qualifications

• 5–7 years of experience in data engineering, ideally on AWS-native platforms.
• Proven experience building ETL/ELT pipelines, migrating data solutions, and managing real-time streaming architectures.
• Hands-on expertise in Databricks, PySpark, Python, and SQL for large-scale data transformation.
• Strong understanding of data warehouse design (Redshift, Snowflake) and data governance principles.
• Familiarity with DevOps concepts, including CI/CD workflows and version control (GitLab, GitHub).
• Experience with serverless compute (AWS Lambda) and automation scripting.
• Solid grasp of data security, performance optimisation, and cost management in cloud environments.
• Excellent communication and collaboration skills — you translate complex technical details into clear business language.
• Bonus: Experience with public sector or HR analytics projects, mentorship and leading data teams.
• Bachelor’s degree in Computer Science, Data Engineering, or a related field (Master’s preferred)
• Certifications such as: AWS Certified Data Engineer – Associate or AWS Certified Solutions Architect, Databricks Certified Data Engineer (Associate/Professional), Snowflake or Redshift certifications (a plus)
• Agile/Scrum Master certification (preferr

Responsibilities

• Design and build enterprise-scale data architectures — including data lakes, warehouses, and real-time streaming pipelines.
• Develop and maintain high-performance ETL/ELT pipelines that process large volumes of structured and unstructured data.
• Implement and optimise data transformations in Databricks using PySpark, Python, and SQL, ensuring quality, scalability, and cost-efficiency.
• Collaborate and mentor — guide junior engineers, review code, and drive adoption of best practices in data engineering and DevOps.
• Integrate and automate data flows using APIs, AWS services (Glue, Redshift, S3, EMR, Lambda), and real-time tools like Kafka or Kinesis.
• Monitor and troubleshoot performance bottlenecks, ensuring reliability, consistency, and security across all data operation

Skills

AWS

Databricks

PySpark

Python

SQL

ETL/ELT

CI/CD

Git

Communication

Education

Bachelor's degree in Computer Science or related field

Master’s degree preferred

Certifications: AWS Certified Data Engineer / Solutions Architect

Tools

Databricks

Redshift

Snowflake

Kafka / Kinesis

Glue / S3 / EMR / Lambda

Job description

Zenika Singapore is seeking an experienced Data Engineer Consultant to design and implement scalable data platforms for public sector and enterprise clients. You’ll work hands-on with AWS, Databricks, and PySpark, collaborating with cross-functional teams to deliver production-ready data solutions.

Responsibilities include building enterprise data architectures, real-time streaming pipelines, and cost-efficient data transformations while ensuring security and governance.