Senior Data Engineer: AWS + Databricks & PySpark Leader

Astek Group; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Astek Group is seeking a Senior Data Engineer to design, develop and maintain scalable data pipelines on an AWS/Databricks-based platform. You will lead technical design, implement lakehouse architectures with Delta Lake, and ensure data quality and governance across analytics, reporting and AI/ML workloads.

You will build automated data workflows, optimize Spark/SQL workloads and mentor junior engineers, collaborating with data scientists, analysts and business stakeholders to deliver reliable

Qualifications

• Degree in computer science, data engineering or related field.
• 0

Responsibilities

• Design, develop and optimise scalable batch and streaming pipelines on AWS/Databricks.
• Lead code reviews and mentor junior engineers.
• Collaborate with data scientists and analysts to deliver reliable data products.

Skills

Cloud data engineering

Python

PySpark

SQL

Spark

Data quality

Mentoring

Leadership

CI/CD

Education

Bachelor's degree in Computer Science / Information Systems / Data Engineering

Tools

Databricks

AWS (S3, Glue, Lake Formation)

Delta Lake

Terraform

Git

CI/CD tooling

Delta Live Tables

Job description

Astek Group is seeking a Senior Data Engineer to design, develop and maintain scalable data pipelines on an AWS/Databricks-based platform. You will lead technical design, implement lakehouse architectures with Delta Lake, and ensure data quality and governance across analytics, reporting and AI/ML workloads.

You will build automated data workflows, optimize Spark/SQL workloads and mentor junior engineers, collaborating with data scientists, analysts and business stakeholders to deliver reliable