Senior Data Engineer: AWS/Databricks & PySpark Lead

astek singapore innovation technology pte. ltd.; Singapore; On-site; SGD 120,000 - 190,000; Full time

Job summary

astek singapore innovation technology pte. ltd. seeks a Senior Data Engineer to design, build and optimize scalable data pipelines on AWS and Databricks, enabling analytics and AI workloads.

You will lead data lakehouse architectures, implement governance, quality checks and CI/CD for data products, mentoring juniors and collaborating with scientists and business stakeholders in a dynamic cloud environment.

Qualifications

• 6–10 years of data/software engineering experience.
• Experience with cloud-based data platforms (AWS, Databricks).
• Strong knowledge of ETL/ELT, CDC, data quality, metadata and lineage.
• Experience with data governance and security concepts.

Responsibilities

• Design, develop and optimise scalable batch and streaming data pipelines.
• Lead technical design and code reviews; mentor engineers.
• Build and maintain lakehouse architectures (Bronze/Silver/Gold).
• Establish automated data quality checks and lineage.
• Collaborate with data scientists, analysts and stakeholders.

Skills

Technical leadership

Mentoring

Collaboration

Data governance

Problem solving

Education

Bachelor’s degree in CS / SE / Data Eng / Info Systems

Tools

Python

PySpark

SQL

Apache Spark

Databricks

Delta Lake

AWS services (S3, Glue, IAM, Redshift, Lambda)

CI/CD

Terraform

Job description

astek singapore innovation technology pte. ltd. seeks a Senior Data Engineer to design, build and optimize scalable data pipelines on AWS and Databricks, enabling analytics and AI workloads.

You will lead data lakehouse architectures, implement governance, quality checks and CI/CD for data products, mentoring juniors and collaborating with scientists and business stakeholders in a dynamic cloud environment.