Data Engineer: Databricks, PySpark & Delta Lake

Espire Infolabs; Singapore; On-site; SGD 70,000 - 110,000; Full time

Job summary

Espire Infolabs is seeking a hands-on Data Engineer in Singapore to design, build, and optimize scalable data pipelines on the Databricks Lakehouse platform. You will collaborate with analysts, data scientists, and business teams to turn raw data into analytics-ready assets.

The role requires 3–5 years of hands-on data engineering experience, strong PySpark and SQL skills, and experience with Databricks and Delta Lake on cloud platforms (Azure/AWS/GCP).

Qualifications

• 3-5 years of hands-on data engineering experience.
• Strong PySpark skills (DataFrames, Spark SQL, UDFs, performance tuning).
• Proven experience building production pipelines on Databricks.
• Solid working knowledge of Delta Lake (ACID, time travel, merge/upsert, schema evolution).
• Advanced SQL and strong Python.
• Experience with a major cloud platform (Azure, AWS, or GCP) and its storage and data services.
• Understanding of data modelling (dimensional, lakehouse) and ETL/ELT patterns.
• Familiarity with Git and CI/CD practices.

Responsibilities

• Design, build, and optimize scalable data pipelines on the Databricks Lakehouse platform.
• Collaborate with analysts, data scientists, and business teams to turn raw data into analytics-ready assets.

Skills

PySpark

Databricks

Delta Lake

SQL

Python

Cloud platforms

Data modelling

ETL/ELT

Git CI/CD

Data pipelines

Job description

Espire Infolabs is seeking a hands-on Data Engineer in Singapore to design, build, and optimize scalable data pipelines on the Databricks Lakehouse platform. You will collaborate with analysts, data scientists, and business teams to turn raw data into analytics-ready assets.

The role requires 3–5 years of hands-on data engineering experience, strong PySpark and SQL skills, and experience with Databricks and Delta Lake on cloud platforms (Azure/AWS/GCP).