Data Engineer – Databricks & AWS Analytics Pipelines

Singapore Economic Development Board (EDB)

Singapore

On-site

SGD 70,000 - 120,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Singapore Economic Development Board (EDB) is seeking a Data Engineer to build end-to-end data pipelines, manage data lake architecture, and deliver analytics-ready datasets. You will work with Databricks, Python, SQL, and AWS services to support governance, quality, and reporting.

The role emphasizes scalable, secure data solutions for government analytics initiatives. Key tasks include implementing medallion architecture, integrating multiple data sources, and enabling BI/ML workflows.

Qualifications

  • 2-5 years of data engineering experience, with demonstrated ability to work independently on data pipeline projects
  • Diploma or degree in Computer Science, Engineering, Information Technology, Data Science or related disciplines
  • Proficiency with Databricks platform including workflows, notebooks, and cluster management
  • Experience implementing medallion architecture for data lake solutions
  • Hands-on experience with Unity Catalog for data governance and cataloguing
  • Strong Python and SQL skills for data manipulation and transformation
  • Experience with Jupyter notebooks and collaborative data science environments
  • Working knowledge of AWS data services (S3, Athena, RDS)
  • Understanding of ETL/ELT principles and data pipeline design patterns
  • Basic knowledge of machine learning concepts and ML pipeline implementation
  • Singaporean or PR

Responsibilities

  • Design and implement data pipelines using Databricks workflows and notebooks
  • Build and maintain medallion architecture (Bronze, Silver, Gold layers) for data processing and transformation
  • Develop ETL processes to integrate data from various SaaS platforms and internal systems
  • Implement data governance practices using Unity Catalog for data discovery, lineage, and access control
  • Create and maintain Jupyter notebooks for data exploration and collaborative analytics
  • Design scalable data storage solutions using AWS services (S3, RDS, Athena)
  • Build data models and prepare datasets optimised for reporting and business intelligence
  • Implement ML pipelines for basic predictive analytics and data insights
  • Ensure data quality, validation, and monitoring across all data workflows
  • Collaborate with stakeholders to understand data requirements and deliver analytics-ready datasets

Skills

Databricks platform
Python
SQL
AWS services
Data governance

Education

Diploma or degree in Computer Science/Engineering/IT/Data Science

Tools

Databricks
AWS
Unity Catalog
Jupyter notebooks
S3
Athena
RDS

Job description

Singapore Economic Development Board (EDB) is seeking a Data Engineer to build end-to-end data pipelines, manage data lake architecture, and deliver analytics-ready datasets. You will work with Databricks, Python, SQL, and AWS services to support governance, quality, and reporting.

The role emphasizes scalable, secure data solutions for government analytics initiatives. Key tasks include implementing medallion architecture, integrating multiple data sources, and enabling BI/ML workflows.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer — Databricks, AWS, Pipelines & Governance
Data Engineer — Databricks, AWS, Pipelines & Governance

Public Service Division • Singapore

On-site
SGD 70,000 - 120,000
Senior Data Engineer: Build AWS/Databricks Pipelines
Senior Data Engineer: Build AWS/Databricks Pipelines

Epergne Solutions • Singapore

On-site
SGD 120,000 - 180,000
Analytics Data Engineer - Databricks & AWS Pipelines
Analytics Data Engineer - Databricks & AWS Pipelines

FPT Asia Pacific • Singapore

On-site
SGD 110,000 - 180,000
Data Engineer - Databricks & AWS Data Pipelines
Data Engineer - Databricks & AWS Data Pipelines

EPS COMPUTER SYSTEMS PTE LTD • Singapore

On-site
SGD 90,000 - 150,000
Data Engineer: Databricks & Python for Analytics Pipelines
Data Engineer: Databricks & Python for Analytics Pipelines

OPTIMUM SOLUTIONS (SINGAPORE) PTE LTD • Singapore

On-site
SGD 90,000 - 130,000
AI-Driven Data Engineer: Databricks + AWS Pipelines
AI-Driven Data Engineer: Databricks + AWS Pipelines

PERSOL • Singapore

On-site
SGD 90,000 - 130,000
Data Engineer: Databricks, Spark & BI Pipelines
Data Engineer: Databricks, Spark & BI Pipelines

User Experience Researchers Pte Ltd • Singapore

On-site
SGD 90,000 - 150,000
Data Engineer: Build Scalable Data Pipelines & Analytics
Data Engineer: Build Scalable Data Pipelines & Analytics

USER EXPERIENCE RESEARCHERS PTE. LTD. • Singapore

On-site
SGD 90,000 - 130,000
Data Engineer — End-to-End Pipelines & Analytics
Data Engineer — End-to-End Pipelines & Analytics

Singpass • Singapore

On-site
SGD 90,000 - 150,000
Flexible work arrangements
Leave benefits
Employee wellness programs
+1
Databricks Data Engineer - Scalable Pipelines & Analytics
Databricks Data Engineer - Scalable Pipelines & Analytics

Vinova • Singapore

On-site
SGD 90,000 - 170,000