Data Engineer: Databricks, Spark & BI Pipelines

User Experience Researchers Pte Ltd

Singapore

Sur place

SGD 90 000 - 150 000

Plein temps

Il y a 6 heures
Soyez parmi les premiers à postuler

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Résumé du poste

User Experience Researchers Pte Ltd is seeking a Data Engineer to join the data team supporting a government agency. You will design and build data models, curated datasets, and pipelines to enable BI, analytics, and data science use cases, collaborating with business stakeholders to translate requirements into scalable, reliable data products.

Responsibilities include modeling, ETL/ELT development, and ensuring data quality across multiple source systems using Databricks, Spark, Delta Lake, and

Qualifications

  • 3–8 years of relevant experience in Data Engineering or a related role.
  • Strong proficiency in SQL and experience with relational databases and data warehousing.
  • Strong experience in data modelling, including dimensional modelling and designing analytical datasets.
  • Proficiency in Python for data processing and pipeline development.
  • Hands-on experience with Databricks, Apache Spark and Delta Lake.
  • Degree in Computer Science, Information Technology, Data Engineering or a related discipline, or equivalent relevant professional experience.
  • Experience designing and developing ETL/ELT pipelines and data transformation workflows.
  • Experience working with AWS data services and cloud-based data platforms.
  • Ability to engage business stakeholders, understand business processes and translate requirements into technical data solutions.
  • Familiarity with Git, CI/CD and data pipeline orchestration.

Responsabilités

  • Engage directly with business stakeholders to understand requirements and translate them into data models, datasets and pipelines.
  • Design and develop data models and transformation pipelines to integrate, clean, harmonise and curate data from multiple source systems.
  • Build and maintain scalable, reliable and reusable data pipelines using Databricks, Spark and SQL.
  • Design datasets and data structures optimized for downstream reporting, analytics and data science applications.
  • Implement data quality checks, validation and reconciliation to ensure data accuracy and consistency.
  • Monitor and troubleshoot pipeline performance and operational issues.
  • Document data models, datasets, transformations and pipeline dependencies.
  • Work with data engineers, analysts and data scientists to deliver data solutions aligned with business needs.

Connaissances

SQL
Python
Data modelling
ETL/ELT pipelines
Stakeholder engagement
CI/CD
Git

Formation

Degree in Computer Science or related discipline

Outils

Databricks
Apache Spark
Delta Lake
AWS data services

Description du poste

User Experience Researchers Pte Ltd is seeking a Data Engineer to join the data team supporting a government agency. You will design and build data models, curated datasets, and pipelines to enable BI, analytics, and data science use cases, collaborating with business stakeholders to translate requirements into scalable, reliable data products.

Responsibilities include modeling, ETL/ELT development, and ensuring data quality across multiple source systems using Databricks, Spark, Delta Lake, and

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Data Engineer: Build Scalable Data Pipelines & Analytics
Data Engineer: Build Scalable Data Pipelines & Analytics

USER EXPERIENCE RESEARCHERS PTE. LTD. • Singapore

Sur place
SGD 90 000 - 130 000
Data Engineer
Data Engineer

User Experience Researchers Pte Ltd • Singapore

Sur place
SGD 90 000 - 150 000
Data Engineer
Data Engineer

USER EXPERIENCE RESEARCHERS PTE. LTD. • Singapore

Sur place
SGD 90 000 - 130 000
Data Engineer - Databricks & AWS Data Pipelines
Data Engineer - Databricks & AWS Data Pipelines

EPS COMPUTER SYSTEMS PTE LTD • Singapore

Sur place
SGD 90 000 - 150 000
Data Engineer: Build Scalable Pipelines & Data Models
Data Engineer: Build Scalable Pipelines & Data Models

Jobster Private Ltd • Singapore

Sur place
SGD 90 000 - 140 000
Data Engineer – Databricks & AWS Analytics Pipelines
Data Engineer – Databricks & AWS Analytics Pipelines

Singapore Economic Development Board (EDB) • Singapore

Sur place
SGD 70 000 - 120 000
AI-Driven Data Engineer: Databricks + AWS Pipelines
AI-Driven Data Engineer: Databricks + AWS Pipelines

PERSOL • Singapore

Sur place
SGD 90 000 - 130 000
Data Engineer (Databricks)
Data Engineer (Databricks)

PERCEPT SOLUTIONS PTE. LTD. • Singapore

Sur place
SGD 90 000 - 130 000
Analytics Data Engineer - Databricks & AWS Pipelines
Analytics Data Engineer - Databricks & AWS Pipelines

FPT Asia Pacific • Singapore

Sur place
SGD 110 000 - 180 000
Data Engineer: Databricks & Python for Analytics Pipelines
Data Engineer: Databricks & Python for Analytics Pipelines

OPTIMUM SOLUTIONS (SINGAPORE) PTE LTD • Singapore

Sur place
SGD 90 000 - 130 000