Databricks Data Engineer – Automation & AI Pipelines

U3 INFOTECH PTE. LTD.

Singapore

Presencial

SGD 90.000 - 150.000

Jornada completa

Hace 2 días
Sé de los primeros/as/es en solicitar esta vacante

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

U3 INFOTECH PTE. LTD. is seeking a data engineer to design and maintain scalable ETL/ELT pipelines using Databricks, PySpark, SQL and Delta Lake.

The role focuses on integrating data from databases, APIs and files, with streaming where needed, and building curated datasets for reporting, analytics and AI applications. You will implement data quality checks, monitor pipelines, troubleshoot issues and optimise performance, while applying CI/CD and technical documentation practices to support

Responsabilidades

  • Design, develop and maintain scalable ETL/ELT data pipelines using Databricks, Python, PySpark, SQL and Delta Lake.
  • Integrate data from multiple sources, including databases, APIs and files, with streaming ingestion where required.
  • Develop and maintain curated datasets and data models to support business reporting, analytics and AI applications.
  • Implement data quality checks, data validation, reconciliation and incremental data processing.
  • Monitor data pipelines, investigate failures, troubleshoot issues and ensure data accuracy and availability.
  • Optimise data processing performance, pipeline execution and compute utilisation.
  • Implement version control, automated testing, CI/CD and technical documentation.
  • Identify and automate repetitive data engineering and support activities.
  • Explore practical AI

Descripción del empleo

U3 INFOTECH PTE. LTD. is seeking a data engineer to design and maintain scalable ETL/ELT pipelines using Databricks, PySpark, SQL and Delta Lake.

The role focuses on integrating data from databases, APIs and files, with streaming where needed, and building curated datasets for reporting, analytics and AI applications. You will implement data quality checks, monitor pipelines, troubleshoot issues and optimise performance, while applying CI/CD and technical documentation practices to support

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Data Engineer - Databricks & Automation
Data Engineer - Databricks & Automation

U3 INFOTECH PTE. LTD. • Singapore

Presencial
SGD 90.000 - 150.000
Data Engineer - Databricks & AWS Data Pipelines
Data Engineer - Databricks & AWS Data Pipelines

EPS COMPUTER SYSTEMS PTE LTD • Singapore

Presencial
SGD 90.000 - 150.000
AI-Driven Data Engineer: Databricks + AWS Pipelines
AI-Driven Data Engineer: Databricks + AWS Pipelines

PERSOL • Singapore

Presencial
SGD 90.000 - 130.000
Senior Data Engineer, Databricks & AI Automation
Senior Data Engineer, Databricks & AI Automation

Flintex Consulting Pte Ltd • Singapore

Presencial
SGD 120.000 - 180.000
Data Engineer (Databricks)
Data Engineer (Databricks)

NCS Pte Ltd • Singapore

Presencial
SGD 90.000 - 150.000
Data Engineer (Databricks)
Data Engineer (Databricks)

PERCEPT SOLUTIONS PTE. LTD. • Singapore

Presencial
SGD 90.000 - 130.000
Data Engineer, AI Integration Specialist
Data Engineer, AI Integration Specialist

PERSOL • Singapore

Presencial
SGD 90.000 - 130.000
Databricks Data Engineer - Scalable Pipelines & Analytics
Databricks Data Engineer - Scalable Pipelines & Analytics

Vinova • Singapore

Presencial
SGD 90.000 - 170.000
Data Engineer (Databricks & DevOps)
Data Engineer (Databricks & DevOps)

COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD. • Singapore

Presencial
SGD 90.000 - 150.000
Databricks Workflows
CloudWatch Monitoring
Databricks Data Engineer - Scale & Refactor Pipelines
Databricks Data Engineer - Scale & Refactor Pipelines

TRINITY CONSULTING SERVICES PTE. LTD. • Singapore

Presencial
SGD 120.000 - 180.000