Data Engineer-Augmentation Consultant

EXCELTECH COMPUTERS PTE. LTD.; Singapore; In loco; SGD 90.000 - 140.000; Tempo pieno

Descrizione del lavoro

EXCELTECH COMPUTERS PTE. LTD. seeks a Data Engineer-Augmentation Consultant to accelerate our enterprise data platform on Databricks. You will lead legacy to Databricks migration, establish operational frameworks, and ensure seamless integration with healthcare information systems.

Responsibilities include monitoring production pipelines, implementing logging and alerting, and managing incident response with post-incident reviews to drive reliability and performance.

Competenze

• Experience with modern data platforms and Databricks workflows.
• Strong ability to monitor and optimize data pipelines.
• Familiarity with incident response and disaster recovery concepts.

Mansioni

• Lead migration of legacy data pipelines to Databricks.
• Maintain production data pipelines with 99.9% uptime.
• Implement logging, alerting, and monitoring systems.
• Perform health checks on performance, jobs, and resources.
• Manage incident response and post-incident reviews.

Conoscenze

Databricks

Data pipelines

Monitoring

Incident management

Strumenti

Application monitoring tools

Descrizione del lavoro

Data Engineer-Augmentation Consultant

This Data Engineer role is designed to augment our existing data engineering team to accelerate the implementation and operationalization of our enterprise data platform built on Databricks. The successful candidate will be responsible for leading the migration of legacy data pipelines to Databricks, establishing operational excellence frameworks,and ensuring seamless integration with existing healthcare information systems and clinical data workflows.

• Monitor and maintain production data pipelines to ensure 99.9% uptime and optimal performance
• Implement comprehensive logging, alerting, andmonitoring systems using Application monitoring tools
• Perform regular health checks performance, job execution times, and resource utilization to identify and resolve bottle necks proactively
• Manage incident response procedures for pipeline failures, including root cause analysis, resolution, and post-incident reviews
• Establish and maintain disaster recovery procedures and backup strategies for critical data assets within the Databricks environment