Data Engineer

Helius Technologies Pte Ltd; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Helius Technologies Pte Ltd is seeking a Data Engineer in Singapore to accelerate our enterprise data platform built on Databricks. You will migrate legacy ETL pipelines to Databricks Delta Lake, establish operational excellence, and ensure seamless integration with healthcare information systems and clinical data workflows.

You will mentor junior teammates and collaborate with infrastructure and compliance teams on critical projects including real-time analytics for clinical monitoring systems

Qualifications

• Degree in Computer Science or Computer Engineering.
• Minimum 5 years experience in system operations, compliance and management.
• Hands-on AWS cloud platform experience is required.
• Experience with cloud operations/cloud architecture is preferred.
• AWS certification is highly desirable.

Responsibilities

• Monitor and maintain production data pipelines with high uptime.
• Implement logging, alerting, and monitoring systems.
• Conduct health checks on performance and resource utilization.
• Lead incident response and post-incident reviews.
• Maintain disaster recovery and backup strategies for data assets.
• Tune Spark jobs and Databricks cluster configurations for cost and performance.
• Document procedures and runbooks; coordinate maintenance windows.
• Manage user access controls and workspace security.

Skills

Databricks platform

Apache Spark

Monitoring & incident management

Programming data pipelines

Data warehousing concepts

ML Ops practices

Communication skills

Problem solving

CI/CD pipelines

Education

Degree in Computer Science or Computer Engineering

Tools

Databricks

AWS cloud services

Tableau

IDMC (Informatica Data Management Cloud)

Oracle Database

SageMaker

DataRobot

STATA

Job description

JOB DESCRIPTION

Position Summary / Project Description

This Data Engineer role is designed to augment our existing data engineering team to accelerate the implementation and operationalization of our enterprise data platform built on Databricks. The successful candidate will be responsible for leading the migration of legacy data pipelines to Databricks, establishing operational excellence frameworks, and ensuring seamless integration with existing healthcare information systems and clinical data workflows.

The role involves working on critical projects including the Healthcare Data Analytics Platform modernization and advanced analytics infrastructure supporting machine learning operations. The position holder will be expected to mentor junior team members.

Key projects include migrating existing ETL processes from traditional data warehouse systems to Databricks Delta Lake architecture, implementing real-time streaming analytics for clinical monitoring systems. The role requires close collaboration with infrastructure teams, compliance officers.

Role and Responsibilities

Operational Responsibilities:

• Monitor and maintain production data pipelines to ensure 99.9% uptime and optimal performance
• Implement comprehensive logging, alerting, and monitoring systems using Application monitoring tools
• Perform regular health checks performance, job execution times, and resource utilization to identify and resolve bottlenecks proactively
• Manage incident response procedures for pipeline failures, including root cause analysis, resolution, and post-incident reviews
• Establish and maintain disaster recovery procedures and backup strategies for critical data assets within the Databricks environment
• Conduct regular performance tuning of Spark jobs and Databricks cluster configurations to optimize cost and execution efficiency
• Maintain comprehensive documentation for operational procedures, runbooks, and troubleshooting guides
• Coordinate scheduled maintenance windows and system upgrades with minimal business impact
• Manage user access controls, workspace configurations, and security policies within Application environments

Requirements / Qualifications

Education & Experience:

• Degree in Computer Science or Computer Engineering
• Minimum 5 years working experience in system operations compliance and management areas
• Project hands-on experience specifically with AWS platform (primary requirement)
• project experience in cloud operations or cloud architecture
• Must be cloud certified (AWS)

Core Technical Skills:

• proficiency in Databricks platform, including workspace management, cluster configuration, and job orchestration
• Strong expertise in Apache Spark within Databricks environment, including Spark SQL, DataFrames, and RDDs
• Good in-depth understanding of data warehouse concepts, data profiling, data verification and advanced analytics techniques
• Strong knowledge of monitoring, incident management, and cloud cost control

Technology Stack Experience:

• Databricks
• AWS cloud services and architecture
• IDMC (Informatica Data Management Cloud)
• Tableau for data visualization
• Oracle Database management
• ML Ops practices within Databricks environment
• STATA for statistical analysis is advantage
• Amazon SageMaker integration with Databricks
• DataRobot platform integration

Soft Skills & Stakeholder Management:

• Good interpersonal skills with the ability to work with different groups of stakeholders
• Strong problem-solving skills and ability to work independently in a fast-paced environment with minimal supervision
• Excellent communication skills for technical documentation and cross-team collaboration

Desirable Requirements:

• AWS certification (Associate or Professional level) - highly preferred
• Exposure to hospital information/clinical systems is an added advantage
• Understanding of DevOps practices and CI/CD pipelines for Databricks-based data engineering projects.

Helius Technologies Pte Ltd

36, Robinson Road,#13-05, City House, Singapore 068877

http://helius-tech.com

Registration No : R1108376

EA Licence No : 11C3373