Associate Data Engineer

HELIUS TECHNOLOGIES PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

HELIUS TECHNOLOGIES PTE. LTD. is seeking a senior cloud operations engineer with strong Databricks and AWS expertise to manage production data pipelines.

The role requires hands-on experience in cloud architecture, data warehousing concepts, and advanced analytics techniques. Responsibilities include maintaining uptime, implementing robust logging and monitoring, and driving incident response with rigorous post-incident reviews.

Qualifications

• Degree in Computer Science or Computer Engineering.
• Minimum 5 years in system operations, compliance and management areas.
• Hands-on AWS cloud experience.
• Cloud operations or cloud architecture project experience.
• Must be cloud certified (AWS).

Responsibilities

• Monitor and maintain production data pipelines with high uptime (99.9%).
• Implement logging, alerting, and monitoring systems.
• Conduct health checks on performance, jobs, and resource usage to identify bottlenecks.
• Lead incident response for pipeline failures including RCA and post-incident reviews.
• Establish disaster recovery and backup strategies for critical data assets in Databricks.

Skills

Databricks platform proficiency

Spark expertise

Data warehousing concepts

Monitoring and incident management

Cloud cost control

Education

Degree in Computer Science or Computer Engineering

Tools

Databricks

AWS cloud services

IDMC (Informatica Data Management Cloud)

Tableau

Oracle Database

ML Ops in Databricks

STATA

Amazon SageMaker integration

DataRobot

Job description

• Degree in Computer Science or Computer Engineering


• Minimum 5 years workingexperience in system operations compliance and management areas


• Project hands-on experiencespecifically with AWS platform (primary requirement)


• project experience in cloudoperations or cloud architecture


• Must be cloud certified (AWS)

Core Technical Skills:

• proficiency in Databricksplatform, including workspace management, cluster configuration, and joborchestration


• Strong expertise in ApacheSpark within Databricks environment, including Spark SQL, DataFrames, and RDDs


• Good in-depth understanding ofdata warehouse concepts, data profiling, data verification and advancedanalytics techniques


• Strong knowledge ofmonitoring, incident management, and cloud cost control

Technology Stack Experience:

• Databricks


• AWS cloud services andarchitecture


• IDMC (Informatica DataManagement Cloud)


• Tableau for data visualization


• Oracle Database management


• ML Ops practices withinDatabricks environment


• STATA for statistical analysisis advantage


• Amazon SageMaker integrationwith Databricks


• DataRobot platformintegration

Responsibilities:

Operational Responsibilities:

• Monitor and maintainproduction data pipelines to ensure 99.9% uptime and optimal performance


• Implement comprehensivelogging, alerting, and monitoring systems using Application monitoring tools


• Perform regular health checksperformance, job execution times, and resource utilization to identify andresolve bottlenecks proactively


• Manage incident responseprocedures for pipeline failures, including root cause analysis, resolution,and post-incident reviews


• Establish and maintaindisaster recovery procedures and backup strategies for critical data assetswithin the Databricks environment