Senior Data Engineer - AWS Databricks & Spark Ops

NTT SINGAPORE PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

NTT Singapore PTE. LTD. is seeking a seasoned Cloud Operations professional to maintain data pipelines, optimize Spark jobs in Databricks, and manage cloud infrastructure with a focus on reliability and cost control.

The role requires hands-on AWS experience, Databricks expertise, and strong incident management skills to ensure high uptime and secure data environments across Enterprise workflows.

Qualifications

• Degree in Computer Science or Computer Engineering.
• Minimum 5 years working experience in system operations compliance and management areas.
• Project hands-on experience with AWS platform (primary requirement).
• Project experience in cloud operations or cloud architecture.
• Must be cloud certified (AWS).

Responsibilities

• Monitor and maintain production data pipelines to ensure 99.9% uptime and optimal performance.
• Implement comprehensive logging, alerting, and monitoring systems using Application monitoring tools.
• Perform regular health checks performance, job execution times, and resource utilization to identify and resolve bottlenecks proactively.
• Manage incident response procedures for pipeline failures, including root cause analysis, resolution, and post-incident reviews.
• Establish and maintain disaster recovery procedures and backup strategies for critical data assets within the Databricks environment.
• Conduct regular performance tuning of Spark jobs and Databricks cluster configurations to optimize cost and execution efficiency.
• Maintain comprehensive documentation for operational procedures, runbooks, and troubleshooting guides.
• Coordinate scheduled maintenance windows and system upgrades with minimal business impact.
• Manage user access controls, workspace configurations, and security policies within Application environments.

Skills

Databricks

Apache Spark

Data warehousing

Monitoring

Cloud cost control

DevOps

Stakeholder management

Education

Bachelors in CS/CE

AWS Certification

Tools

Databricks

AWS

IDMC

Tableau

Oracle DB

ML Ops in Databricks

SageMaker

DataRobot

Job description

NTT Singapore PTE. LTD. is seeking a seasoned Cloud Operations professional to maintain data pipelines, optimize Spark jobs in Databricks, and manage cloud infrastructure with a focus on reliability and cost control.

The role requires hands-on AWS experience, Databricks expertise, and strong incident management skills to ensure high uptime and secure data environments across Enterprise workflows.