Senior Data Engineer: Real-Time Pipelines & MLOps Architect

Singapore Airlines Limited; Singapore; On-site; SGD 180,000 - 280,000; Full time

Job summary

Singapore Airlines Limited is seeking a Lead Data Engineer to architect and build open-source-based data ingestion and MLOps platforms. The role emphasizes handling large and near-real-time datasets with a focus on data quality and automation.

You will design data models, implement robust pipelines, and enable self-service data platform features for business users across cloud and on-prem environments. The position involves collaboration with data scientists and engineers to deliver scalable

Qualifications

• BS in Computer Science or related field is required.
• Advanced degrees (MS/PhD) are highly desirable.
• 5+ years of experience in data engineering, data ingestion, and pipelines using open-source platforms.

Responsibilities

• Design and develop data engineering services and their ecosystem using distributed databases, orchestration (Airflow), and stream/batch processing (Kafka, Kinesis, Spark).
• Develop MLOps pipelines and support ML/DL models deployed at scale across cloud and on-premises environments.
• Build scalable, fault-tolerant data ingestion pipelines and intuitive self-service data platform functions for business users.
• Lead evaluation of next-generation technologies in data ingestion workflows and contribute to cloud-architecture discussions.

Skills

Python programming

Data pipelines

AWS cloud

Databricks

Airflow

CI/CD & Agile

Scala/Java/C#

Distributed systems

Education

BS in Computer Science

MS/PhD desirable

Tools

Databricks

Airflow

Kafka

Kinesis

S3

Redshift

PostgreSQL

Spark

EC2

EMR

Job description

Singapore Airlines Limited is seeking a Lead Data Engineer to architect and build open-source-based data ingestion and MLOps platforms. The role emphasizes handling large and near-real-time datasets with a focus on data quality and automation.

You will design data models, implement robust pipelines, and enable self-service data platform features for business users across cloud and on-prem environments. The position involves collaboration with data scientists and engineers to deliver scalable