Principal Data Engineer: ML Data Pipelines & Governance

Western Digital; Singapore; On-site; SGD 150,000 - 210,000; Full time

Job summary

Western Digital is hiring for a data engineering role focused on ML-ready scientific data pipelines. You will build feature stores, version data, and ensure data governance for AI workflows in a scalable cloud environment.

The role emphasizes end-to-end pipeline engineering, data quality, and collaboration with ML engineers to enable robust model training and deployment at scale in Singapore.

Qualifications

• Strong SQL skills with advanced data transformations.
• Experience designing batch pipelines with reliability and fault tolerance.
• Knowledge of data quality checks, schema validation and distribution monitoring.
• Ability to trace data origin and transformations for reproducibility of training data.
• Awareness of how data pipelines feed ML model training and evaluation.

Responsibilities

• Build and maintain reliable, versioned data pipelines for ML-ready features.
• Design data quality checks across datasets and alert ML team when issues arise.
• Implement training data versioning and lineage for reproducibility.
• Establish data contracts and governance with access control and retention policies.
• Contribute to real-time sensor data ingestion and synthetic data pipeline workstreams.
• Maintain ML data layer components tightly integrated with AI platform.

Skills

SQL proficiency

Batch pipeline design

Data quality principles

Data versioning & lineage

ML data lifecycle awareness

Education

Bachelor's or Master’s degree in AI/CS/Data Eng

Tools

Airflow

Prefect

AWS Glue Jobs

Job description

Western Digital is hiring for a data engineering role focused on ML-ready scientific data pipelines. You will build feature stores, version data, and ensure data governance for AI workflows in a scalable cloud environment.

The role emphasizes end-to-end pipeline engineering, data quality, and collaboration with ML engineers to enable robust model training and deployment at scale in Singapore.