Senior Data Engineer: AI & Real-Time Pipelines

ST LOGISTICS PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

ST LOGISTICS PTE. LTD. seeks a data engineer to design and optimise scalable data workflows for AI-ready analytics.

You will build real-time and batch pipelines, extract and integrate data from diverse sources, and design data models to support AI/ML applications. The role interfaces between data and application layers via APIs and requires strong SQL, Python, Spark and cloud platform experience. The position emphasizes data quality, governance, and reproducibility, with cross-team collaboration

Qualifications

• Bachelor degree in a relevant field is required.
• Minimum 5 years of work experience in AI-related data engineering.
• Advanced understanding of software engineering practices, version control, containerization, and CI/CD pipelines.
• Experience deploying models with TensorFlow or PyTorch; familiar with Azure, Databricks and Fabric.

Responsibilities

• Design and optimise scalable data workflows with expertise in data loading patterns, data architecture.
• Develop and maintain robust data pipelines for real-time and batch processing.
• Extract/integrate data from multiple sources; interface via API between data and application layers.
• Leverage SQL for efficient data transformation and analytics.
• Apply data modelling best practices to support AI/ML applications and indexing for performance.
• Integrate diverse data sources into unified architectures powering AI-driven insights.
• Train advanced models; explore computer vision, forecasting, and route optimisation.
• Collaborate to ensure data readiness, feature engineering pipelines and reproducibility.
• Champion data quality and governance with validation, lineage tracking, and compliance.

Skills

Spark

Python

Java

SQL

Pandas

HuggingFace

OpenAI APIs

Version Control

Containerization

CI/CD

TensorFlow

PyTorch

Education

Bachelor Degree in Engineering, Economics, Mathematics, Computer Science or related areas

Tools

Azure

Databricks

Fabric

Job description

ST LOGISTICS PTE. LTD. seeks a data engineer to design and optimise scalable data workflows for AI-ready analytics.

You will build real-time and batch pipelines, extract and integrate data from diverse sources, and design data models to support AI/ML applications. The role interfaces between data and application layers via APIs and requires strong SQL, Python, Spark and cloud platform experience. The position emphasizes data quality, governance, and reproducibility, with cross-team collaboration