AI Data Engineer

MICHAEL PAGE (PERSONNEL) PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Benefits offered by this job

Career growth opportunities

Cutting-edge data/AI transformation

Job summary

MICHAEL PAGE (PERSONNEL) PTE. LTD. is seeking a senior data engineer to design and support large-scale batch and real-time data pipelines on modern cloud platforms.

You will drive data integration across APIs, databases, files, and event-driven systems, and support GenAI use cases with robust knowledge repositories and RAG solutions. The role requires strong CI/CD, data governance, cloud security, and platform operations skills, with a focus on reliability and stakeholder collaboration.

Qualifications

• Degree in Computer Science, Engineering, Information Systems, or a related discipline.
• At least 5 years of experience in data engineering or cloud data platform delivery.
• Proficient with Databricks, Apache Spark (PySpark), and SQL; exposure to Python, Kafka, Delta Lake, and Microsoft Fabric.
• Experience designing production-grade batch and streaming pipelines, including orchestration and monitoring.
• Knowledge Base and RAG solutions development.
• Good understanding of CI/CD, data governance, cloud security, access management, and platform operations; strong stakeholder communication.

Responsibilities

• Design, develop, and support large-scale batch and real-time data pipelines on modern cloud platforms.
• Build robust data integration solutions across APIs, databases, files, and event-driven systems.
• Develop and maintain knowledge repositories and retrieval-based AI solutions to support GenAI use cases.
• Provide technical leadership on platform architecture, code quality, deployment standards, and operational excellence.
• Drive platform reliability through monitoring, troubleshooting, release management, and continuous improvement initiatives.

Skills

Databricks

Apache Spark (PySpark)

SQL

Python

Kafka

Delta Lake

Microsoft Fabric

Knowledge Base & RAG

Education

Degree in Computer Science, Engineering, Information Systems

Job description

• Competitive package with strong career growth potential
• Permanent position with stable work environment

About Our Client

Our client is a well-established organisation investing heavily in modern cloud, data, and AI capabilities to enable digital transformation and innovation across multiple business functions.

Job Description

• Design, develop, and support large-scale batch and real-time data pipelines on modern cloud platforms.
• Build robust data integration solutions across APIs, databases, files, and event-driven systems.
• Develop and maintain knowledge repositories and retrieval-based AI solutions to support emerging GenAI use cases.
• Provide technical leadership on platform architecture, code quality, deployment standards, and operational excellence.
• Drive platform reliability through monitoring, troubleshooting, release management, and continuous improvement initiatives.

The Successful Applicant

• Degree in Computer Science, Engineering, Information Systems,or a related discipline
• At least 5 years of experience in data engineering or cloud data platform delivery.
• Strong hands-on experience withDatabricks, Apache Spark (PySpark), and SQL, with exposure to technologies such asPython, Kafka, Delta Lake, and Microsoft Fabricconsidered advantageous.
• Proven track record designing and supporting production-grade batch and streaming pipelines, including orchestration, monitoring, troubleshooting, and performance optimisation.
• Experience implementingKnowledge Base and RAG solutions, including embeddings, vectorisation, retrieval mechanisms, and GenAI applications.
• Good understanding ofCI/CD, data governance, cloud security, access management, and platform operations,with strong stakeholder communication skills.

What's on Offer

• Competitive package with strong career growth potential
• Opportunity to work on cutting-edge cloud, data, and AI transformation programmes.
• Exposure to enterprise-scale platforms, stakeholders, and high-impact business initiatives.