Databricks AI Engineer: Pipelines, GenAI & Apps

Tata Consultancy Services Asia Pacific Pte Ltd; Singapore; On-site; SGD 70,000 - 120,000; Full time

Job summary

Tata Consultancy Services Asia Pacific Pte Ltd in Singapore seeks a Data & AI Engineer to build scalable data pipelines, develop AI agents, and deliver end-to-end data and AI applications on the enterprise data platform, focused on Databricks.

You will bridge data engineering, AI engineering, and data science to power analytics, automation, and intelligent applications across Suntory Beverage & Food’s global operations, contributing to enterprise AI architecture with reusable, high-performance

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Data Science, or related field.
• 1–3 years of experience in data engineering, AI engineering, or related roles.
• Strong hands-on experience with Databricks (Delta Lake, PySpark, workflows, model serving).
• Proficiency in Python and SQL for data processing and application development.
• Experience building data pipelines and ETL processes in large-scale environments.
• Practical experience in AI/GenAI development (LLMs, RAG, prompt engineering).
• Familiarity with API development and integration for data and AI services.
• Understanding of machine learning concepts and model deployment workflows.
• Experience with MLOps / DataOps (CI/CD, pipeline automation, monitoring) is preferred.
• Knowledge of Azure ecosystem (ADLS, ADF, Azure AI) is a plus.
• Strong problem-solving skills and ability to work across cross-functional teams.
• Experience in FMCG, supply chain, or commercial analytics is an advantage.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks (Delta Lake, PySpark, workflows).
• Build robust ETL/ELT processes to ingest, transform, and serve data from multiple sources.
• Ensure data quality, reliability, and performance optimisation across pipelines.
• Implement data models aligned with analytics and AI use cases.
• Collaborate with data governance teams to ensure compliance with enterprise data standards.
• Design and develop AI agents and GenAI solutions using Databricks and Azure AI capabilities.
• Implement RAG, prompt engineering, and orchestration for enterprise AI use cases.
• Integrate agents with enterprise data sources, vector databases, and APIs.
• Collaborate with business teams to identify AI-driven automation and productivity use cases.
• Develop end-to-end data and AI applications using Databricks (notebooks, dashboards, apps, APIs).
• Expose data and AI services via APIs and work with BI teams to integrate backend logic.

Skills

Databricks

Delta Lake

PySpark

Workflows

Model Serving

APIs

Python

SQL

MLOps

GenAI

RAG

Azure AI

Cross-functional collaboration

Problem solving

Education

Bachelor’s or Master’s in Computer Science, Data Engineering, Data Science, or related field

Tools

Databricks

Delta Lake

PySpark

APIs

Azure AI

Model Serving

CI/CD

Job description

Tata Consultancy Services Asia Pacific Pte Ltd in Singapore seeks a Data & AI Engineer to build scalable data pipelines, develop AI agents, and deliver end-to-end data and AI applications on the enterprise data platform, focused on Databricks.

You will bridge data engineering, AI engineering, and data science to power analytics, automation, and intelligent applications across Suntory Beverage & Food’s global operations, contributing to enterprise AI architecture with reusable, high-performance