Senior Databricks AI/ML Platform Engineer - APAC

Tata Consultancy Services Limited; Melbourne; On-site; AUD 180,000 - 280,000; Full time

Job summary

Tata Consultancy Services Limited in Australia is seeking a Senior Databricks ML Platform Engineer to accelerate AI enablement, ML platform adoption, and data platform modernization across Azure Databricks.

You will design and implement enterprise-grade Databricks environments, govern with Unity Catalog, build lakehouse architectures, optimize performance, and drive cloud transformation while delivering ML pipelines, vector search, RAG, and agentic AI integrations.

Qualifications

• 5+ years of Data Engineering, ML Engineering, or Platform Engineering experience.
• Experience implementing enterprise-scale AI or ML platforms.
• Experience with production AI workloads and MLOps.
• Experience supporting highly regulated enterprise environments.
• Strong stakeholder management and communication skills.

Responsibilities

• Design and administer Azure Databricks environments.
• Implement Unity Catalog governance and security controls.
• Build scalable Lakehouse architectures using Delta Lake.
• Optimize Databricks performance, reliability, and operational efficiency.
• Support platform modernization and cloud transformation initiatives.
• Develop and operationalize machine learning solutions on Databricks.
• Implement ML pipelines using MLflow and Databricks Machine Learning.
• Build and deploy model serving endpoints.
• Design and implement Vector Search indexes and endpoints.
• Develop Retrieval-Augmented Generation (RAG) solutions.
• Support Agentic AI and MCP integrations.
• Enable Azure OpenAI and Databricks Mosaic AI capabilities.
• Implement CI/CD pipelines for ML workloads.
• Manage model versioning, experimentation, and monitoring.
• Develop automated retraining and deployment processes.
• Implement model governance and observability.
• Monitor model drift and performance using enterprise MLOps practices.

Skills

Data engineering

ML engineering

Platform engineering

AI/ML platforms

MLOps

Regulated environments

Stakeholder management

Tools

Azure Databricks

Delta Lake

MLflow

Databricks Mosaic AI

Job description

Tata Consultancy Services Limited in Australia is seeking a Senior Databricks ML Platform Engineer to accelerate AI enablement, ML platform adoption, and data platform modernization across Azure Databricks.

You will design and implement enterprise-grade Databricks environments, govern with Unity Catalog, build lakehouse architectures, optimize performance, and drive cloud transformation while delivering ML pipelines, vector search, RAG, and agentic AI integrations.