Azure Databricks Platform Engineer

Daimler AG (Canada); Bengaluru; On-site; INR 3,000,000 - 5,500,000; Full time

Job summary

Mercedes-Benz Research and Development India Private Limited in Bengaluru is seeking a seasoned Data/Platform Engineer to design, build, and scale Azure and Databricks-based data and platform solutions. You will balance hands-on engineering with platform ownership, automation, and cross-functional collaboration.

The role focuses on ETL/ELT pipelines, data governance, IAM, monitoring, and exploring AI/LLMs to drive reusable platform components, with guidance to team members on technical topics.

Qualifications

• 5+ years of experience in Data Engineering, Platform Engineering, or a similar role.
• Strong hands-on experience with Azure Services and Azure Databricks.
• Experience in solution/component design and development, including participation in or leading technical design reviews.
• Strong proficiency in Python, PySpark, and SQL.
• Strong understanding of ETL/ELT, data pipelines, data modeling, and data architecture.
• Good knowledge of Git, GitHub, CI/CD, and automated deployment practices.
• Experience with Python package management and release processes, including building and deploying Wheel packages.
• Hands-on experience with Pytest and automated unit, integration, and regression testing.
• Experience with IAM, cloud security, Key Vault, Storage, and monitoring.
• Understanding of Data Governance, Data Quality, and Databricks Unity Catalog.
• Knowledge of AI and LLMs and their application in building and scaling solutions.
• Strong problem-solving, communication, collaboration, stakeholder management, and team coordination skills.

Responsibilities

• Design, build, and maintain scalable Azure services and Azure Databricks solutions.
• Develop and optimize ETL/ELT pipelines using Python, PySpark, and SQL.
• Support GitHub, CI/CD, IAM, security, monitoring, and platform configurations.
• Drive platform automation, standardization, reusability, and optimization.
• Explore AI, LLMs, and emerging technologies to build and scale solutions and present relevant ideas to the team.
• Collaborate with cross-functional teams and guide team members on technical topics.

Skills

Azure Services

Azure Databricks

Python

PySpark

SQL

ETL/ELT

Data modeling

Data architecture

GitHub

CI/CD

Automated testing

IAM

Cloud security

Key Vault

Monitoring

Data Governance

Databricks Unity Catalog

AI and LLMs

Tools

GitHub

CI/CD

Job description

Description

Role Description

Support the Platform Team in designing, implementing, and scaling Azure and Databricks-based data and platform solutions. The role combines hands-on engineering with platform ownership, automation, team collaboration, and continuous improvement.

Key Responsibilities

Design, build, and maintain scalable Azure services and Azure Databricks solutions.

Develop and optimize ETL/ELT pipelines using Python, PySpark, and SQL.

Support GitHub, CI/CD, IAM, security, monitoring, and platform configurations.

Drive platform automation, standardization, reusability, and optimization.

Explore AI, LLMs, and emerging technologies to build and scale solutions and present relevant ideas to the team.

Collaborate with cross-functional teams and guide team members on technical topics.

Qualifications

Required Skills

5+ years of experience in Data Engineering, Platform Engineering, or a similar role.

Strong hands-on experience with Azure Services and Azure Databricks.

Experience in solution/component design and development, including participation in or leading technical design reviews.

Strong proficiency in Python, PySpark, and SQL.

Strong understanding of ETL/ELT, data pipelines, data modeling, and data architecture.

Good knowledge of Git, GitHub, CI/CD, and automated deployment practices.

Experience with Python package management and release processes, including building and deploying Wheel packages.

Hands-on experience with Pytest and automated unit, integration, and regression testing.

Experience with IAM, cloud security, Key Vault, Storage, and monitoring.

Understanding of Data Governance, Data Quality, and Databricks Unity Catalog.

Knowledge of AI and LLMs and their application in building and scaling solutions.

Strong problem-solving, communication, collaboration, stakeholder management, and team coordination skills.

Good to Have

• Experience with Azure Web Apps / App Services.
• Knowledge of Infrastructure as Code (IaC) and Declarative Asset Bundles.
• Exposure to streaming technologies, MLOps, and Power BI/Fabric.

Organization

Mercedes-Benz Research and Development India Private Limited

Primary Location

India-Karnataka-Bangalore

Work Locations

Mercedes-Benz Research & Development India, Embassy Crest 'Embassy Crest' Plot No 5, EPIP Zone, Phase 1, 560 066