Azure Databricks Platform Engineer

Selectrucks; Bengaluru; Sur place; INR 3 000 000 - 4 500 000; Plein temps

Résumé du poste

Mercedes-Benz Research and Development India Private Limited seeks a senior Data/Platform Engineer to design and implement Azure Databricks-based data solutions in Bengaluru. You will own scalable pipelines, collaborate across teams, and help drive automation and security posture.

The role emphasizes hands-on development with PySpark, Python, and SQL, plus experience in governance, testing, and CI/CD. Join a growing platform team in a fast-paced environment leveraging AI and modern data tooling.

Qualifications

• 5+ years of experience in Data/Platform Engineering.
• Strong hands-on experience with Azure Services and Azure Databricks.
• Experience in solution/component design and reviews.
• Strong proficiency in Python, PySpark, and SQL.
• Understanding of ETL/ELT, data pipelines, data modeling, and data architecture.
• Knowledge of Git, GitHub, CI/CD, and automated deployment practices.
• Python packaging and release processes including Wheel packages.
• Hands-on Pytest and automated unit/integration testing.
• IAM, cloud security, Key Vault, Storage, and monitoring.
• Data Governance and Unity Catalog knowledge.
• AI and LLMs knowledge and application.

Responsabilités

• Design, build, and maintain scalable Azure services and Azure Databricks solutions.
• Develop and optimize ETL/ELT pipelines using Python, PySpark, and SQL.
• Support GitHub, CI/CD, IAM, security, monitoring, and platform configurations.
• Drive platform automation, standardization, reusability, and optimization.
• Explore AI, LLMs, and emerging technologies to build scalable solutions and present ideas to the team.
• Collaborate with cross-functional teams and guide team members on technical topics.

Connaissances

Azure Databricks

Python

PySpark

SQL

ETL/ELT

Data modeling

GitHub CI/CD

IAM & security

Data governance

Unit testing

AI / LLMs

Data pipelines

Formation

Bachelor's degree in CS/Engineering

Outils

GitHub

CI/CD

Description du poste

Description

Role Description

Support the Platform Team in designing, implementing, and scaling Azure and Databricks-based data and platform solutions. The role combines hands-on engineering with platform ownership, automation, team collaboration, and continuous improvement.

Key Responsibilities

Design, build, and maintain scalable Azure services and Azure Databricks solutions.

Develop and optimize ETL/ELT pipelines using Python, PySpark, and SQL.

Support GitHub, CI/CD, IAM, security, monitoring, and platform configurations.

Drive platform automation, standardization, reusability, and optimization.

Explore AI, LLMs, and emerging technologies to build and scale solutions and present relevant ideas to the team.

Collaborate with cross-functional teams and guide team members on technical topics.

Qualifications

Required Skills

5+ years of experience in Data Engineering, Platform Engineering, or a similar role.

Strong hands-on experience with Azure Services and Azure Databricks.

Experience in solution/component design and development, including participation in or leading technical design reviews.

Strong proficiency in Python, PySpark, and SQL.

Strong understanding of ETL/ELT, data pipelines, data modeling, and data architecture.

Good knowledge of Git, GitHub, CI/CD, and automated deployment practices.

Experience with Python package management and release processes, including building and deploying Wheel packages.

Hands-on experience with Pytest and automated unit, integration, and regression testing.

Experience with IAM, cloud security, Key Vault, Storage, and monitoring.

Understanding of Data Governance, Data Quality, and Databricks Unity Catalog.

Knowledge of AI and LLMs and their application in building and scaling solutions.

Strong problem-solving, communication, collaboration, stakeholder management, and team coordination skills.

Good to Have

• Experience with Azure Web Apps / App Services.
• Knowledge of Infrastructure as Code (IaC) and Declarative Asset Bundles.
• Exposure to streaming technologies, MLOps, and Power BI/Fabric.

Organization

Mercedes-Benz Research and Development India Private Limited

Primary Location

India-Karnataka-Bangalore

Work Locations

Mercedes-Benz Research & Development India, Embassy Crest 'Embassy Crest' Plot No 5, EPIP Zone, Phase 1, 560 066