DataBricks Engineer_Virtual Drive_9-JAN-2026

Tata Consultancy Services; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

A leading IT services company is looking for an Assistant Manager with strong DataBricks and Python expertise to monitor and troubleshoot workflows and Azure Data Factory pipeline runs. This full-time position requires proven experience in data support using Cloud technology and a solid understanding of Data Warehousing concepts. Join a global team and contribute to business-critical reporting and process documentation in a dynamic environment based in Hyderabad, Telangana.

Qualifications

• Proven experience working with DataBricks and Apache Spark Python.
• Experience in Azure Cloud technologies is required.
• Strong understanding of Data Warehousing and Data Lakes.

Responsibilities

• Understand and troubleshoot Python code in DataBricks notebooks.
• Monitor Azure Data Factory pipeline runs and troubleshoot failures.
• Support business-critical reporting during transformations.
• Document processes and implement best practices.
• Be part of a global team.

Skills

DataBricks

Apache Spark

Python

SQL

Azure Cloud

Data Warehousing

Data Lakes

Job description

Assistant Manager @ Tata Consultancy Services | Recruiting Expertise

Hello, Good Day!

JOB Description

• Databricks
• PySpark / Python.
• SQL.

Good to Know

CI / CD (Continuous Integration / Continuous Delivery or Deployment): Azure DevOps, Mongo DB, Datadog and Splunk.

Key Responsibilities

• Understand the Python code written in the DataBricks notebooks, troubleshoot & identify bugs.
• Monitor and troubleshoot DataBricks workflows / job failures.
• Monitor and troubleshoot Azure Data Factory (ADF) pipeline runs.
• Work on DataBricks / Azure Data Factory (ADF) production fixes or enhancements as needed.
• Support business‑critical reporting during the transformation process.
• Document processes and implement industry best practices.
• Be an active member of a global team.
• Deep understanding of modern Data Architecture, Data Warehousing concepts and Dimensional Modeling.

Required qualifications

Working DataBricks experience & strong Apache Spark Python.

Working experience in Azure Cloud.

Good understanding of Data Warehousing / Data Lakes concepts.

Proven senior‑level data support experience using Cloud technology.

Seniority level

Mid‑Senior level

Employment type

Full‑time

Job function

Business Development, Engineering, and General Business

Industries

IT Services and IT Consulting, Data Infrastructure and Analytics, and IT System Data Services

Referrals increase your chances of interviewing at Tata Consultancy Services by 2x

Get notified about new Software Engineer jobs in Hyderabad, Telangana, India.