Databricks Developer

Tata Consultancy Services; Bengaluru; On-site; INR 1,200,000 - 2,800,000; Full time

Job summary

Tata Consultancy Services (TCS) Data & Analytics is seeking a Databricks Developer to design and build scalable data pipelines and data lakehouse solutions across AWS/Azure/GCP. You will work with Spark, Delta Lake, and Unity Catalog to enable AI/ML use cases and ensure governance and cost optimization.

You will collaborate with data scientists and cross-functional teams to deliver robust data solutions, applying best practices in data quality, security, and performance tuning.

Qualifications

• 5 to 12 years of experience.
• Strong coding skills in Python/Scala/Java.
• Experience in data engineering, data warehousing and ETL tooling.

Responsibilities

• Design and develop scalable data pipelines using Databricks, Spark, and Delta Lake.
• Build and optimize ETL/ELT workflows with Python, Scala, Java, and SQL.
• Manage Unity Catalog, Databricks Workflows/Jobs, and data governance standards.
• Develop and maintain data lakehouse and data warehouse solutions on cloud platforms (AWS/Azure/GCP).
• Collaborate with Data Scientists to enable AI/ML and analytics use cases.
• Perform performance tuning, troubleshooting, and cost optimization of Databricks workloads.
• Ensure data quality, security, and compliance across enterprise data platforms.
• Work with cross-functional teams to deliver scalable and business-driven data solutions.

Skills

Communication

Team collaboration

Analytical thinking

Data Engineering concepts

ETL/ELT design

Data Governance

Education

Any Technical Degree (BE/BTech/MTech/MCA/BCA/BSc/Diploma/Masters)

Tools

Databricks

Spark

Delta Lake

Python

Scala

Java

SQL

Unity Catalog

Workflows/Jobs

AWS

Azure

Google Cloud

TensorFlow

PyTorch

Scikit-learn

Databricks Certified Developer

Databricks Certified Data Scientist

Job description

TCS Data & Analytics is powering the AI revolution by transforming data into a strategic enterprise asset. Built on the philosophy of Smart Data for Smarter AI, it enables organisations to create intelligent, AI-ready ecosystems that accelerate innovation, unlock new value, and drive business transformation at scale. As AI reshapes industries, TCS is helping businesses turn data into their most powerful competitive advantage.

Title Description for Opportunity

Role Name

Databricks Developer

Responsibilities:

• Design and develop scalable data pipelines using Databricks, Spark, and Delta Lake.
• Build and optimize ETL/ELT workflows using Python, Scala, Java, and SQL.
• Manage Unity Catalog, Databricks Workflows/Jobs, and data governance standards.
• Develop and maintain data lakehouse and data warehouse solutions on cloud platforms (AWS/Azure/GCP).
• Collaborate with Data Scientists to enable AI/ML and analytics use cases.
• Perform performance tuning, troubleshooting, and cost optimization of Databricks workloads.
• Ensure data quality, security, and compliance across enterprise data platforms.
• Work with cross-functional teams to deliver scalable and business-driven data solutions.

Must Have Skills:

• Databricks: In-depth knowledge of Databricks, Spark, Delta Lake, and related technologies.
• Programming: Strong programming skills in Python, Scala, or Java.
• Data Engineering: Experience with data engineering, data warehousing, and ETL tools.
• Expertise in SQL, Unity Catalogue, Workflows/Jobs
• Data Science: Experience with data science, machine learning, and statistical modeling.
• Communication: Excellent communication and collaboration skills
• Cloud Experience: Experience with cloud-based data platforms, such as AWS, Azure, or Google Cloud.
• Machine Learning: Experience with machine learning frameworks, such as TensorFlow, PyTorch, or Scikit-learn.
• Certifications: Relevant certifications, such as Databricks Certified Developer or Databricks Certified Data Scientist

Location: PAN INDIA

Experience Range: 5 to 12 years

Qualifications: Any Technical Degree(BE/B,Tech/M.tech/MCA/BCA/BSC/Diploma/Masters)

Certifications:

Relevant certifications, such as Databricks Certified Developer or Databricks Certified Data Scientist

Documents required for interview:

• TCS Online Application Form
• Resume
• Govt. Photo ID Proof (Aadhar Card / PAN Card)
• PAN Card
• Marksheet
• Work experience letters

Solution- can be used as per opening

• TCS Data Modernization Service on AWS

Research insights/Blogs -

• Modernise ETL systems for a successful AI-first operating model
• TCS accelerates Alstom’s digital transformation with a future-ready Data Integration Backbone

Leadership Video

• The Future of AI is Built on Data. And It Starts Here- Satish Byravan, Global Head of Data & Analytics
• https://www.tcs.com/careers/india/tcs-data-and-analytics-careers