Databricks Specialist

Tata Consultancy Services; Hyderabad; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Tata Consultancy Services in Hyderabad is seeking a data engineer with hands-on experience in Databricks, Spark, and PySpark to drive big data processing and analytics.

The role requires cloud proficiency (Azure preferred), SQL and data modeling skills, and hands-on ETL/ELT experience with ADF, Informatica, or Talend to build scalable data pipelines. Strong problem-solving, communication, and ability to thrive in a fast-paced team environment are essential.

Qualifications

• Hands-on experience with Databricks, Spark, and PySpark.
• Proficiency in Azure, AWS, or GCP for data pipelines.
• Strong SQL, schema design, and dimensional modeling.
• Experience with ETL/ELT tools like Azure Data Factory, Informatica, or Talend.
• Familiarity with Azure Synapse, Snowflake, or BigQuery.

Skills

Databricks & Spark

SQL

Data Modeling

ETL/ELT Tools

Data Warehousing

Problem Solving

Communication & Teamwork

Fast-paced environment

Tools

Databricks

Apache Spark

PySpark

Azure Data Factory

Informatica

Talend

Azure Synapse

Snowflake

BigQuery

Power BI

Azure DevOps

CI/CD

MLlib

Job description

Role & responsibilities

Competencies (Technical/Behavioral Competency)

• Databricks & Spark: Hands-on experience with Databricks, Apache Spark, and PySpark for big data processing.


• Cloud Platforms: Proficiency in Azure (preferred), AWS, or GCP for data engineering workflows


• SQL & Data Modeling: Strong knowledge of SQL, schema design, and dimensional data modeling.


• ETL/ELT Tools: Experience with tools like Azure Data Factory, Informatica, or Talend.


• Data Warehousing: Familiarity with technologies such as Azure Synapse, Snowflake, or BigQuery.


• Strong problem-solving and debugging skills.


• Excellent communication and teamwork abilities.


• Ability to work in a fast-paced, dynamic environment.

Good-to-Have

• Knowledge of Event Hub, IoT Hub, and streaming analytics.


• Exposure to Power BI, Azure DevOps, and CI/CD pipelines.


• Understanding of machine learning libraries (MLlib) and predictive analytics.