Databricks and Data Engineer

Tata Consultancy Services; Hyderabad; On-site; INR 2,400,000 - 4,200,000; Full time

Job summary

Tata Consultancy Services in Hyderabad is seeking a Databricks and Data Engineer with 6–8 years of experience to design and implement scalable data pipelines using Databricks, Spark, and PySpark.

The role requires strong SQL, data modeling, and hands-on experience with cloud platforms (Azure preferred) and ETL/ELT tools, with collaboration across teams in a fast-paced environment. Knowledge of streaming analytics, familiarity with Power BI, Azure DevOps, and CI/CD pipelines are a plus.

Qualifications

• Hands-on Databricks, Spark, and PySpark for big data processing.
• Azure/AWS/GCP data engineering workflows.
• Strong SQL, schema design, and dimensional data modeling.
• Experience with ETL/ELT tools like Azure Data Factory, Informatica, or Talend.
• Familiarity with Azure Synapse, Snowflake, or BigQuery.
• Strong problem-solving and debugging skills.
• Excellent communication and teamwork abilities.
• Ability to work in a fast-paced, dynamic environment.

Skills

Databricks & Spark

Cloud platforms

SQL & data modelling

ETL/ELT Tools

Data warehousing

Problem solving

Communication & teamwork

Fast-paced environment

Tools

Azure Data Factory

Informatica

Talend

Azure Synapse

Snowflake

BigQuery

Job description

Role: Databricks, and Data Engineer

Exp: 6 to 8yrs

Location: Hyderabad

Must-Have**

• Databricks & Spark: Hands-on experience with Databricks, Apache Spark, and PySpark for big data processing.
• Cloud Platforms: Proficiency in Azure (preferred), AWS, or GCP for data engineering workflows
• SQL & Data Modeling: Strong knowledge of SQL, schema design, and dimensional data modeling.
• ETL/ELT Tools: Experience with tools like Azure Data Factory, Informatica, or Talend.
• Data Warehousing: Familiarity with technologies such as Azure Synapse, Snowflake, or BigQuery.
• Strong problem-solving and debugging skills.
• Excellent communication and teamwork abilities.
• Ability to work in a fast-paced, dynamic environment.

Good-to-Have

• Knowledge of Event Hub, IoT Hub, and streaming analytics.
• Exposure to Power BI, Azure DevOps, and CI/CD pipelines.
• Understanding of machine learning libraries (MLlib) and predictive analytics.