Azure Databricks Developer

Tata Consultancy Services; Chennai District; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Tata Consultancy Services is seeking an experienced Azure Databricks Developer to join our data engineering team in Chennai. You will design, build, and optimize data pipelines using PySpark/Spark and integrate data from multiple sources in cloud-based analytics solutions.

The ideal candidate has 6-10 years of experience, strong SQL and Python skills, and a solid understanding of data warehousing concepts, performance tuning, and data quality in production environments.

Qualifications

• 6–10 years of relevant experience in data engineering.
• Strong PySpark/Spark, SQL, and Python skills.
• Experience with data warehousing concepts and performance tuning.

Responsibilities

• Design, develop, and optimize data pipelines using Azure Databricks.
• Build scalable data processing solutions using PySpark and Spark.
• Integrate data from multiple sources into Azure data platforms.
• Develop and maintain ETL/ELT workflows.
• Ensure data quality, performance, and reliability.
• Collaborate with business and technical teams to deliver analytics solutions.
• Support production deployments and troubleshoot issues.

Skills

PySpark / Spark

SQL & Python

Data Warehousing Concepts

Performance Tuning & Optimization

Job description

Experience: 6-10 Years

Virtual Interview Date: 7th August

We are looking for experienced Azure Databricks Developers with strong expertise in data engineering, big data processing, and cloud-based analytics solutions.

Key Skills

• PySpark / Spark
• SQL & Python
• Data Warehousing Concepts
• Performance Tuning & Optimization

Responsibilities

• Design, develop, and optimize data pipelines using Azure Databricks.
• Build scalable data processing solutions using PySpark and Spark.
• Integrate data from multiple sources into Azure data platforms.
• Develop and maintain ETL/ELT workflows.
• Ensure data quality, performance, and reliability.
• Collaborate with business and technical teams to deliver analytics solutions.
• Support production deployments and troubleshoot issues.