Databricks Developer

Tata Consultancy Services; Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services in Pune, India seeks a data engineering professional to design, build, and optimize large-scale data processing pipelines.

You will work with Databricks, Azure Synapse, and Python-based ML models to deliver insights, ensure data quality, and support scalable analytics across teams.

Responsibilities

• Design, develop, test, deploy, and maintain data pipelines using Databricks.
• Collaborate with cross-functional teams to gather requirements and deliver solutions.
• Develop complex SQL queries to extract insights from datasets in Azure Synapse.
• Implement machine learning models using Python libraries such as scikit-learn and TensorFlow.
• Troubleshoot data quality, performance optimization, and scalability issues.

Job description

Roles and Responsibilities

• Design, develop, test, deploy, and maintain large-scale data processing pipelines using Databricks.
  
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
  
• Develop complex SQL queries to extract insights from massive datasets stored in Azure Synapse.
  
• Implement machine learning models using Python libraries such as scikit-learn and TensorFlow.
  
• Troubleshoot issues related to data quality, performance optimization, and scalability.