Databricks Developer

Tata Consultancy Services; Chennai District; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Tata Consultancy Services in Chennai seeks experienced data professionals to design and deploy data solutions using Databricks, Spark, and Delta Lake. You will develop data pipelines, data lakes, and data warehouses, ensuring performance and scalability across data platforms.

The ideal candidate has hands-on Python/Scala/Java, SQL, ML workflows, and cloud experience with AWS/Azure/Google Cloud, along with strong communication and teamwork skills.

Qualifications

• Databricks, Spark, Delta Lake expertise.
• Programming in Python, Scala, or Java.
• Experience with data engineering, data warehousing, and ETL tools.
• Experience with SQL, Unity Catalog, Workflows/Jobs.
• Experience in data science, ML workflows, and statistics.
• Excellent communication and collaboration skills.
• Cloud experience with AWS, Azure, or Google Cloud.
• Databricks Certified Developer or Databricks Certified Data Scientist certifications are a plus.

Responsibilities

• Data Solution Development: Design, develop, and optimize data solutions using Databricks, Spark, and related technologies.
• Data Engineering: Develop and maintain data pipelines, data lakes, and data warehouses using Databricks, Delta Lake, and other tools.
• Data Science: Collaborate with data scientists to deploy ML models and optimize workflows.
• Performance Optimization: Optimize Spark jobs, Databricks notebooks, and data pipelines for performance and scalability.
• Collaboration: Work with cross-functional teams to identify requirements, provide technical guidance, and ensure data quality.

Skills

Python

Scala

Java

SQL

Communication

Education

15 years education

Tools

Databricks

Spark

Delta Lake

Job description

Walkin Time: 9am-1pm

Experience Range:4-10yrs

TCS has always been in the spotlight for being adept in the next big technologies. What we can offer you is a space to explore varied technologies and quench your techie soul.

Responsibilities:

• Data Solution Development: Design, develop, and optimize data solutions using Databricks, Spark, and related technologies.
• Data Engineering: Develop and maintain data pipelines, data lakes, and data warehouses using Databricks, Delta Lake, and other tools.
• Data Science: Collaborate with data scientists to deploy machine learning models and optimize data science workflows.
• Performance Optimization: Optimize Spark jobs, Databricks notebooks, and data pipelines for performance and scalability.
• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality

Required Skills:

• Databricks: In-depth knowledge of Databricks, Spark, Delta Lake, and related technologies.
• Programming: Strong programming skills in Python, Scala, or Java.
• Data Engineering: Experience with data engineering, data warehousing, and ETL tools.
• Expertise in SQL, Unity Catalogue, Workflows/Jobs
• Data Science: Experience with data science, machine learning, and statistical modeling.
• Communication: Excellent communication and collaboration skills.

Preferred Skills:

• Cloud Experience: Experience with cloud-based data platforms, such as AWS, Azure, or Google Cloud.
• Machine Learning: Experience with machine learning frameworks, such as TensorFlow, PyTorch, or Scikit-learn.
• Certifications: Relevant certifications, such as Databricks Certified Developer or Databricks Certified Data Scientist

Minimum Qualification: 15 years of full-time education