Walk-in | Databricks developer

Tata Consultancy Services; Hyderabad; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

Tata Consultancy Services (TCS) in Pan India seeks an experienced Databricks Developer/Lead to design, develop, and optimize data solutions using Databricks, Spark, Delta Lake and related technologies.

The role emphasizes data engineering, data science collaboration, and performance optimization of Spark jobs, with responsibilities spanning data pipelines, data lakes, and cross-functional guidance.

Qualifications

• 4–10 years of experience in Databricks-based data engineering.
• Strong programming in Python, Scala, or Java.
• Experience with data warehousing, ETL, and data pipelines.
• Proficient in SQL and Unity Catalogue.
• Ability to collaborate with data scientists and cross-functional teams.

Responsibilities

• Design, develop, and optimize data solutions using Databricks and Spark.
• Build and maintain data pipelines, lakes, and warehouses.
• Collaborate with data scientists to deploy ML models.
• Optimize Spark jobs and notebooks for performance.
• Provide technical guidance and ensure data quality.

Skills

Databricks

Python/Scala/Java

Data Engineering

SQL/Delta Lake

Data Science

Spark

Communication

Tools

Delta Lake

Unity Catalogue

Workflows/Jobs

Job description

Experience:4-10 Years

Location: Pan India(Metro Cities)

JD:

An experienced Databricks Developer / Lead to design, develop, and optimize data solutions using Databricks, Spark, and related technologies. The ideal candidate should have a strong background in data engineering, data science, and programming languages like Python, Scala, or Java.

Responsibilities:

• Data Solution Development: Design, develop, and optimize data solutions using Databricks, Spark, and related technologies.
• Data Engineering: Develop and maintain data pipelines, data lakes, and data warehouses using Databricks, Delta Lake, and other tools.
• Data Science: Collaborate with data scientists to deploy machine learning models and optimize data science workflows.
• Performance Optimization: Optimize Spark jobs, Databricks notebooks, and data pipelines for performance and scalability.
• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality

Required Skills:

• Databricks: In-depth knowledge of Databricks, Spark, Delta Lake, and related technologies.
• Programming: Strong programming skills in Python, Scala, or Java.
• Data Engineering: Experience with data engineering, data warehousing, and ETL tools.
• Expertise in SQL, Unity Catalogue, Workflows/Jobs
• Data Science: Experience with data science, machine learning, and statistical modeling.

Communication: Excellent communication and collaboration skills.