Walk In || Databricks Data Engineer

Tata Consultancy Services; Pune District; On-site; INR 1,400,000 - 2,700,000; Full time

Job summary

Tata Consultancy Services (TCS) Pune invites experienced data professionals to join its data engineering team. The role emphasizes building scalable data pipelines with Apache Spark and the Databricks platform, and strong Python (PySpark) or Scala programming skills.

Responsibilities include ETL design, data ingestion and transformations, data warehousing knowledge, and cloud experience (AWS or Azure). Walk-in at TCS Pune on 08-August-26 (Saturday).

Qualifications

• Strong hands-on experience in data engineering and big data development using Spark and Databricks.
• Strong programming skills in Python (with PySpark) and/or Scala for distributed data processing.
• Experience designing and managing ETL pipelines, data ingestion, and transformations for large production datasets.
• Knowledge of data warehousing, data modeling, and SQL/Spark query optimization.
• Familiarity with AWS or Azure cloud services for big data solutions and cluster management.
• Excellent problem-solving, attention to detail, and ability to work in a fast-paced, collaborative environment.

Responsibilities

• Develop and optimize data pipelines using Apache Spark on Databricks.
• Write scalable Python (PySpark) or Scala code for distributed data processing.
• Design ETL pipelines, data ingestion, and transformations for large production datasets.
• Optimize SQL queries and Spark jobs for performance in data warehousing contexts.
• Leverage cloud services (AWS or Azure) for big data solutions and cluster management.
• Collaborate in a fast-paced, cross-functional team and communicate technical issues clearly.

Skills

Data engineering

Big data development

Apache Spark

Databricks

Python with PySpark

Scala

ETL pipelines

Data ingestion

Data transformations

Data warehousing

SQL optimization

Cloud platforms

AWS

Azure

Cluster management

Resource optimization

Problem solving

Communication

Tools

Databricks

Apache Spark

Python

Scala

SQL

AWS

Azure

Job description

Come and join us for an exciting career with TCS!!!

Experience: 6 - 15 Years

Walk In Venue: TCS Pune

Walk In Date - 08-August-26 (Saturday)

Role Summary

• Strong hands-on experience in data engineering and big data development, working with Apache Spark and the Databricks platform.
• Strong programming skills in Python (with PySpark) and/or Scala, with the ability to write efficient, scalable code for data processing on distributed systems.
• Proven experience in designing and managing ETL pipelines, data ingestion processes, and transformations for large datasets in production environments.
• In-depth knowledge of data warehousing concepts, data modeling, and working with both relational and NoSQL databases; ability to optimize SQL queries and Spark jobs for performance.
• Familiarity with cloud services (such as AWS or Azure) in context of big data solutions, including cluster management and resource optimization on cloud platforms.
• Excellent problem-solving skills, attention to detail, and the ability to work effectively in a fast-paced, collaborative environment, managing multiple priorities and communicating technical issues proactively.