Developer

Tata Consultancy Services Limited; Telangana; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Tata Consultancy Services Limited in Telangana, India is seeking a senior Big Data Engineer with 4–15 years of IT experience to design and implement scalable data solutions. You will work with Spark, PySpark, Hadoop, Hive, and cloud data services to deliver robust ETL/ELT pipelines and data platforms.

Your role involves optimizing data pipelines, ensuring data quality, and collaborating with data architects and business teams across on-premises and cloud environments.

Qualifications

• 4–15 years of IT experience with strong expertise in Big Data engineering, development, and data processing.
• Hands-on experience with distributed data processing and modern data platforms.
• Proficiency in Python, PySpark, SQL and/or Scala for data engineering solutions.

Responsibilities

• Develop and maintain scalable ETL/ELT pipelines for large volumes of structured and unstructured data.
• Design and optimize data pipelines, data lakes, data warehouses, and large-scale processing workflows.
• Work closely with data architects, analysts, and business teams to deliver reliable and scalable data solutions.
• Follow best practices for data security, governance, CI/CD, documentation and production support.

Skills

Big Data engineering

Spark/PySpark

Python

SQL

Scala

Data pipelines

Cloud platforms

Data security & governance

Tools

Apache Spark

Hadoop

Hive

HDFS

Kafka

Databricks

Airflow

Delta Lake

Job description

Experience: 04 to 15yrs

Notice Period: 0-90 Days

Date of Interview: 24th Oct,2026

Responsibilities :-

• 4–15 years of IT experience with strong expertise in Big Data engineering, development, and data processing.
• Hands‑on experience with Apache Spark, PySpark, Hadoop, Hive, HDFS, and distributed data processing.
• Develop and maintain scalable ETL/ELT pipelines for large volumes of structured and unstructured data.
• Strong programming skills in Python, PySpark, SQL, and/or Scala for data engineering solutions.
• Experience working with cloud platforms such as AWS, Azure, or GCP and their data services.
• Design and optimize data pipelines, data lakes, data warehouses, and large-scale processing workflows.
• Experience with technologies such as Kafka, Databricks, Airflow, Delta Lake, or equivalent Big Data tools.
• Perform performance tuning, troubleshooting, data quality checks, and optimization of Big Data applications.
• Work closely with data architects, analysts, and business teams to deliver reliable and scalable data solutions.
• Follow best practices for data security, governance, CI/CD, documentation, and production support.