Bigdata And Hadoop Developer

Tata Consultancy Services; Bengaluru, Hyderabad; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Tata Consultancy Services in Bengaluru is hiring a Big Data Developer with 5–15 years of hands-on experience to design, develop, and optimize Hadoop-based solutions.

You will work on data ingestion, processing, and storage, implement MapReduce, Hive, and Spark jobs, and collaborate with cross-functional teams to ensure data quality and scalable analytics.

Qualifications

• In-depth knowledge of Hadoop, HDFS, MapReduce, Hive, Pig, HBase and Spark.
• Strong programming skills in Java, Python, or Scala.
• Experience with NoSQL, data warehousing, and ETL tools.
• Experience with Hadoop, Spark, and Flink.
• Good understanding of multithreading and distributed computing concepts in PySpark.
• Excellent communication and collaboration skills.

Responsibilities

• Design and Development: Design, develop, and maintain Hadoop applications, including data ingestion, processing, and storage.
• Data Processing: Develop and optimize Hadoop MapReduce jobs, Hive queries, and Pig scripts for data processing and analysis.
• Data Management: Manage and maintain Hadoop clusters, including configuration, monitoring, and troubleshooting.
• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality.
• Innovation: Stay up to date with industry trends, new technologies, and best practices in big data and Hadoop.

Skills

Hadoop Ecosystem

Programming: Java/Python/Scala

Big Data Technologies: NoSQL, dataware

Data Processing: Hadoop, Spark, Flink

Multithreading & distributed computing

Communication skills

Tools

Hadoop

HDFS

MapReduce

Hive

Pig

HBase

Spark

NoSQL databases

ETL tools

Job description

TCS Hiring!!

Tcs is having vacancy for skill Big data Developer

Exp req: 5 to 15 yrs

JD

Responsibilities:

• Design and Development: Design, develop, and maintain Hadoop applications, including data ingestion, processing, and storage.
• Data Processing: Develop and optimize Hadoop MapReduce jobs, Hive queries, and Pig scripts for data processing and analysis.
• Data Management: Manage and maintain Hadoop clusters, including configuration, monitoring, and troubleshooting.
• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality.
• Innovation: Stay up to date with industry trends, new technologies, and best practices in big data and Hadoop.

Required Skills:

• Hadoop Ecosystem: In-depth knowledge of Hadoop, HDFS, MapReduce, Hive, Pig, HBase, and Spark.
• Programming: Strong programming skills in Java, Python, or Scala.
• Big Data Technologies: Experience with big data technologies, including NoSQL databases, data warehousing, and ETL tools.
• Data Processing: Experience with data processing frameworks, including Hadoop, Spark, and Flink.
• Very good conceptual understanding of Multithreading, distributed computing concepts of Pyspark
• Communication: Excellent communication and collaboration skills.

Preferred Skills:

• Cloud Experience: Experience with cloud-based big data platforms, such as AWS EMR, Azure HDInsight, or Google Cloud Dataproc.
• Machine Learning: Experience with machine learning and deep learning frameworks, such as TensorFlow, PyTorch, or Scikit-learn.
• Certifications: Relevant certifications, such as Cloudera Certified Professional (CCP) or Hortonworks Certified Developer (HCD)