Hadoop Developer

Synechron; Bengaluru; On-site; INR 1,200,000 - 1,900,000; Full time

Job summary

Synechron in Bengaluru (India) seeks a skilled Big Data Engineer to design, develop, test, deploy, and maintain large-scale data processing pipelines using Spark and the Hadoop ecosystem. You will collaborate with cross-functional teams to translate business requirements into scalable data solutions and write efficient PySpark/Python code.

The role requires 3-6 years of hands-on experience with Spark, Hadoop, Hive, and Scala, plus strong SQL skills to query large datasets.

Qualifications

• 3-6 years of experience in Big Data Technologies (Hadoop) with expertise in Spark.
• Proficiency in writing efficient SQL queries for querying large datasets.
• Strong understanding of Hive, PySpark, Scala programming languages.

Responsibilities

• Design, develop, test, deploy, and maintain large-scale data processing pipelines using Spark.
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
• Develop high-quality code in Python using PySpark and Hadoop technologies.
• Troubleshoot complex issues related to big data processing and provide timely resolutions.
• Participate in code reviews and contribute to the development of best practices for software engineering.

Skills

Big Data Spark

PySpark

SQL queries

Hive

Scala

Hadoop

Python

Education

B.Tech / BE

Job description

Roles and Responsibilities

• Design, develop, test, deploy, and maintain large-scale data processing pipelines using Spark.
  
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
  
• Develop high-quality code in Python using PySpark and Hadoop technologies.
  
• Troubleshoot complex issues related to big data processing and provide timely resolutions.
  
• Participate in code reviews and contribute to the development of best practices for software engineering.
  

Desired Candidate Profile

• 3-6 years of experience in Big Data Technologies (Hadoop) with expertise in Spark.
  
• Proficiency in writing efficient SQL queries for querying large datasets.
  
• Strong understanding of Hive, Pyspark, Scala programming languages.
  
• Bachelor's degree in Any Specialization (B.Tech / B.E.).