Hadoop Developer

Systechcorp Inc; Navi Mumbai; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Systechcorp Inc. is seeking a Hadoop SME/Developer to lead a major Hadoop-HBase to Teradata migration. The role requires deep knowledge of the Hadoop ecosystem and hands-on experience with HBase, HDFS, Spark, and related tools.

You will work closely with customers to design and implement data migration strategies, ensure data integrity, and optimize ingestion pipelines for unstructured data. A strong background in Java/Python/Scala and Bash scripting is essential.

Qualifications

• Total IT experience 10+ years.
• Minimum 5 years of relevant experience using key Hadoop services.
• Minimum 6 months of hands‑on HBase experience.
• Solid understanding of how structured data is stored and accessed in HBase, and metadata can be linked with the RDBMS to migrate the data.
• Data Integration experience is required.
• Knowledge of HDFS, HBase, Solr, Spark, Hive.
• Experience in unstructured data processing and validation.
• Developed data ingestion pipelines in Hadoop for unstructured data.
• Hands‑on experience in Java, Python, Scala and Bash scripting.
• Understanding of Solr text search.
• Experience migrating/storing data in AWS S3 and Azure Blob.
• Strong communication with customers and prospects.

Responsibilities

• Hadoop-HBase SME working on a large Hadoop-HBase to Teradata migration project.
• Proficient in the Hadoop ecosystem to support migration activities.
• Collaborate with clients to understand requirements and deliver data migration results.

Skills

Hadoop ecosystem

Java

Python

Scala

Bash scripting

Data integration

Teradata migration

Communication with customers

Tools

HDFS

HBase

Solr

Spark

Hive

AWS Glue

Athena

Azure Blob

Job description

Role: Hadoop SME / Developer

Job Location: Mumbai

Role Description

• This position is for a Hadoop-HBase SME who will be working on a large and complex Hadoop-HBase to Teradata migration project.
• Good experience of the Hadoop ecosystem will be a key competency for this position.

Minimum Requirements

• Total IT experience of 10+ years.
• Minimum 5 years of relevant experience using key Hadoop services
• Minimum 6 months of hands‑on Hbase experience
• Solid understanding of how structured data is stored and accessed in HBase, and metadata can be linked with the RDBMS to migrate the data.
• Data Integration experience is required
• Knowledge of following Hadoop components are required: HDFS, HBase, Solr, Spark, Hive.
• Experience in unstructured data processing and validation such as documents, images and text.
• Worked and developed data ingestion pipelines in Hadoop for unstructured data.
• Good hands‑on experience in programming language like Java, Python, Scala and Bash scripting.
• Understanding of how Solr text search works.
• Experience in migrating, storing and retrieving data in object stores like AWS S3, and Azure Blob.
• Should be able to communicate effectively with customers and prospects.

Nice to have Experience

• Working experience with AWS integration services like AWS Glue and Athena.
• Good Experience in Teradata Vantage SQL
• Experience with any database migration would be added plus Role & responsibilities

Preferred candidate profile