Data Engineer – HBase, EMR & Spark Modernization

Trantor; Chandigarh; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Trantor in India is seeking an experienced Data Engineer to support a large-scale data platform modernization. You will migrate and modernize HBase, EMR, Hadoop and Spark environments, while ensuring data integrity and production stability.

You will work with Cloud, Backend, Architecture, DevSecOps, Security, and QA teams to plan upgrades, migrations, and post-migration validation, leveraging HBase snapshots and HFile-based strategies.

Qualifications

• 5+ years of experience in Data Engineering / Big Data Engineering.
• Strong hands-on production experience with HBase.
• Strong experience with Amazon EMR, Apache Spark, and Hadoop.
• Experience with Scala and/or Spark programming.
• Hands-on experience with AWS and S3.
• Experience in HBase/EMR migration, modernization, and production cutover activities.
• Strong understanding of distributed data platforms and data validation techniques.

Responsibilities

• Migrate and modernize HBase, EMR, Hadoop, and Spark environments.
• Perform HBase snapshots, restore, ExportSnapshot, and HFile-based data migration.
• Troubleshoot cluster-level performance, availability, and compatibility issues.
• Validate data integrity using row/region counts, checksums, and reconciliation.
• Support EMR upgrades, production cutovers, rollback planning, and post-migration validation.
• Collaborate with Cloud, Backend, Architecture, DevSecOps, Security, and QA teams.

Skills

HBase

Amazon EMR

Apache Spark

Hadoop

Scala

AWS

S3

Data Migration

Big Data

Tools

HBase

Amazon EMR

Apache Spark

Hadoop

S3

Scala

Job description

We are looking for an experienced Data Engineer with strong hands‑on production experience in HBase, Amazon EMR, Apache Spark, and Hadoop to support a large-scale data platform modernization and migration program.

Migrate and modernize HBase, EMR, Hadoop, and Spark environments.

Perform HBase snapshots, restore, ExportSnapshot, and HFile-based data migration.

Troubleshoot cluster-level performance, availability, and compatibility issues.

Validate data integrity using row/region counts, checksums, and reconciliation.

Support EMR upgrades, production cutovers, rollback planning, and post-migration validation.

Collaborate with Cloud, Backend, Architecture, DevSecOps, Security, and QA teams.

• 5+ years of experience in Data Engineering / Big Data Engineering
• Strong hands‑on production experience with HBase
• Strong experience with Amazon EMR, Apache Spark, and Hadoop
• Experience with Scala and/or Spark programming
• Hands‑on experience with AWS and S3
• Experience in HBase/EMR migration, modernization, and production cutover activities
• Strong understanding of distributed data platforms and data validation techniques

Good to Have

HBase 1.x/2.x, EMR 5.x/7.x, HFiles, Apache Phoenix, Hive, Presto, Iceberg, Kerberos, KMS, and snapshot/restore strategies.