Data Engineer

Bizquad Consultants Private Limited

India

Remote

INR 2,700,000 - 3,300,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Trantor is seeking an experienced Data Engineer in remote India to support a modernization of distributed data platforms. You will migrate HBase/EMR environments, ensure data integrity, and maintain performance and operational stability. This role requires hands-on experience with HBase, EMR, Spark, and the Hadoop ecosystem.

The position is remote in India with immediate joiners preferred. Strong focus on migration planning, data validation, cutover execution, and post-migration verification.

Qualifications

  • Minimum 7 years of total experience.
  • Minimum 6 years of relevant experience.
  • Minimum 5 years of experience in Data Engineering or Big Data Engineering.
  • Strong hands-on production experience with HBase.
  • Strong experience with Amazon EMR.
  • Strong experience with Apache Spark.
  • Strong understanding of the Hadoop ecosystem.
  • Experience with Scala and/or Spark programming.
  • Experience with S3 and AWS-based data platforms.
  • Hands-on experience with HBase/EMR migration or modernization in production environments.
  • Experience with production data migration and cutover activities.
  • Experience validating migrated data through row/region counts, reconciliation, checksums, or equivalent techniques.
  • Experience troubleshooting distributed data platforms at the cluster level.
  • Strong understanding of dependencies between HBase, Spark, Hadoop, and application workloads.
  • Experience in production support and migration-related troubleshooting.

Responsibilities

  • Design and execute migration and modernization activities across HBase, Amazon EMR, Hadoop, and Spark environments.
  • Support production migration of HBase and EMR workloads across environments.
  • Troubleshoot distributed clusters and resolve performance, availability, configuration, and compatibility issues.
  • Plan and execute HBase snapshot, restore, and migration activities.
  • Validate migrated data using row and region counts, checksums, reconciliation, application behavior, and other appropriate methods.
  • Support HBase data movement using relevant mechanisms such as Snapshot, ExportSnapshot, and HFiles.
  • Collaborate with Backend, Cloud, Architecture, DevSecOps, Security, and QA teams to resolve cross-platform dependencies.

Skills

HBase
Amazon EMR
Apache Spark
Hadoop
Scala
S3
AWS
Data migration
Data validation
Distributed systems
Troubleshooting
Production support

Tools

EMR
Hadoop
Spark
HFiles

Job description

Trantor

Remote, India

Full Time

Experience Required

5+ Years

Salary Range

30 LPA

Openings

5 Position(s)

Application Deadline

No Deadline

Job Description

We are seeking a Data Engineer with strong hands-on experience in HBase, Amazon EMR, Hadoop, and Apache Spark to support a production data platform modernization and migration program. This role focuses on migrating and modernizing distributed data platforms while maintaining application compatibility, data integrity, performance, and operational stability.Candidates must have practical production experience operating and migrating HBase/EMR environments. The engineer will contribute to migration planning, cluster-level troubleshooting, data validation, snapshot and restore activities, cutover, rollback, and post-migration verification.The position is based remotely in India. Immediate joiners or candidates serving a notice period of up to 20 days are preferred.

Responsibilities
  • Design and execute migration and modernization activities across HBase, Amazon EMR, Hadoop, and Spark environments.
  • Support production migration of HBase and EMR workloads across environments.
  • Troubleshoot distributed clusters and resolve performance, availability, configuration, and compatibility issues.
  • Plan and execute HBase snapshot, restore, and migration activities.
  • Validate migrated data using row and region counts, checksums, reconciliation, application behavior, and other appropriate methods.
  • Support HBase data movement using relevant mechanisms such as Snapshot, ExportSnapshot, and HFiles.
  • Analyze dependencies among HBase, Spark, Hadoop, applications, and supporting platform components.
  • Support Amazon EMR version upgrades and broader platform modernization initiatives.
  • Participate in production cutovers, maintenance windows, rollback planning, and post-cutover validation.
  • Troubleshoot migration issues involving data integrity, cluster configuration, application connectivity, performance, and compatibility.
  • Collaborate with Backend, Cloud, Architecture, DevSecOps, Security, and QA teams to resolve cross-platform dependencies.
  • Perform data validation and reconciliation between legacy and target environments.
  • Document migration procedures, validation results, issues, resolutions, and operational runbooks.
  • Contribute to automation and repeatable processes for migration and validation activities.
Qualifications
  • Minimum 7 years of total experience.
  • Minimum 6 years of relevant experience.
  • Minimum 5 years of experience in Data Engineering or Big Data Engineering.
  • Strong hands-on production experience with HBase.
  • Strong experience with Amazon EMR.
  • Strong experience with Apache Spark.
  • Strong understanding of the Hadoop ecosystem.
  • Experience with Scala and/or Spark programming.
  • Experience with S3 and AWS-based data platforms.
  • Hands-on experience with HBase/EMR migration or modernization in production environments.
  • Experience with production data migration and cutover activities.
  • Experience validating migrated data through row/region counts, reconciliation, checksums, or equivalent techniques.
  • Experience troubleshooting distributed data platforms at the cluster level.
  • Strong understanding of dependencies between HBase, Spark, Hadoop, and application workloads.
  • Experience in production support and migration-related troubleshooting.
Skills Required

HBase Amazon EMR Apache Spark Hadoop Scala S3 AWS Data Migration Data Validation Distributed Systems Troubleshooting Production Support

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Platform Engineer
Data Platform Engineer

Maimsd Technology Private Limited • India

Remote
INR 1,500,000 - 2,500,000
Data Engineering / Big Data Engineering.
Data Engineering / Big Data Engineering.

Techbliss Digital Solution • Chennai, Bengaluru

On-site
INR 3,000,000 - 4,600,000
Senior AWS Data Engineer
Senior AWS Data Engineer

BizQuad • India

Remote
INR 3,150,000 - 3,850,000
Backend Engineer - Java Modernization
Backend Engineer - Java Modernization

Bizquad Consultants Private Limited • India

Remote
INR 2,500,000 - 2,800,000
Data Engineer
Data Engineer

PW (PhysicsWallah) • Dadri

On-site
INR 900,000 - 1,300,000
Senior AWS EMR Engineer
Senior AWS EMR Engineer

Web Spiders Group • Kolkata

On-site
INR 1,800,000 - 3,600,000
Data Engineer - Big Data / Platform Engineer
Data Engineer - Big Data / Platform Engineer

Suzva Software Technologies • Bengaluru

On-site
INR 1,200,000 - 2,000,000
Senior Data Engineer
Senior Data Engineer

RITWIK IT SERVICES PRIVATE LIMITED • Bengaluru

Hybrid
INR 4,500,000 - 6,500,000
Data Engineer - Data Platforms
Data Engineer - Data Platforms

InOpTra Digital Inc • Bengaluru

Remote
INR 1,800,000 - 3,200,000
Big Data Engineer
Big Data Engineer

Infosys • Hyderabad, Pune District, Bengaluru

On-site
INR 1,200,000 - 2,000,000