Senior Big Data Infra Lead: HDFS, Iceberg & S3 (Remote)

Emerging Travel Group; United States; Remote; USD 140,000 - 210,000; Full time

Benefits offered by this job

Flexible schedule

Remote work option

Travel discounts for hotels

Job summary

Emerging Travel Group is seeking a Big Data Infrastructure Engineer to own and advance our international data stack. You will deploy, upgrade and operate core services such as HDFS, S3-compatible storage, and Iceberg, guiding the platform's evolution and performance.

You will lead infrastructure pilots, set quotas, migrate catalogs to Lakekeeper or Gravitino, and rebuild monitoring and alerting. Collaboration with a parallel stack engineer is essential.

Qualifications

• 5+ years of experience designing, deploying and operating big data platforms.
• Hands-on experience with HDFS / Hadoop: deployment, version upgrades, troubleshooting.
• Hands-on experience deploying and operating S3-compatible object storage. Apache Ozone is ideal, but MinIO or similar solutions also count.
• Experience with Apache Iceberg.
• Experience setting up monitoring and alerting for data infrastructure.
• English B2.
• Ability to work in the GMT+3 time zone (up to 3 hours difference).

Responsibilities

• Own the big data infrastructure of our international contour and be its technical lead.
• Deploy, upgrade and operate core services: HDFS, S3-compatible storage, Iceberg.
• Run an infrastructure pilot and scale datasets into thousands of tables.
• Introduce quotas for compute and storage across business units.
• Migrate Iceberg catalog to Lakekeeper or Gravitino.
• Rebuild monitoring and alerting to improve alert quality.
• Collaborate with a parallel-stack engineer and share approaches.

Skills

Big data architecture

Data platform design

Monitoring & alerting

HDFS/Hadoop

S3-compatible storage

English communication

Cross-team collaboration

Tools

Apache Iceberg

Apache Ozone

MinIO

Trino

Kafka

Flink

Iceberg REST catalogs

Job description

Emerging Travel Group is seeking a Big Data Infrastructure Engineer to own and advance our international data stack. You will deploy, upgrade and operate core services such as HDFS, S3-compatible storage, and Iceberg, guiding the platform's evolution and performance.

You will lead infrastructure pilots, set quotas, migrate catalogs to Lakekeeper or Gravitino, and rebuild monitoring and alerting. Collaboration with a parallel stack engineer is essential.