Cloud Data Engineer: Hadoop to Spark on AWS | Hybrid

ETEAM Inc.

Maryland Heights (MO)

Hybrid

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

ETEAM Inc. is seeking a Hadoop Data Engineer to design and optimize large-scale data pipelines.

The role focuses on Spark/Scala/Python development, Java, and Kafka, with a strong emphasis on AWS S3 and Iceberg-based lakehouse architectures. You will work in a hybrid environment in Maryland Heights, collaborating with architects, analysts, and platform engineers to translate business needs into scalable data solutions.

Qualifications

  • Must have hands-on experience with Spark (Scala/Python) and core Java.
  • Strong SQL skills including CDC concepts across Oracle/SQL Server is expected.
  • Proficiency with Unix shell scripting and Python for automation.

Responsibilities

  • Design, build, and optimize scalable data pipelines (batch and real-time) using Spark, Java, and Kafka.
  • Maintain data lakehouse architectures on AWS and Cloudera, utilizing S3, Iceberg, and Hive.
  • Migrate on-prem Hadoop workloads to cloud-native architectures and ensure governance/compliance.

Skills

Scala/Python (Spark)
Core Java
Unix scripting
Python
SQL

Education

Bachelor's degree in CS/Engineering or related field

Tools

Apache Spark
Apache Kafka
Hadoop
AWS S3
Iceberg
Hive

Job description

ETEAM Inc. is seeking a Hadoop Data Engineer to design and optimize large-scale data pipelines.

The role focuses on Spark/Scala/Python development, Java, and Kafka, with a strong emphasis on AWS S3 and Iceberg-based lakehouse architectures. You will work in a hybrid environment in Maryland Heights, collaborating with architects, analysts, and platform engineers to translate business needs into scalable data solutions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer: Databricks & Spark Expert (Hybrid)
Azure Data Engineer: Databricks & Spark Expert (Hybrid)

Signature IT World • New Jersey

Hybrid
USD 110,000 - 150,000
AWS Data Engineer: Scalable ETL & Analytics
AWS Data Engineer: Scalable ETL & Analytics

Smart IT Frame LLC • Reston (VA)

On-site
USD 110,000 - 180,000
Big Data Engineer: Spark, ETL & Data Quality
Big Data Engineer: Spark, ETL & Data Quality

eNcloud Services LLC • Katy (TX)

On-site
USD 100,000 - 170,000
Hadoop & AWS Data Engineer — Spark, Hive, Airflow
Hadoop & AWS Data Engineer — Spark, Hive, Airflow

Next Level Business Services, Inc. • Beaverton (OR)

On-site
USD 90,000 - 120,000
Senior Data Engineer (Hybrid) – ETL, Spark & Cloud
Senior Data Engineer (Hybrid) – ETL, Spark & Cloud

Edgesource Corp. • McLean (VA)

On-site
USD 130,000 - 145,000
Flex Time Off
Hybrid Workplace
401K Program
+4
Cloud Data Engineer: Spark & Hive Data Pipelines
Cloud Data Engineer: Spark & Hive Data Pipelines

Tata Consultancy Services Limited • Irving (TX)

On-site
USD 90,000 - 110,000
Cloud Data Engineer: AWS, Databricks & PySpark Pipelines
Cloud Data Engineer: AWS, Databricks & PySpark Pipelines

Advanced Tech Placement • Atlanta (GA)

On-site
USD 120,000 - 150,000
AWS Data Engineer - Scalable ETL & Data Pipelines
AWS Data Engineer - Scalable ETL & Data Pipelines

TMV Global Inc • Virginia (MN)

On-site
USD 95,000 - 120,000
Cloud Data Engineer — Spark, Delta Lake & Fabric Pro
Cloud Data Engineer — Spark, Delta Lake & Fabric Pro

Govx • Washington

Remote
USD 120,000 - 140,000
Paid Time Off
Health, Dental, and Vision Insurance
401(k) plan with discretionary match
+2
Senior Big Data Engineer — Spark, Hadoop on AWS (Hybrid)
Senior Big Data Engineer — Spark, Hadoop on AWS (Hybrid)

Rishi Writes • Rockville (MD)

Hybrid
USD 120,000 - 170,000