Big Data Developer - Spark, Hive & ETL Expert

eNcloud; Katy (TX); Hybrid; USD 95,000 - 140,000; Full time

Job summary

eNcloud Services LLC in Katy, TX seeks Big Data Developer to build data transformation and ingestion pipelines using Spark, Hive, HDFS, and related tools. You will implement ETL processes, write complex SQL, and ensure data quality across large datasets in analytics workloads.

The role requires a Bachelor’s degree and 5+ years of experience, with travel to client locations possible. Strong scripting and CI/CD experience are a plus.

Qualifications

• Bachelor’s degree in Computer Science, IT, Engg or related field.
• At least 60 months of experience in Big Data / data engineering environments.
• Travel and relocation to client locations may be required.

Responsibilities

• Build data transformation, metadata, and workload management processes.
• Ingest and curate data using Spark, Hive, HDFS, Sqoop, and related tools.
• Develop high-performance ETL code with strong SQL and data quality checks.
• Write shell scripts; run complex SQL queries and Hadoop commands.
• Monitor production jobs and support CI/CD and version control.

Skills

Spark

Hive

HDFS

Sqoop

HBase

Kerberos

Sentry

Impala

ETL

SQL

Python

Scala

Education

Bachelor's degree in Computer Science / IT / Engg

Tools

Bitbucket

CI/CD

Job description

eNcloud Services LLC in Katy, TX seeks Big Data Developer to build data transformation and ingestion pipelines using Spark, Hive, HDFS, and related tools. You will implement ETL processes, write complex SQL, and ensure data quality across large datasets in analytics workloads.

The role requires a Bachelor’s degree and 5+ years of experience, with travel to client locations possible. Strong scripting and CI/CD experience are a plus.