Senior Big Data Engineer - PySpark, Spark, Hive

Realign Llc; Charlotte (NC); On-site; USD 120,000 - 180,000; Full time

Job summary

Realign Llc is seeking a highly experienced Hadoop Spark Developer to design, develop, and maintain large-scale data processing solutions. The role emphasizes PySpark, Hive, Python, and SQL, with strong distributed-data experience.

You will work closely with data architects, engineers, and business stakeholders to optimize workloads, ensure data quality, and deliver scalable analytics capabilities across batch and streaming pipelines.

Qualifications

• 10+ years of experience with Big Data technologies and distributed processing.
• Bachelor's or Master's degree in a relevant field is required or preferred.
• Proven ability to design, develop, and optimize large-scale data solutions.

Responsibilities

• Design, develop, and optimize large-scale data processing solutions using Hadoop and Spark.
• Build and optimize ETL/ELT pipelines with PySpark, Hive, and Python.
• Develop high-performance Spark jobs and manage data ingestion frameworks.
• Collaborate with architects, data scientists, and DevOps teams.

Skills

PySpark

Hive

Python

SQL

Unix

Kafka

Java

Education

Bachelor's degree

Master's degree

Tools

Hadoop

Spark

Kafka

Hive

Job description

Realign Llc is seeking a highly experienced Hadoop Spark Developer to design, develop, and maintain large-scale data processing solutions. The role emphasizes PySpark, Hive, Python, and SQL, with strong distributed-data experience.

You will work closely with data architects, engineers, and business stakeholders to optimize workloads, ensure data quality, and deliver scalable analytics capabilities across batch and streaming pipelines.