Senior Hadoop Spark Engineer - Big Data, ETL, Kafka

REALIGN LLC; Charlotte (NC); On-site; USD 120,000 - 180,000; Full time

Job summary

REALIGN LLC in Charlotte, NC seeks a highly experienced Hadoop Spark Developer with 10+ years of deep expertise in Big Data technologies, including PySpark, Hadoop Ecosystem, Hive, and Python. You will design, develop, optimize, and maintain large-scale data processing solutions.

Ideal candidate brings hands-on distributed data processing, strong analytical skills, and ability to collaborate with data engineers, architects, and business stakeholders. Microsoft Copilot experience is a plus.

Qualifications

• 10+ years of experience with Hadoop and Spark data processing.
• Experience with PySpark, Hive, and Python.
• Strong analytical skills and stakeholder collaboration.
• Bachelor's or Master's degree required.
• Experience with real-time streaming with Kafka is desirable.

Responsibilities

• Design, develop, and maintain scalable Big Data solutions using Hadoop and Spark.
• Build and optimize ETL/ELT pipelines using PySpark, Hive, and Python.
• Process and analyze large datasets in distributed environments.
• Develop high-performance Spark jobs and optimize workloads.
• Mentor junior developers and provide technical leadership.

Skills

PySpark

Hive

Python

SQL

Unix

Kafka

Java

Hadoop

Hadoop Ecosystem

Education

Bachelor's or Master's degree

Tools

Microsoft Copilot

Job description

REALIGN LLC in Charlotte, NC seeks a highly experienced Hadoop Spark Developer with 10+ years of deep expertise in Big Data technologies, including PySpark, Hadoop Ecosystem, Hive, and Python. You will design, develop, optimize, and maintain large-scale data processing solutions.

Ideal candidate brings hands-on distributed data processing, strong analytical skills, and ability to collaborate with data engineers, architects, and business stakeholders. Microsoft Copilot experience is a plus.