Hadoop Developer

Northern Base; Charlotte (NC); On-site; USD 110,000 - 160,000; Full time

Job summary

Northern Base in Charlotte, NC is seeking a Hadoop Developer to design and optimize large-scale data pipelines using PySpark, Spark, and the Hadoop ecosystem. This onsite role requires 10–15 years of experience and a strong background in building batch and real-time streaming applications with Kafka.

You will collaborate with Data Architects, Data Scientists, and DevOps teams to deliver high-performance Spark jobs, ensure data quality, and implement robust ETL/ELT processes across structured,

Qualifications

• Must have 10–15 years of experience with Hadoop and Big Data technologies.
• Experience designing scalable Hadoop and Spark solutions with batch and real-time streaming using Kafka.
• Experience using Microsoft Copilot for code generation, troubleshooting, documentation, and testing.

Skills

PySpark

Apache Spark

Hadoop

Hive

Python

SQL

Unix

Kafka

Java

Big Data

Distributed Data Processing

ETL/ELT

Spark Job Development

Hive Tables/Partitions/Views

Data Quality

Batch Streaming

Data Ingestion

Structured/Unstructured Data

Copilot for AI-Assisted Development

Production Troubleshooting

Code Reviews

Education

Bachelor's or Master's in Computer Science or related field

Job description

Hiring Alert | Hadoop Developer

Location: Charlotte, NC (Onsite)

Employment Type: Full-Time

Experience Required: 10 15 Years

Visa Type: USC / GC Only

Must-Have Skills

• PySpark
• Apache Spark
• Hadoop Ecosystem
• Hive
• Python
• SQL
• Unix
• Kafka
• Java
• Big Data Development
• Distributed Data Processing
• ETL / ELT Pipeline Development
• Spark Job Development & Performance Optimization
• Hive Tables, Partitions, Views & Complex Queries
• Data Quality, Validation & Reconciliation
• Batch & Real-Time Streaming Applications
• Data Ingestion Frameworks
• Structured, Semi-Structured & Unstructured Data Processing
• Microsoft Copilot for AI-Assisted Development
• Production Troubleshooting & Root Cause Analysis
• Code Reviews & Development Best Practices

Preferred Experience

• 10+ years of experience with Hadoop and Big Data technologies
• Experience designing scalable Hadoop and Spark solutions
• Strong experience building batch and real-time streaming applications using Kafka
• Experience using Microsoft Copilot for code generation, troubleshooting, documentation, and testing
• Experience developing high-performance Spark jobs and optimizing workloads
• Experience collaborating with Data Architects, Data Scientists, Business Analysts, and DevOps teams
• Experience participating in Agile ceremonies including sprint planning, estimation, and retrospectives
• Experience mentoring junior developers and providing technical leadership
• Strong analytical, problem-solving, and communication skills

Education

Bachelor's or Master's Degree in Computer Science or related field preferred.

Tech Stack

PySpark | Apache Spark | Hadoop | Hive | Python | SQL | Unix | Kafka | Java | Big Data | ETL | ELT | Data Processing | Distributed Computing | Streaming | Data Ingestion | Microsoft Copilot | Data Quality | Reconciliation | Performance Optimization | Agile | Production Support