Hadoop Developer

Dexian; Charlotte (NC); Hybrid; USD 120,000 - 150,000; Full time

Job summary

Dexian is seeking a software engineer with 3–5 years of distributed data experience for a Charlotte, NC role. The position requires deep Cloudera Hadoop expertise, Python automation, and strong knowledge of Docker, Kubernetes, and cloud storage. You will work across Hadoop components, PySpark, and Jupyter environments to deliver scalable data solutions.

The candidate should also be familiar with security practices and enterprise compliance while collaborating in a hybrid onsite/remote setting.

Qualifications

• 3–5 years of experience in software engineering, distributed computing, data engineering, or a related field.
• Deep expertise in Cloudera Hadoop and its ecosystem, including HDFS, YARN, Spark, Impala.
• Strong Python development skills for automation, application development, and system integration.
• Knowledge of FastMCP and Gunicorn.
• Proficiency with Python libraries, including spaCy, NumPy, Pandas, and Polars.
• Strong knowledge of Docker, containers, and Kubernetes for deployment and orchestration.
• Intermediate to advanced Linux/Unix knowledge, including Bash and shell scripting.
• Demonstrable troubleshooting and problem-solving skills, including analyzing error messages and identifying root causes.
• Experience with distributed computing principles and Big Data technologies.
• Knowledge of Hive, HBase, Scala, and PySpark.
• Experience with Iceberg and object storage technologies such as Amazon S3 and Ozone.
• Experience working with Jupyter environments and integrating machine learning libraries.
• Understanding of enterprise security practices and compliance requirements.

Skills

Python

Cloudera Hadoop

HDFS

YARN

Spark

Impala

spaCy

NumPy

Pandas

Polars

Docker

Kubernetes

Linux Bash

PySpark

Hive

HBase

Iceberg

S3

Ozone

Jupyter

Job description

Job Location: Charlotte, NC (3 days onsite & 2 days remote)

Required Skills & Qualifications

• 3–5 years of experience in software engineering, distributed computing, data engineering, or a related field.
• Deep expertise in Cloudera Hadoop and its ecosystem, including:
• HDFS
• YARN
• Spark
• Impala
• Strong Python development skills for automation, application development, and system integration.
• Knowledge of FastMCP and Gunicorn.
• Proficiency with Python libraries, including spaCy, NumPy, Pandas, and Polars.
• Strong knowledge of Docker, containers, and Kubernetes for deployment and orchestration.
• Intermediate to advanced Linux/Unix knowledge, including Bash and shell scripting.
• Demonstrable troubleshooting and problem-solving skills, including analyzing error messages and identifying root causes.
• Experience with distributed computing principles and Big Data technologies.
• Knowledge of Hive, HBase, Scala, and PySpark.
• Experience with Iceberg and object storage technologies such as Amazon S3 and Ozone.
• Experience working with Jupyter environments and integrating machine learning libraries.
• Understanding of enterprise security practices and compliance requirements.

More about Dexian

Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.

Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.

Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

Dexian | Unlock trajectory changing opportunities.