Senior Hadoop & Big Data Architect

Envision Technology Solutions; Charlotte (NC); On-site; USD 140,000 - 180,000; Full time

Job summary

Envision Technology Solutions seeks a senior data engineering/architect to define end-to-end architecture for data platforms and streaming systems. You will lead data pipelines using Hadoop, PySpark, and Kafka, while aligning with security and enterprise standards.

You will mentor engineers, collaborate with product owners and DevOps, and drive agile practices. Strong Python and distributed processing skills are required to thrive in a fast-paced environment.

Qualifications

• Minimum 10 years of hands-on data engineering and architecture experience.
• Deep expertise in Hadoop ecosystem with Spark, Hive, and HDFS.
• Proficiency in PySpark and Python for distributed processing and ETL.

Responsibilities

• Define end-to-end architecture for data platforms, streaming systems, and web applications.
• Lead data engineering initiatives and mentor junior developers and engineers.
• Collaborate with product owners, analysts, and DevOps; participate in agile ceremonies.
• Evaluate emerging technologies and recommend adoption strategies.

Skills

Hadoop ecosystem

PySpark

Python

Apache Kafka

Tools

HDFS

Hive

Spark

Apache Kafka

Job description

Envision Technology Solutions seeks a senior data engineering/architect to define end-to-end architecture for data platforms and streaming systems. You will lead data pipelines using Hadoop, PySpark, and Kafka, while aligning with security and enterprise standards.

You will mentor engineers, collaborate with product owners and DevOps, and drive agile practices. Strong Python and distributed processing skills are required to thrive in a fast-paced environment.