Senior PySpark Architect: Scalable Data & Cloud Solutions

Avance Consulting; Charlotte (NC); On-site; USD 100,000 - 130,000; Full time

Job summary

Avance Consulting is looking for a technology consultant in Charlotte, NC, to engage in enterprise architecture, focusing on the Cloudera Hadoop ecosystem. Responsibilities include analyzing system requirements, developing integration strategies, and collaborating with development teams. Ideal candidates should have strong experience in technology consulting, with a robust understanding of architectural frameworks and ETL/ELT processes. Proficiency with tools such as Hadoop, Python, and Kafka is required, making this a great opportunity for those passionate about scalable and secure architectures.

Qualifications

• Strong experience in technology consulting and architectural frameworks.
• Deep knowledge of Cloudera Hadoop ecosystem including Hive, Scala, and SPARK.
• Experience with ETL/ELT frameworks and large data sets.

Responsibilities

• Gather and analyze system requirements for performance and scalability.
• Contribute to tech framework development and architectural definitions.
• Collaborate with development teams to resolve technical issues.

Skills

Technology consulting

Enterprise and solutions architecture

Cloudera Hadoop ecosystem

ETL/ELT framework design

Parallel data processing

REST APIs

Tools

Hadoop

Hive

Python

NoSQL databases

Kafka

Databricks

Job description

Avance Consulting is looking for a technology consultant in Charlotte, NC, to engage in enterprise architecture, focusing on the Cloudera Hadoop ecosystem. Responsibilities include analyzing system requirements, developing integration strategies, and collaborating with development teams. Ideal candidates should have strong experience in technology consulting, with a robust understanding of architectural frameworks and ETL/ELT processes. Proficiency with tools such as Hadoop, Python, and Kafka is required, making this a great opportunity for those passionate about scalable and secure architectures.