Senior PySpark Architect – Data Platform & Cloud

Avance Consulting; North Carolina; On-site; USD 100,000 - 130,000; Full time

Job summary

Avance Consulting is looking for a skilled technology consultant based in North Carolina. The role requires strong experience in the Cloudera Hadoop ecosystem, including Hive, Scala, and SPARK, as well as expertise in designing ETL/ELT frameworks for complex data warehouses.

The ideal candidate will have a background in software engineering and must be proficient in data virtualization and parallel data processing. This position offers the opportunity to solve complex problems in a dynamic environment.

Responsibilities

• Design and implement ETL/ELT frameworks for data warehouses.
• Work with large data sets; performance tuning and troubleshooting.
• Develop complex data products in heterogeneous environments.

Skills

Technology consulting

Cloudera Hadoop ecosystem

ETL/ELT framework

Data virtualization

Microservice architecture

Tools

AWS

Azure

GCP

Python

Scala

Hadoop

Job description

Avance Consulting is looking for a skilled technology consultant based in North Carolina. The role requires strong experience in the Cloudera Hadoop ecosystem, including Hive, Scala, and SPARK, as well as expertise in designing ETL/ELT frameworks for complex data warehouses.

The ideal candidate will have a background in software engineering and must be proficient in data virtualization and parallel data processing. This position offers the opportunity to solve complex problems in a dynamic environment.