Senior GCP Data Engineer: Big Data & Spark Expert

NucleusTeq; Phoenix (AZ); On-site; USD 110,000 - 165,000; Full time

Job summary

NucleusTeq in Phoenix, AZ seeks a GCP Data Engineer to design and implement large-scale data pipelines using GCS, DataProc, BigQuery, and Airflow. This role requires strong Spark and PySpark skills and experience with Data Frames to process vast datasets.

You'll work in a mature agile environment focusing on enterprise-grade big data platforms, collaborating across teams to deliver BI solutions and data products. 5–7 years of hands-on experience is expected.

Qualifications

• Degree in Computer Science, Applied Mathematics, Engineering, or related field (or equivalent work experience).
• 6+ years of experience working as a big data engineer (Required) with demonstrated use cases and outcomes.
• Knowledge of PySpark, Spark, Python, Scala, Hive, Pig, and MapReduce; prepared to demonstrate live during interview.
• Experience in GCP.
• Experience in SQL.
• Large-scale data engineering and BI delivery experience.
• Design of large-scale enterprise-level big data platforms.
• Experience working with and analyzing large data sets.
• Proven experience working in a mature, self-organized agile team.

Skills

GCP

PySpark

Spark

Python

Scala

Hive

Pig

MapReduce

BigQuery

DataProc

Airflow

GCS

Spanner

GraphDB

SQL

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Hive

Pig

MapReduce

SQL

Scala

Job description

NucleusTeq in Phoenix, AZ seeks a GCP Data Engineer to design and implement large-scale data pipelines using GCS, DataProc, BigQuery, and Airflow. This role requires strong Spark and PySpark skills and experience with Data Frames to process vast datasets.

You'll work in a mature agile environment focusing on enterprise-grade big data platforms, collaborating across teams to deliver BI solutions and data products. 5–7 years of hands-on experience is expected.