GCP Data Engineer

NucleusTeq; Phoenix (AZ); On-site; USD 110,000 - 165,000; Full time

Job summary

NucleusTeq in Phoenix, AZ seeks a GCP Data Engineer to design and implement large-scale data pipelines using GCS, DataProc, BigQuery, and Airflow. This role requires strong Spark and PySpark skills and experience with Data Frames to process vast datasets.

You'll work in a mature agile environment focusing on enterprise-grade big data platforms, collaborating across teams to deliver BI solutions and data products. 5–7 years of hands-on experience is expected.

Qualifications

• Degree in Computer Science, Applied Mathematics, Engineering, or related field (or equivalent work experience).
• 6+ years of experience working as a big data engineer (Required) with demonstrated use cases and outcomes.
• Knowledge of PySpark, Spark, Python, Scala, Hive, Pig, and MapReduce; prepared to demonstrate live during interview.
• Experience in GCP.
• Experience in SQL.
• Large-scale data engineering and BI delivery experience.
• Design of large-scale enterprise-level big data platforms.
• Experience working with and analyzing large data sets.
• Proven experience working in a mature, self-organized agile team.

Skills

GCP

PySpark

Spark

Python

Scala

Hive

Pig

MapReduce

BigQuery

DataProc

Airflow

GCS

Spanner

GraphDB

SQL

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Hive

Pig

MapReduce

SQL

Scala

Job description

Role – GCP Data Engineer

Location – Phoenix, AZ

Duration: 12+ Months

Skills:

• Years of experience : 5-7 years
• GCP Cloud : GCS, DataProc, BigQuery, Composer/Airflow
• Big Data: PySpark
• Spark, Python, GCP is must have
• Strong experience with Spark , Data Frames
• Big Query background with data processing for large volumes
• Another NO Sql DB is big plus - Spanner DB & Graph DB

Qualifications:

• Degree in Computer Science, Applied Mathematics, Engineering, or any other technology related field (or equivalent work experience)
• 6+ years of experience working as a big data engineer (Required) must be able to articulate use cases supported and outcomes driven.
• knowledge of the following (expectation is to demonstrate these skills live during the interview): PySpark, Spark, Python, Scala, Hive, Pig, and MapReduce.
• Experience in GCP.
• Experience in SQL.
• Large scale data engineering and business intelligence delivery experience
• Design of large-scale enterprise level big data platforms
• Experience working with and performing analysis using large data sets
• Proven and Demonstrated experience working with or on a mature, self-organized agile team