Google Cloud Platform Data Engineer

NucleusTeq; Phoenix (AZ); On-site; USD 120,000 - 160,000; Full time

Job summary

NucleusTeq in Phoenix is seeking a senior Big Data Engineer to design and implement large-scale data pipelines using Spark, PySpark, and Google Cloud Platform services.

You will work with BigQuery, DataProc, Airflow, and NoSQL databases to process vast datasets, optimize performance, and deliver BI-ready insights for enterprise workloads.

Qualifications

• Degree in Computer Science, Applied Mathematics, Engineering, or related field (or equivalent work experience).
• 6+ years of experience as a big data engineer; able to articulate use cases and outcomes.
• Knowledge of PySpark, Spark, Python, Scala, Hive, Pig, and MapReduce.
• Experience in Google Cloud Platform.
• Experience in SQL.
• Large-scale data engineering and BI delivery experience.
• Design of large-scale enterprise data platforms.
• Experience working with large data sets in a mature agile team.

Skills

Spark

Python

Google Cloud Platform

Data Frames

BigQuery

NoSQL DB

Spanner DB

Graph DB

Education

Degree in Computer Science, Engineering, or related field

Tools

Hive

Pig

MapReduce

SQL

GCS

DataProc

Composer/Airflow

BigQuery

Job description

Skills

• Spark, Python, Google Cloud Platform is must have
• Strong experience with Spark , Data Frames
• Big Query background with data processing for large volumes
• Another NO Sql DB is big plus - Spanner DB & Graph DB

• Years of experience : 5-7 years
• Google Cloud Platform Cloud : GCS, DataProc, BigQuery, Composer/Airflow
• Big Data: PySpark
• Spark, Python, Google Cloud Platform is must have
• Strong experience with Spark , Data Frames
• Big Query background with data processing for large volumes
• Another NO Sql DB is big plus - Spanner DB & Graph DB

Qualifications

• Degree in Computer Science, Applied Mathematics, Engineering, or any other technology related field (or equivalent work experience)
• 6+ years of experience working as a big data engineer (Required) must be able to articulate use cases supported and outcomes driven.
• knowledge of the following (expectation is to demonstrate these skills live during the interview): PySpark, Spark, Python, Scala, Hive, Pig, and MapReduce.
• Experience in Google Cloud Platform.
• Experience in SQL.
• Large scale data engineering and business intelligence delivery experience
• Design of large-scale enterprise level big data platforms
• Experience working with and performing analysis using large data sets
• Proven and Demonstrated experience working with or on a mature, self-organized agile team