Senior Big Data Engineer, GCP Data Pipelines

Sgn Global Technologies

Phoenix (AZ)

On-site

USD 86,000 - 104,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Sgn Global Technologies in Phoenix, AZ is hiring a data engineer to design, build, and optimize large-scale data pipelines on Google Cloud Platform. You will model data for performance and scalability, and implement event-driven processing using Kafka or GCP Pub/Sub.

Requirements include 6–8 years of Data Engineering experience in a Big Data environment, strong Python and SQL skills, and hands-on experience with Hadoop Hive, Spark, and GCP services such as BigQuery, Airflow, DataProc, and

Qualifications

  • 6 to 8 years of Data Engineering experience in a Big Data environment.
  • Hands-on software development experience with Big Data & Analytics solutions.
  • Experience with Hadoop Hive, Spark, Python, and shell scripting; plus GCP services such as BigQuery, Airflow, DataProc, and PubSub.
  • Proficiency in SQL and database systems.
  • Experience designing and optimizing data models for performance and scalability.
  • Experience building event processing pipelines using Kafka or GCP Pub/Sub.
  • Experience with CI/CD pipelines, automated test frameworks, and source code management tools including XLR, Jenkins, and Git.
  • Good knowledge and experience with configuration management tools such as GitHub.

Responsibilities

  • Design, develop, and optimize data pipelines for large-scale data processing, transformation, and analysis using Big Data and GCP technologies.
  • Use SQL and database systems to design and optimize data models with a focus on performance and scalability.
  • Build event processing pipelines using Kafka or GCP Pub/Sub.
  • Apply knowledge of distributed (multi-tiered) systems, algorithms, and relational databases to support scalable data solutions.

Skills

Data engineering
Big Data
SQL
Shell scripting
Python
GCP
Airflow
DataProc
PubSub
Kafka
CI/CD
Git
GitHub
XLR
Jenkins

Tools

Hadoop Hive
Spark
BigQuery
Airflow
DataProc
PubSub
Kafka
CI/CD pipelines
Jenkins
Git
GitHub
XLR

Job description

Sgn Global Technologies in Phoenix, AZ is hiring a data engineer to design, build, and optimize large-scale data pipelines on Google Cloud Platform. You will model data for performance and scalability, and implement event-driven processing using Kafka or GCP Pub/Sub.

Requirements include 6–8 years of Data Engineering experience in a Big Data environment, strong Python and SQL skills, and hands-on experience with Hadoop Hive, Spark, and GCP services such as BigQuery, Airflow, DataProc, and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GCP Data Engineer: Big Data Pipelines & Analytics
Senior GCP Data Engineer: Big Data Pipelines & Analytics

Tata Consultancy Services Limited • Phoenix (AZ)

On-site
USD 100,000 - 120,000
Medical Coverage
Dental & Vision
401K Plan
+2
Big data engineer with GCP
Big data engineer with GCP

Sgn Global Technologies • Phoenix (AZ)

On-site
USD 86,000 - 104,000
Senior GCP Data Engineer: Pipelines, BigQuery & Streaming
Senior GCP Data Engineer: Pipelines, BigQuery & Streaming

Kanini • Nashville (TN)

On-site
USD 90,000 - 120,000
Senior GCP Data Engineer: Big Data & Spark Expert
Senior GCP Data Engineer: Big Data & Spark Expert

NucleusTeq • Phoenix (AZ)

On-site
USD 110,000 - 165,000
Senior Data Engineer, GCP Data Pipelines & ETL
Senior Data Engineer, GCP Data Pipelines & ETL

CVS Health • Raleigh (NC)

On-site
USD 83,000 - 222,000
Senior GCP Data Engineer: BigQuery, Dataflow & ETL
Senior GCP Data Engineer: BigQuery, Dataflow & ETL

CloudBigD • Chicago (IL)

On-site
USD 140,000 - 180,000
Senior GCP Data Engineer | Data Pipelines & BigQuery Expert
Senior GCP Data Engineer | Data Pipelines & BigQuery Expert

Rivago Infotech Inc • New York (NY)

On-site
USD 120,000 - 160,000
Senior GCP Data Engineer - Data Pipelines & Analytics
Senior GCP Data Engineer - Data Pipelines & Analytics

Cedent Consulting Inc. • Alpharetta (GA)

On-site
USD 100,000 - 130,000
Senior Data Engineer - GCP Data Pipelines & ETL
Senior Data Engineer - GCP Data Pipelines & ETL

CVS Health • Oklahoma

Hybrid
USD 83,000 - 222,000
Health insurance
Dental coverage
Retirement savings plan
Senior GCP Data Engineer - BigQuery & Data Pipelines
Senior GCP Data Engineer - BigQuery & Data Pipelines

Ethereum Technologies • Austin (TX)

On-site
USD 120,000 - 180,000