Big data engineer with GCP

Sgn Global Technologies

Phoenix (AZ)

On-site

USD 86,000 - 104,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Sgn Global Technologies in Phoenix, AZ is hiring a data engineer to design, build, and optimize large-scale data pipelines on Google Cloud Platform. You will model data for performance and scalability, and implement event-driven processing using Kafka or GCP Pub/Sub.

Requirements include 6–8 years of Data Engineering experience in a Big Data environment, strong Python and SQL skills, and hands-on experience with Hadoop Hive, Spark, and GCP services such as BigQuery, Airflow, DataProc, and

Qualifications

  • 6 to 8 years of Data Engineering experience in a Big Data environment.
  • Hands-on software development experience with Big Data & Analytics solutions.
  • Experience with Hadoop Hive, Spark, Python, and shell scripting; plus GCP services such as BigQuery, Airflow, DataProc, and PubSub.
  • Proficiency in SQL and database systems.
  • Experience designing and optimizing data models for performance and scalability.
  • Experience building event processing pipelines using Kafka or GCP Pub/Sub.
  • Experience with CI/CD pipelines, automated test frameworks, and source code management tools including XLR, Jenkins, and Git.
  • Good knowledge and experience with configuration management tools such as GitHub.

Responsibilities

  • Design, develop, and optimize data pipelines for large-scale data processing, transformation, and analysis using Big Data and GCP technologies.
  • Use SQL and database systems to design and optimize data models with a focus on performance and scalability.
  • Build event processing pipelines using Kafka or GCP Pub/Sub.
  • Apply knowledge of distributed (multi-tiered) systems, algorithms, and relational databases to support scalable data solutions.

Skills

Data engineering
Big Data
SQL
Shell scripting
Python
GCP
Airflow
DataProc
PubSub
Kafka
CI/CD
Git
GitHub
XLR
Jenkins

Tools

Hadoop Hive
Spark
BigQuery
Airflow
DataProc
PubSub
Kafka
CI/CD pipelines
Jenkins
Git
GitHub
XLR

Job description

Phoenix, AZ (onsite)

Join Sgn Global Technologies to build and improve large-scale Big Data and analytics solutions on GCP. This role focuses on designing reliable data pipelines, optimizing data models for performance, and supporting event-driven processing using modern cloud tooling. If you bring hands-on data engineering experience (6 to 8 years) and strong Big Data fundamentals, you will have the opportunity to deliver data platforms that scale.

What you’ll do
  • Design, develop, and optimize data pipelines for large-scale data processing, transformation, and analysis using Big Data and GCP technologies.
  • Use SQL and database systems to design and optimize data models with a focus on performance and scalability.
  • Build event processing pipelines using Kafka or GCP PubSub.
  • Apply knowledge of distributed (multi-tiered) systems, algorithms, and relational databases to support scalable data solutions.
What you bring
  • 6 to 8 years of Data Engineering experience in a Big Data environment.
  • Hands-on software development experience with Big Data & Analytics solutions.
  • Experience with Hadoop Hive, Spark, Python, and shell scripting, plus GCP services such as BigQuery, Airflow, DataProc, and PubSub.
  • Proficiency in SQL and database systems.
  • Experience designing and optimizing data models for performance and scalability.
  • Experience building event processing pipelines using Kafka or GCP PubSub.
  • Experience with CI/CD pipelines, automated test frameworks, and source code management tools including XLR, Jenkins, and Git.
  • Good knowledge and experience with configuration management tools such as GitHub.
Technologies you’ll work with

Hadoop Hive, Spark, Python, shell scripting, GCP BigQuery, Airflow, DataProc, PubSub, SQL, Kafka, CI/CD pipelines, automated test frameworks, XLR, Jenkins, Git, GitHub.

Compensation

$85,700 - $104,000 per year

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Big Data Engineer, GCP Data Pipelines
Senior Big Data Engineer, GCP Data Pipelines

Sgn Global Technologies • Phoenix (AZ)

On-site
USD 86,000 - 104,000
Gcp Data Engineer
Gcp Data Engineer

Tata Consultancy Services Limited • Phoenix (AZ)

On-site
USD 100,000 - 120,000
Medical Coverage
Dental & Vision
401K Plan
+2
GCP Data Engineer
GCP Data Engineer

NucleusTeq • Phoenix (AZ)

On-site
USD 110,000 - 165,000
Gcp Data Engineer
Gcp Data Engineer

Tata Consultancy Services Limited • Charlotte (NC)

On-site
USD 100,000 - 120,000
Discretionary Annual Incentive
Comprehensive Medical Coverage
Family & Parental Leaves
+4
GCP Big Data Engineer
GCP Big Data Engineer

Veriipro • Phoenix (AZ)

On-site
USD 120,000 - 160,000
Senior GCP Data Engineer - Scalable Pipelines & Analytics
Senior GCP Data Engineer - Scalable Pipelines & Analytics

Compunnel Inc. • Phoenix (AZ)

Hybrid
USD 120,000 - 180,000
Sr Data Engineer
Sr Data Engineer

TechDigital Group • St. Louis (MO)

On-site
USD 80,000 - 120,000
GCP Data Engineer
GCP Data Engineer

Methodhub • Dallas (TX)

Hybrid
USD 90,000 - 120,000
Senior Big Data Engineer — GCP, Spark & BI Analytics
Senior Big Data Engineer — GCP, Spark & BI Analytics

Ethereum Technologies LLC • Phoenix (AZ)

On-site
USD 83,000 - 118,000
Senior GCP Data Engineer: Big Data Pipelines & Analytics
Senior GCP Data Engineer: Big Data Pipelines & Analytics

Tata Consultancy Services Limited • Phoenix (AZ)

On-site
USD 100,000 - 120,000
Medical Coverage
Dental & Vision
401K Plan
+2