GCP Data Engineer: Scalable Pipelines, IAM & Airflow

TechDigital Group; Seattle (WA); On-site; USD 130,000 - 160,000; Full time

Job summary

A leading tech company located in Seattle is seeking a GCP Data Engineer to develop and manage large-scale cloud data processing systems. Responsibilities include designing scalable data solutions on GCP, ensuring data access transparency, and collaborating with technical teams. The ideal candidate will have over 5 years of experience using technologies like Python, Java, and GCP, as well as skills in data management, cloud technologies, and strong problem-solving abilities.

Qualifications

• 5+ years of experience in an engineering role using Python, Java, Spark, and SQL.
• 5+ years of experience working as a Data Engineer in GCP.
• Demonstrated proficiency with Google's Identity and Access Management (IAM) API.

Responsibilities

• Design, develop, and implement scalable, high-performance data solutions on GCP.
• Ensure changes to data access permissions are reflected in the Tableau dashboard within 24 hours.
• Collaborate with technical and business users to manage data sets across multiple projects.

Skills

Python

Java

Spark

SQL

Airflow

Linux/Unix

Scala

GitHub

Jenkins

Terraform

Education

Bachelor's degree in Computer Engineering or a related field

Tools

GCP

HDFS

Impala

Hive

Kafka

Pub/Sub

Dataflow

Job description

A leading tech company located in Seattle is seeking a GCP Data Engineer to develop and manage large-scale cloud data processing systems. Responsibilities include designing scalable data solutions on GCP, ensuring data access transparency, and collaborating with technical teams. The ideal candidate will have over 5 years of experience using technologies like Python, Java, and GCP, as well as skills in data management, cloud technologies, and strong problem-solving abilities.