Senior Google Cloud Data Platform Engineer

International Business Machines Corporation; San Francisco (CA); Remote; USD 120,000 - 180,000; Full time

Job summary

IBM Consulting is seeking a seasoned Data Engineer specializing in Google Cloud data platforms to design, build, and maintain scalable data pipelines. You will leverage DataProc, DataFlow, Pub/Sub, BigQuery and related open-source tools to deliver robust data solutions.

You will work across data warehouse and data lake ecosystems, implementing batch and real-time pipelines, and optimizing data layers for migration and processing. Remote-friendly role open to candidates across the United States.

Qualifications

• Proven experience designing and maintaining data pipelines on Google Cloud.
• Experience with batch and real-time data processing for data warehouses and lakes.
• Strong knowledge of open-source tools like Apache Beam, Airflow, and dbt.
• Ability to optimize data layers for migration and performance.

Responsibilities

• Design data pipelines using DataProc, DataFlow, PubSub, and BigQuery.
• Build scalable data engineering solutions with Spark/Python or Spark/Scala.
• Manage data platforms using Cloud Composer (Airflow) and Cloud Scheduler.
• Collaborate with teams to ensure data quality and accessibility.

Skills

Google Cloud

Data Pipelines

Spark/Python

Apache Airflow

dbt

BigQuery

Tools

Apache Beam

Apache Airflow

dbt

Spark

DataProc

Job description

IBM Consulting is seeking a seasoned Data Engineer specializing in Google Cloud data platforms to design, build, and maintain scalable data pipelines. You will leverage DataProc, DataFlow, Pub/Sub, BigQuery and related open-source tools to deliver robust data solutions.

You will work across data warehouse and data lake ecosystems, implementing batch and real-time pipelines, and optimizing data layers for migration and processing. Remote-friendly role open to candidates across the United States.