GCP Data Engineer: Scalable Pipelines, BigQuery Dataflow

Quantum Technologies. LLC; Tampa (FL); On-site; USD 120,000 - 180,000; Full time

Job summary

Quantum Technologies LLC in Tampa, FL seeks an experienced GCP Data Engineer to design and maintain scalable cloud-based data pipelines and data processing solutions on Google Cloud Platform. You will work with large datasets to develop ETL/ELT workflows and optimize data warehouses for analytics.

You will implement batch and streaming pipelines using BigQuery, Dataflow, Apache Beam, and Airflow, manage data quality, governance, and security, and collaborate with BI and ML teams to enable

Qualifications

• Experience with Google Cloud Platform (GCP) data services.

Responsibilities

• Design and implement scalable batch and streaming data pipelines on GCP.

Skills

Python programming

Advanced SQL

SQL optimization

Data modeling

Dimensional modeling

Data warehouse architecture

ETL/ELT development

Data quality validation

IAM/security best practices

Git / CI/CD

Infrastructure automation

Tools

BigQuery

Cloud Dataflow

Apache Beam

Cloud Composer

Pub/Sub

Cloud Storage

Dataproc

Spark

Git

CI/CD

Infrastructure automation tools

Job description

Quantum Technologies LLC in Tampa, FL seeks an experienced GCP Data Engineer to design and maintain scalable cloud-based data pipelines and data processing solutions on Google Cloud Platform. You will work with large datasets to develop ETL/ELT workflows and optimize data warehouses for analytics.

You will implement batch and streaming pipelines using BigQuery, Dataflow, Apache Beam, and Airflow, manage data quality, governance, and security, and collaborate with BI and ML teams to enable