Remote GCP Data Engineer: AI-Driven Data Pipelines

Insight Global; Woonsocket (RI); Remote; USD 110,000 - 155,000; Full time

Job summary

Insight Global is seeking a GCP Data Engineer to support a major healthcare client in a roster migration project on Google Cloud Platform. You will design, build, and maintain cloud-native data pipelines, implement PySpark ETL, and develop Python applications and APIs using Django, Flask, or FastAPI.

The role emphasizes BigQuery, Dataproc, Dataflow, Airflow/Composer, CI/CD, and DevOps practices, with Kubernetes/GKE and infrastructure automation.

Qualifications

• 6+ years of experience as a Data Engineer or Software Engineer.
• Strong Python development experience with Django/Flask/FastAPI.
• Cloud-native data pipelines in GCP (BigQuery/Dataproc/Dataflow/Composer).
• Strong PySpark and SQL skills for ETL/data workflows.
• Experience building and supporting APIs and microservices.
• Experience CI/CD pipelines and Kubernetes/GKE environments.

Responsibilities

• Design, develop, and maintain cloud-native data pipelines in GCP.
• Move, process, and transform data within the GCP environment.
• Develop ETL processes using PySpark, BigQuery, Dataproc, Dataflow, and Airflow.
• Create and manage BigQuery tables and data workflows.
• Develop REST APIs and microservices using Django/Flask/FastAPI.

Skills

Python development

PySpark

SQL

API/microservices

CI/CD

Kubernetes/GKE

Django/Flask/FastAPI

Tools

BigQuery

Dataproc

Dataflow

Cloud Composer/Airflow

Airflow

Kubernetes (GKE)

Job description

Insight Global is seeking a GCP Data Engineer to support a major healthcare client in a roster migration project on Google Cloud Platform. You will design, build, and maintain cloud-native data pipelines, implement PySpark ETL, and develop Python applications and APIs using Django, Flask, or FastAPI.

The role emphasizes BigQuery, Dataproc, Dataflow, Airflow/Composer, CI/CD, and DevOps practices, with Kubernetes/GKE and infrastructure automation.