Remote GCP Data Engineer

Insight Global; Woonsocket (RI); Remote; USD 110,000 - 155,000; Full time

Job summary

Insight Global is seeking a GCP Data Engineer to support a major healthcare client in a roster migration project on Google Cloud Platform. You will design, build, and maintain cloud-native data pipelines, implement PySpark ETL, and develop Python applications and APIs using Django, Flask, or FastAPI.

The role emphasizes BigQuery, Dataproc, Dataflow, Airflow/Composer, CI/CD, and DevOps practices, with Kubernetes/GKE and infrastructure automation.

Qualifications

• 6+ years of experience as a Data Engineer or Software Engineer.
• Strong Python development experience with Django/Flask/FastAPI.
• Cloud-native data pipelines in GCP (BigQuery/Dataproc/Dataflow/Composer).
• Strong PySpark and SQL skills for ETL/data workflows.
• Experience building and supporting APIs and microservices.
• Experience CI/CD pipelines and Kubernetes/GKE environments.

Responsibilities

• Design, develop, and maintain cloud-native data pipelines in GCP.
• Move, process, and transform data within the GCP environment.
• Develop ETL processes using PySpark, BigQuery, Dataproc, Dataflow, and Airflow.
• Create and manage BigQuery tables and data workflows.
• Develop REST APIs and microservices using Django/Flask/FastAPI.

Skills

Python development

PySpark

SQL

API/microservices

CI/CD

Kubernetes/GKE

Django/Flask/FastAPI

Tools

BigQuery

Dataproc

Dataflow

Cloud Composer/Airflow

Airflow

Kubernetes (GKE)

Job description

Job Description

Insight Global is seeking a GCP Data Engineer to support a large healthcare client. This individual will join the Network and Providers team, supporting a critical roster migration initiative involving the movement and transformation of data within Google Cloud Platform (GCP).

This role requires a hands-on engineer with strong experience across Python development, GCP data engineering, PySpark, ETL, APIs, and DevOps, along with exposure to modern AI/LLM technologies. The engineer will work with large datasets in BigQuery, develop and orchestrate ETL pipelines, build cloud-native Python applications and APIs, and support CI/CD and infrastructure automation.

Day-to-Day Responsibilities

Design, develop, and maintain cloud-native data pipelines in GCPMove, process, and transform data within the GCP environmentDevelop ETL processes using PySpark, BigQuery, Dataproc, Dataflow, and Cloud Composer/AirflowCreate and manage BigQuery tables and data workflowsBuild Python applications and services using Django, Flask, and/or FastAPIDevelop and maintain REST APIs and microservicesSupport solutions leveraging AI/LLMs, RAG, LangChain, and OpenAI integrationsDeploy and support workloads using Cloud Run, GKE, and KubernetesDevelop and support Cloud FunctionsWrite efficient SQL and PySpark for large-scale data processingSupport CI/CD pipelines and DevOps best practicesAssist with infrastructure automation using TerraformPartner with engineering and business teams to support the roster migration and broader provider/network data initiatives

Skills and Requirements

-6+ years of experience as a Data Engineer or Software Engineer-Strong Python development experience->Experience with Python frameworks such as Django, Flask, and/or FastAPI-Strong experience designing and developing cloud-native data pipelines in GCP-Hands-on experience with BigQuery, Dataproc, Cloud Composer/Airflow, and Dataflow-Strong PySpark and SQL skills-Experience building and supporting ETL/data engineering pipelines-Experience developing APIs and microservices-Experience supporting CI/CD pipelines->Experience with Kubernetes/GKE and containerized environments

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [e-mail].