Senior GCP Data Engineer — Hybrid, AI/ETL & BigQuery

Persistent; Charlotte (NC); In loco; USD 124.000 - 220.000; Tempo pieno

Vantaggi offerti da questo lavoro

Competitive compensation

Talent development programs

Cutting-edge technology projects

Employee engagement initiatives

Annual health check-ups

Insurance coverage

Descrizione del lavoro

Persistent is seeking a Senior GCP Data Engineer on a contract basis in Charlotte, NC, onsite. You will design, develop, and optimize scalable ETL/ELT pipelines using Python and GCP-native services, integrate MongoDB with BigQuery, and build AI-driven data solutions with LangGraph and Azure OpenAI frameworks.

You will collaborate with data scientists, software engineers, and business stakeholders, ensuring data quality, governance, and efficient operations while advancing our data platforms and

Competenze

• 7–12 years of data engineering, cloud data platforms, or big data experience.
• Hands-on expertise with Google Cloud Platform (GCP) including BigQuery, Dataflow, Cloud Composer, Cloud Storage.
• Mandatory experience with Starburst and/or Dremio.
• Strong Python programming and scripting skills.
• Deep SQL development and optimization skills; NoSQL (MongoDB) experience a plus.
• Experience building and optimizing ETL/ELT pipelines and enterprise data integration.
• Familiarity with Cloud Logging, Cloud Monitoring, and incident troubleshooting.

Mansioni

• Design, develop, and deploy scalable ETL/ELT pipelines on GCP.
• Build and optimize AI agents using Python, LangGraph, and related frameworks.
• Integrate MongoDB data into GCS and BigQuery; optimize data ingestion and transformations.
• Implement data virtualization and federated queries with Starburst/Dremio.
• Tune BigQuery workloads and monitor data platforms; ensure data quality and governance.
• Collaborate with data scientists, software engineers, and stakeholders; maintain docs and runbooks.
• Establish CI/CD processes for data deployments and cloud environments.

Conoscenze

GCP

BigQuery

Dataflow

Cloud Composer

Cloud Storage

Starburst

Dremio

Python

SQL

MongoDB

ETL/ELT

CI/CD

DevOps

Agile

Strumenti

LangGraph

Microsoft Agent Framework

Azure OpenAI

Descrizione del lavoro

Persistent is seeking a Senior GCP Data Engineer on a contract basis in Charlotte, NC, onsite. You will design, develop, and optimize scalable ETL/ELT pipelines using Python and GCP-native services, integrate MongoDB with BigQuery, and build AI-driven data solutions with LangGraph and Azure OpenAI frameworks.

You will collaborate with data scientists, software engineers, and business stakeholders, ensuring data quality, governance, and efficient operations while advancing our data platforms and