Senior GCP Data Engineer

Persistent; Charlotte (NC); On-site; USD 124,000 - 220,000; Full time

Benefits offered by this job

Competitive compensation

Talent development programs

Cutting-edge technology projects

Employee engagement initiatives

Annual health check-ups

Insurance coverage

Job summary

Persistent is seeking a Senior GCP Data Engineer on a contract basis in Charlotte, NC, onsite. You will design, develop, and optimize scalable ETL/ELT pipelines using Python and GCP-native services, integrate MongoDB with BigQuery, and build AI-driven data solutions with LangGraph and Azure OpenAI frameworks.

You will collaborate with data scientists, software engineers, and business stakeholders, ensuring data quality, governance, and efficient operations while advancing our data platforms and

Qualifications

• 7–12 years of data engineering, cloud data platforms, or big data experience.
• Hands-on expertise with Google Cloud Platform (GCP) including BigQuery, Dataflow, Cloud Composer, Cloud Storage.
• Mandatory experience with Starburst and/or Dremio.
• Strong Python programming and scripting skills.
• Deep SQL development and optimization skills; NoSQL (MongoDB) experience a plus.
• Experience building and optimizing ETL/ELT pipelines and enterprise data integration.
• Familiarity with Cloud Logging, Cloud Monitoring, and incident troubleshooting.

Responsibilities

• Design, develop, and deploy scalable ETL/ELT pipelines on GCP.
• Build and optimize AI agents using Python, LangGraph, and related frameworks.
• Integrate MongoDB data into GCS and BigQuery; optimize data ingestion and transformations.
• Implement data virtualization and federated queries with Starburst/Dremio.
• Tune BigQuery workloads and monitor data platforms; ensure data quality and governance.
• Collaborate with data scientists, software engineers, and stakeholders; maintain docs and runbooks.
• Establish CI/CD processes for data deployments and cloud environments.

Skills

GCP

BigQuery

Dataflow

Cloud Composer

Cloud Storage

Starburst

Dremio

Python

SQL

MongoDB

ETL/ELT

CI/CD

DevOps

Agile

Tools

LangGraph

Microsoft Agent Framework

Azure OpenAI

Job description

Persistent is seeking a Senior GCP Data Engineer (Contract) to build and optimize scalable data and query solutions in Charlotte, NC (onsite).

Responsibilities

• Design, develop, and deploy AI agents using Python, LangGraph, Microsoft Agent Framework, and Azure OpenAI.
• Build and optimize Survey Programming Agents for:
  • Questionnaire parsing
  • Routing logic
  • JSON generation
  • Dimensions setup
  • STG generation
  • Translation workflows
  • DMS script creation
  • Link testing
  • Survey quality control
  • Change impact analysis
• Design, develop, and deploy scalable ETL/ELT pipelines using Python and GCP-native services.
• Build and maintain enterprise-grade data integration solutions across multiple data sources and platforms.
• Integrate MongoDB data into Google Cloud Storage and BigQuery.
• Design and optimize data ingestion, transformation, and analytical processing workflows.
• Develop and support data virtualization and federated query solutions using Starburst and/or Dremio.
• Optimize BigQuery workloads using partitioning, clustering, query tuning, and performance engineering.
• Monitor and troubleshoot production data pipelines and resolve data quality issues.
• Perform debugging, root cause analysis, and issue resolution for data processing failures.
• Optimize Dataflow jobs and MongoDB indexing strategies to improve performance and reduce operational costs.
• Implement monitoring, alerting, and operational support processes for data platforms.
• Collaborate with Data Scientists, Software Engineers, Architects, and business stakeholders to deliver reliable data solutions.
• Develop and maintain technical documentation, operational runbooks, and deployment procedures.
• Implement CI/CD processes for data engineering solutions and cloud deployments.
• Ensure adherence to data governance, security, compliance, and operational best practices.

Requirements

• 7-12 years of experience in Data Engineering, Cloud Data Platforms, or Big Data environments.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Expertise in BigQuery, Cloud Dataflow, Cloud Composer (Apache Airflow), and Cloud Storage.
• Mandatory hands-on experience with Starburst and/or Dremio.
• Strong experience implementing ETL/ELT pipelines and enterprise data integration solutions.
• Advanced Python programming and scripting expertise.
• Strong SQL development skills and query optimization experience.
• Experience working with MongoDB and NoSQL database technologies.
• Solid understanding of data warehousing, dimensional modeling, and analytical data platforms.
• Hands‑on experience monitoring and supporting production‑grade data environments.
• Experience with Cloud Logging and Cloud Monitoring, including incident troubleshooting.
• Knowledge of CI/CD implementation and DevOps practices for data engineering deployments.
• Strong analytical, troubleshooting, and problem‑solving skills.
• Experience working in Agile and cross‑functional teams.
• Excellent communication and stakeholder management abilities.

Technologies

• Google Cloud Platform (GCP)
• BigQuery
• Dataflow
• Cloud Composer (Apache Airflow)
• Cloud Storage
• Starburst
• Dremio
• Python
• LangGraph
• Microsoft Agent Framework
• Azure OpenAI
• MongoDB
• SQL
• Cloud Logging
• Cloud Monitoring

Benefits

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting‑edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check‑ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment

• Hybrid work and flexible hours to fit diverse lifestyles
• Accessibility-friendly office with ergonomic setups and assistive technologies to support employees with physical disabilities
• If you are a person with disabilities and have specific requirements, inform us during the application process or at any time during employment