Senior GCP Data Engineer: BigQuery, Data Pipelines & ETL

Persistent Systems Limited; Charlotte (NC); Presencial; USD 120.000 - 180.000; A tiempo parcial

Ventajas ofrecidas por este puesto de trabajo

Hybrid work

Long Service awards

Education sponsorship

Insurance: life, personal accident, M9

Descripción de la vacante

Persistent Systems Limited in Charlotte, NC is seeking an experienced Senior GCP Data Engineer to design, build, and optimize scalable data pipelines across enterprise platforms. You will work with Python-based tooling, data virtualization, and federated queries to enable reliable analytics.

The role requires 7–12 years in data engineering with strong GCP hands-on expertise and experience with Starburst and/or Dremio.

Formación

• 7-12 years of experience in Data Engineering, Cloud Data Platforms, or Big Data environments.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Experience with BigQuery, Dataflow, Cloud Composer, and Cloud Storage.
• Mandatory hands-on experience with Starburst and/or Dremio.
• Solid understanding of data warehousing, dimensional modeling, and analytics platforms.

Responsabilidades

• Design, develop, and deploy AI agents using Python, LangGraph, Microsoft Agent Framework, and Azure OpenAI.
• Build and optimize Survey Programming Agents covering Questionnaire Parsing, Routing Logic, JSON Generation, Dimensions Setup, STG Generation, Translation Workflows, DMS Script Creation, Link Testing, Survey Quality Control, and Change Impact Analysis.
• Design, develop, and deploy scalable ETL/ELT data pipelines using Python and GCP-native services.
• Build and maintain enterprise-grade data integration solutions across multiple data sources and platforms.
• Integrate MongoDB data into Google Cloud Storage and BigQuery environments.
• Design and optimize data ingestion, transformation, and analytical processing workflows.
• Develop and support data virtualization and federated query solutions using Starburst and/or Dremio.
• Optimize BigQuery workloads through partitioning, clustering, query tuning, and performance engineering.
• Monitor and troubleshoot production data pipelines and resolve data quality issues.
• Perform debugging, root cause analysis, and issue resolution for data processing failures.
• Optimize Dataflow jobs and MongoDB indexing strategies to improve performance and reduce operational costs.
• Implement monitoring, alerting, and operational support processes for data platforms.
• Collaborate with Data Scientists, Software Engineers, Architects, and business stakeholders to deliver reliable data solutions.
• Develop and maintain technical documentation, operational runbooks, and deployment procedures.
• Implement CI/CD processes for data engineering solutions and cloud deployments.
• Ensure adherence to data governance, security, compliance, and operational best practices.

Conocimientos

GCP Data Engineering

Python

SQL

Data warehousing

Data governance

Educación

Bachelor's degree in a related field

Herramientas

BigQuery

Dataflow

Cloud Composer

Cloud Storage

MongoDB

Starburst

Dremio

Descripción del empleo

Persistent Systems Limited in Charlotte, NC is seeking an experienced Senior GCP Data Engineer to design, build, and optimize scalable data pipelines across enterprise platforms. You will work with Python-based tooling, data virtualization, and federated queries to enable reliable analytics.

The role requires 7–12 years in data engineering with strong GCP hands-on expertise and experience with Starburst and/or Dremio.