Senior GCP Data Engineer: BigQuery, Spark & Dataflow

Envision Technology Solutions

Minnesota City (MN)

On-site

USD 120,000 - 160,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Envision Technology Solutions is seeking a Senior Data Engineer in the United States to design and operate scalable data pipelines, focusing on batch and near-real-time workloads across customer, transaction, and marketing datasets.

You will work with architects, PMs, data scientists, and privacy teams to enforce data contracts and data quality, while optimizing BigQuery, Spark, and the GCP stack for performance and cost.

Qualifications

  • Advanced SQL and Python for ingestion, transformation, validation, reconciliation.
  • GCP services: BigQuery, Dataflow/Beam, Pub/Sub, Cloud Storage, Airflow.
  • Strong Spark and distributed data-processing, with partitioning and tuning.
  • Data modeling for customer, identity, commerce, campaign, audience, and measurement datasets.
  • Experience with data contracts, schema evolution, metadata, lineage, and data quality.
  • CI/CD with GitHub Actions and infrastructure-as-code; automated tests.
  • Pipeline observability: freshness, completeness, accuracy, latency, alerts.
  • Security: encryption, tokenization, RBAC, secrets management, retention controls.
  • Identity resolution knowledge and audience activation concepts.

Responsibilities

  • Design, build, and operate scalable batch and near-real-time pipelines.
  • Collaborate with architects, PMs, analysts, data scientists, privacy teams, and engineers.
  • Define data contracts, SLAs, and acceptance criteria.
  • Implement controls for schema, completeness, freshness, validity, and reconciliation.
  • Optimize BigQuery, Spark, and pipeline workloads for throughput and cost.
  • Develop tests and embed quality gates in CI/CD; establish runbooks and monitoring.

Skills

SQL
Python
GCP
BigQuery
Apache Spark
Data Modeling
Data Quality
CI/CD
Security
Identity Resolution

Education

Bachelor's or Master's in CS / DS / IS / Engineering

Tools

Dataflow/Beam
Pub/Sub
Cloud Storage
Airflow / Cloud Composer
GitHub Actions

Job description

Envision Technology Solutions is seeking a Senior Data Engineer in the United States to design and operate scalable data pipelines, focusing on batch and near-real-time workloads across customer, transaction, and marketing datasets.

You will work with architects, PMs, data scientists, and privacy teams to enforce data contracts and data quality, while optimizing BigQuery, Spark, and the GCP stack for performance and cost.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GCP Data Engineer: BigQuery & Dataflow Architect
Senior GCP Data Engineer: BigQuery & Dataflow Architect

TechDigital Group • Secaucus (NJ)

On-site
USD 140,000 - 190,000
Senior GCP Data Engineer: BigQuery, Dataflow & Starburst
Senior GCP Data Engineer: BigQuery, Dataflow & Starburst

Persistent Systems • Charlotte (NC)

On-site
USD 140,000 - 190,000
Hybrid work options
Company-sponsored higher education and
Certifications
+3
Remote Senior Data Engineer, GCP (BigQuery/Dataflow)
Remote Senior Data Engineer, GCP (BigQuery/Dataflow)

Techstack • United States

Remote
USD 140,000 - 190,000
Remote work options
Education courses and conferences
English language courses
+2
Senior GCP Data Engineer: BigQuery, Data Pipelines & ETL
Senior GCP Data Engineer: BigQuery, Data Pipelines & ETL

Persistent Systems Limited • Charlotte (NC)

On-site
USD 120,000 - 180,000
Hybrid work
Long Service awards
Education sponsorship
+1
Senior GCP Data Engineer — BigQuery & Dataflow
Senior GCP Data Engineer — BigQuery & Dataflow

CVS Health • Utah

Hybrid
USD 83,000 - 222,000
Senior GCP Data Engineer: Big Data & Spark Expert
Senior GCP Data Engineer: Big Data & Spark Expert

NucleusTeq • Phoenix (AZ)

On-site
USD 110,000 - 165,000
Senior Data Engineer — GCP Data Pipelines
Senior Data Engineer — GCP Data Pipelines

9025 CVS Shared Services Resources LLC • North Carolina

Hybrid
USD 83,000 - 222,000
Senior GCP Data Engineer - BigQuery & Data Pipelines
Senior GCP Data Engineer - BigQuery & Data Pipelines

Ethereum Technologies • Austin (TX)

On-site
USD 120,000 - 180,000
Senior GCP Data Engineer: BigQuery, Dataflow, ETL
Senior GCP Data Engineer: BigQuery, Dataflow, ETL

Ethereum Technologies LLC • Chicago (IL)

On-site
USD 120,000 - 180,000
Senior GCP Data Engineer - BigQuery & Airflow
Senior GCP Data Engineer - BigQuery & Airflow

Surescripts • Arlington (VA)

On-site
USD 153,000 - 187,000
Health insurance
401(k) with company match