Senior GCP Data Engineer - BigQuery & Airflow Pipelines

IVID TEK INC; Phoenix (AZ); On-site; USD 120,000 - 160,000; Full time

Job summary

IVID TEK INC in Phoenix, AZ is seeking an experienced GCP Data Engineer to design, build, and optimize enterprise-grade data platforms on Google Cloud. You will create robust batch and real-time pipelines, manage data warehouses, and enable analytics across large-scale environments.

The role emphasizes hands-on Python, PySpark, BigQuery, Dataflow, Airflow, and CI/CD practices, with collaboration across BI and ML teams to drive data-driven decisions.

Qualifications

• 6-9 years of experience in data engineering on GCP.
• Proficient in Python, SQL, and PySpark.
• Experience with BigQuery, Dataflow, Cloud Composer, Pub/Sub, and GCS.
• Strong CI/CD practices using Git and Jenkins.
• Experience supporting BI dashboards (Tableau/Looker).
• Familiarity with AI/ML data prep and modelling concepts.

Responsibilities

• Cloud Pipeline Architecture: Design, develop, and maintain automated batch and streaming data pipelines using GCP services including BigQuery, Dataflow (Apache Beam), Cloud Composer (Apache Airflow), Pub/Sub, and Cloud Storage (GCS).
• Data Warehousing & Optimization: Build and optimize large-scale data models in BigQuery utilizing partitioning, clustering, and materialized views to maximize query performance and control compute costs.
• Programming & Automation: Write production-grade Python and PySpark scripts for complex ETL/ELT transformations, data manipulation, and pipeline orchestration.
• CI/CD & DevOps Integration: Implement and support Git-based version control, continuous integration, and continuous delivery (CI/CD) pipelines using tools like Jenkins for code deployment, testing, and automated monitoring.
• BI & Reporting Support: Collaborate with business intelligence and analytics teams by preparing clean, structured datasets and assisting with data integration for reporting tools such as Tableau or Looker.
• AI/ML Alignment: Partner with cross-functional teams to support and integrate data models designed for downstream AI/ML solutions and predictive analytics.

Skills

Python

SQL

PySpark

BigQuery

Dataflow

Airflow

Looker

Tableau

CI/CD

Git

Tools

Git

Jenkins

Airflow

Job description

IVID TEK INC in Phoenix, AZ is seeking an experienced GCP Data Engineer to design, build, and optimize enterprise-grade data platforms on Google Cloud. You will create robust batch and real-time pipelines, manage data warehouses, and enable analytics across large-scale environments.

The role emphasizes hands-on Python, PySpark, BigQuery, Dataflow, Airflow, and CI/CD practices, with collaboration across BI and ML teams to drive data-driven decisions.