GCP Data Engineer - Azure-to-GCP Migration Specialist

Valiant Technologies LLC; Austin (TX); On-site; USD 120,000 - 170,000; Full time

Job summary

Valiant Technologies LLC in Austin, TX seeks Data Engineers with hands-on GCP data engineering expertise to design and optimize large-scale data pipelines and support the Azure-to-GCP migration.

Applicants should have 6+ years in data engineering, strong Python/SQL skills, experience with BigQuery, Dataflow, Spark, and Airflow/Cloud Composer for orchestration.

Excellent communication and collaboration skills are essential as you will work closely with analytics and product teams.

Qualifications

• 6+ years of experience in data engineering and data pipeline development.
• Solid hands-on GCP data engineering experience.
• Experience with BigQuery, Dataflow, Cloud Storage and related GCP services.
• Strong Python and SQL skills for ETL/ELT development and data transformations.
• Experience building scalable batch and streaming data pipelines.
• Experience with PySpark/Spark and data processing frameworks.
• Understanding of data warehousing, data modeling, data quality, and performance optimization.
• Experience with Airflow/Cloud Composer for orchestration.

Skills

GCP

BigQuery

Dataflow

Cloud Storage

Python

SQL

ETL/ELT

PySpark

Airflow

Data warehousing

Tools

Terraform

CI/CD

Pub/Sub

Cloud Composer

Job description

Valiant Technologies LLC in Austin, TX seeks Data Engineers with hands-on GCP data engineering expertise to design and optimize large-scale data pipelines and support the Azure-to-GCP migration.

Applicants should have 6+ years in data engineering, strong Python/SQL skills, experience with BigQuery, Dataflow, Spark, and Airflow/Cloud Composer for orchestration.

Excellent communication and collaboration skills are essential as you will work closely with analytics and product teams.