Senior Cloud Data Engineer - GCP, Spark & ETL

Yorkshire Global Solutions Inc.; Frisco (TX); On-site; USD 130,000 - 180,000; Full time

Job summary

Yorkshire Global Solutions Inc. in Frisco, TX is seeking an experienced Senior Data Engineer to design and optimize cloud-based data pipelines. You will work with Python, SQL, PySpark and Spark, GCP, BigQuery, Databricks, and ETL/ELT processes to handle large-scale data. Onsite role requiring 10+ years of experience.

Knowledge of Airflow/Cloud Composer, data warehousing, data modeling, and CI/CD will help drive scalable, reliable data solutions.

Qualifications

• 10+ years of experience in Data Engineering.
• Proficient in Python, SQL, PySpark, and Apache Spark.
• Hands-on experience with GCP, BigQuery, and cloud-based data platforms.
• Experience with Databricks, Delta Lake, and ETL/ELT pipelines.
• Knowledge of Apache Airflow or Cloud Composer for workflow orchestration.
• Experience with data warehousing, data modeling, and performance optimization.
• Understanding of data quality, data governance, and CI/CD pipelines.
• Experience processing large-scale datasets in batch or near-real-time environments.

Skills

Python

SQL

PySpark

Apache Spark

GCP

BigQuery

Databricks

Delta Lake

ETL/ELT pipelines

Apache Airflow

Tools

GCP

BigQuery

Databricks

Delta Lake

Apache Airflow

Cloud Composer

Job description

Yorkshire Global Solutions Inc. in Frisco, TX is seeking an experienced Senior Data Engineer to design and optimize cloud-based data pipelines. You will work with Python, SQL, PySpark and Spark, GCP, BigQuery, Databricks, and ETL/ELT processes to handle large-scale data. Onsite role requiring 10+ years of experience.

Knowledge of Airflow/Cloud Composer, data warehousing, data modeling, and CI/CD will help drive scalable, reliable data solutions.