Senior GCP Data Engineer: BigQuery, Dataflow, ETL

Ethereum Technologies; Chicago (IL); Presencial; USD 120 000 - 180 000; Tempo integral

Resumo da oferta

Ethereum Technologies is seeking Data Engineers with strong hands-on Google Cloud Platform (GCP) expertise to design and optimize large-scale data pipelines. The role focuses on migrating data environments from Azure to GCP and delivering production-grade ETL/ELT processes in a modern data platform.

Ideal candidates will have 6+ years in data engineering, proficiency in Python/SQL, and experience with BigQuery, Dataflow, and Airflow/Cloud Composer.

Qualificações

• 6+ years of experience in data engineering and data pipeline development.
• Strong hands-on GCP data engineering experience is mandatory.
• Experience with BigQuery, Dataflow, Cloud Storage, and relevant GCP data services.
• Strong expertise in Python, SQL, ETL/ELT development, and data transformations.
• Experience building scalable batch and/or streaming data pipelines.
• Experience with PySpark/Spark and data processing frameworks.
• Strong understanding of data warehousing, data modeling, data quality, and performance optimization.
• Experience with data pipeline orchestration and scheduling tools such as Airflow/Cloud Composer.

Conhecimentos

GCP data engineering

BigQuery

Dataflow

PySpark

Python

SQL

ETL/ELT development

Data pipelines

Airflow

Cloud Composer

Data warehousing

Data modeling

Data quality

Ferramentas

Airflow

Cloud Composer

Terraform

CI/CD

Pub/Sub

Descrição da oferta de emprego

Ethereum Technologies is seeking Data Engineers with strong hands-on Google Cloud Platform (GCP) expertise to design and optimize large-scale data pipelines. The role focuses on migrating data environments from Azure to GCP and delivering production-grade ETL/ELT processes in a modern data platform.

Ideal candidates will have 6+ years in data engineering, proficiency in Python/SQL, and experience with BigQuery, Dataflow, and Airflow/Cloud Composer.