GCP Data Architect: Scalable Pipelines & Real-Time Analytics

Ethereum Technologies LLC; San Jose (CA); On-site; USD 100,000 - 130,000; Full time

Job summary

A technology firm in San Jose is looking for a highly skilled Data Engineer to create and maintain scalable data infrastructure. The role involves designing performant analytical datasets, developing robust data pipelines, and implementing Big Data solutions. Candidates should have expert-level skills in Python and SQL, with significant experience in Google Cloud Platform services. This is a great opportunity for those who enjoy solving complex challenges in a dynamic environment.

Qualifications

• Extensive hands-on experience in dynamic cloud environments, especially GCP.
• Experience in designing and optimizing analytical datasets for high-volume reporting.
• Proficiency in data ingestion and performance tuning within a petabyte-scale environment.

Responsibilities

• Design, implement, and optimize analytics datasets.
• Build and maintain scalable data pipelines for BI and analytics.
• Implement Big Data solutions for both batch and streaming analytics.
• Collaborate with product managers to understand data requirements.

Skills

Expert-level programming proficiency in Python

Advanced SQL for complex querying

Experience with workflow management tools

Expertise in Google Cloud Platform

Version control with Git

Tools

BigQuery

Cloud Storage

Cloud Dataflow/Beam

Apache Airflow

Job description

A technology firm in San Jose is looking for a highly skilled Data Engineer to create and maintain scalable data infrastructure. The role involves designing performant analytical datasets, developing robust data pipelines, and implementing Big Data solutions. Candidates should have expert-level skills in Python and SQL, with significant experience in Google Cloud Platform services. This is a great opportunity for those who enjoy solving complex challenges in a dynamic environment.