GCP Data Architect

Ethereum Technologies LLC; San Jose, Northern (CA, KY); Hybrid; USD 120,000 - 170,000; Full time

Job summary

ETHEREUM TECHNOLOGIES LLC is seeking a Data Engineer to design, build, and maintain scalable data infrastructure that powers BI, analytics, and ML initiatives.

Ideal candidates will have deep GCP experience (BigQuery, Cloud Storage, Dataflow/Beam, Pub/Sub), strong Python and SQL skills, and hands-on workflow orchestration with Airflow, Cloud Composer, or Dagster. Collaboration with product teams is essential, in a dynamic cloud environment.

Qualifications

• Experience building scalable data infrastructures for BI, analytics, and ML workflows.
• Strong expertise in GCP services, BigQuery ingestion, performance optimization, and data modeling.
• Proficiency in Python programming and advanced SQL for complex data processing.

Responsibilities

• Design and optimize analytical datasets for high-volume reporting and model development.
• Architect, build, and maintain scalable data pipelines for BI and analytics.
• Implement and support batch and real-time data processing and streaming solutions.
• Collaborate with product and business teams to translate data needs into technical solutions.

Skills

Python

SQL

Data engineering

Airflow

Dagster

GCP

BigQuery

Data modeling

Data pipelines

CI/CD

Git

GitHub Actions

Cloud Composer

Pub/Sub

Beam

Cloud Dataflow

Tools

BigQuery

Cloud Storage

Cloud Dataflow/Beam

Pub/Sub

Git

GitHub Actions

Airflow

Dagster

Cloud Composer

Job description

We are looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining scalable data infrastructure that drives business intelligence, advanced analytics, and machine learning initiatives. You must be comfortable working autonomously, navigating complex challenges, and driving projects to successful completion in a dynamic cloud environment.

Core Responsibilities

• Design and Optimization: Design, implement, and optimize clean, well-structured, and performant analytical datasets to support high-volume reporting, business analysis, and data science model development.
• Pipeline Development: Architect, build, and maintain scalable and robust data pipelines for diverse applications, including business intelligence, advanced analytics
• Big Data & Streaming: Implement and support Big Data solutions for both batch (scheduled) and real-time/streaming analytics.
• Collaboration: Work closely with product managers and business teams to understand data requirements and translate them into technical solutions.

Required Skills & Experience

Cloud Platform Expertise (GCP Focus): Extensive hands-on experience working in dynamic cloud environments, with a strong preference for Google Cloud Platform (GCP) services, specifically:

• BigQuery: Expert-level skills in data ingestion, performance optimization, and data modeling within a petabyte-scale environment.
• Experience with other relevant GCP services like Cloud Storage, Cloud Dataflow/Beam, or Pub/Sub

Programming & Querying:

• Python: Expert-level programming proficiency in Python, including experience with relevant data engineering libraries
• SQL: A solid command of advanced SQL for complex querying, data processing, and performance tuning.

Data Pipeline Orchestration: Prior experience using workflow management and orchestration tools (e.g., Apache Airflow, Cloud Composer, Airflow,Dagster, or similar).

DevOps/CI/CD: Experience with version control (Git) and familiarity with CI/CD practices and tools (e.g., GitLab, GitHub Actions) to automate deployment and testing processes.

ETHEREUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ETHEREUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ETHEREUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract