Data Engineer - GCP

Relanto; Fremont (CA); On-site; USD 90,000 - 120,000; Full time

Job summary

Relanto is seeking a Data Engineer based in Fremont, California, to design and maintain scalable data pipelines using Python and PySpark. The candidate should have 2–4 years of experience in Data Engineering, strong skills in SQL, and familiarity with GCP services like BigQuery.

This role involves developing ETL workflows with Apache Airflow and ensuring data quality and integrity. Ideal candidates will possess hands-on experience with data transformation tools such as dbt. Join us to optimize cloud resource usage on GCP.

Qualifications

• 2–4 years of experience in Data Engineering or related roles.
• Strong hands-on experience with Python and SQL.
• Experience with PySpark and distributed data processing.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and PySpark.
• Build and optimize ETL/ELT workflows using Apache Airflow.
• Develop data transformation models and workflows using dbt.

Skills

Python

SQL

PySpark

BigQuery

Apache Airflow

dbt

Cloud Storage

Dataproc

Composer

Pub/Sub

Git

CI/CD

Job description

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and PySpark
• Build and optimize ETL/ELT workflows using Apache Airflow
• Develop data transformation models and workflows using dbt
• Work with BigQuery for data warehousing, querying, and optimization
• Write efficient and optimized SQL queries for large-scale data processing
• Ensure data quality, integrity, and reliability across pipelines
• Collaborate with Data Analysts, Data Scientists, and business stakeholders for data requirements
• Monitor and troubleshoot production data workflows and resolve issues proactively
• Implement best practices for logging, monitoring, testing, and CI/CD
• Optimize cloud resource usage and cost efficiency on GCP
• Participate in code reviews and engineering best practices

Required Skills

• Must have 2–4 years of experience in Data Engineering or related roles
• Strong hands‑on experience with Python and SQL
• Experience with PySpark and distributed data processing
• Good knowledge of BigQuery and GCP services
• Experience with Apache Airflow for orchestration
• Hands‑on experience with dbt for data transformation and modeling
• Understanding of ETL/ELT frameworks and data warehousing concept
• Familiarity with GCP services such as:
  • BigQuery
  • Cloud Storage
  • Dataproc
  • Composer
  • Pub/Sub
• Experience with Git and CI/CD practices
• Strong analytical and problem‑solving skills