GCP Data Engineer: Build Scalable Data Pipelines

Programmers.io; California (MO); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading data engineering company in California is seeking a skilled Data Engineer to design and optimize analytical datasets and maintain robust data pipelines in cloud environments. The ideal candidate will have extensive experience with Google Cloud Platform, particularly BigQuery, strong skills in Python and SQL, and a background in data pipeline orchestration. This role promises opportunities to work collaboratively with product managers and DevOps teams to deliver impactful data solutions.

Qualifications

• Expert-level skills in data ingestion and performance optimization within a petabyte-scale environment.
• Proficiency in Python using data engineering libraries.
• Solid command of advanced SQL for complex querying and data processing.

Responsibilities

• Design, implement, and optimize analytical datasets for reporting and business analysis.
• Architect and maintain scalable data pipelines for business intelligence.
• Implement Big Data solutions for both batch and streaming analytics.

Skills

Cloud Platform Expertise (GCP Focus)

Python

SQL

Data Pipeline Orchestration

DevOps/CI/CD

Monitoring & Automation

Tools

BigQuery

Apache Airflow

Git

Docker

Kubernetes

Job description

A leading data engineering company in California is seeking a skilled Data Engineer to design and optimize analytical datasets and maintain robust data pipelines in cloud environments. The ideal candidate will have extensive experience with Google Cloud Platform, particularly BigQuery, strong skills in Python and SQL, and a background in data pipeline orchestration. This role promises opportunities to work collaboratively with product managers and DevOps teams to deliver impactful data solutions.