GCP Data Engineer

Dreamwork

Downey (CA)

On-site

USD 120,000 - 180,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Dreamwork is seeking a data engineering professional to design and optimize data architectures on Google Cloud Platform, focusing on BigQuery, data modeling, and secure access controls. You will build and maintain data pipelines using dbt and Apache Airflow, integrating diverse data sources and ensuring data quality.

The role emphasizes collaboration with data analysts and software engineers, thorough documentation, and a strong emphasis on scalable, compliant data solutions within a modern

Qualifications

  • Experience designing data solutions on GCP
  • Strong SQL with complex query optimization
  • Experience in data ingestion/ETL/ELT
  • Problem solving and analytical abilities
  • Ability to work independently and in a team
  • GCP certifications are highly desirable

Responsibilities

  • Evaluate data ingestion, transformation, and visualization methods to optimize workflows.
  • Create data models and schemas for efficient querying and secure access controls.
  • Assist in refining data architectures using GCP services like BigQuery, Dataflow, Cloud Storage, Cloud SQL, Cloud Functions.
  • Build and maintain robust data pipelines using dbt, Airflow, or similar tools.
  • Implement data quality checks and testing frameworks to ensure accuracy and integrity.
  • Integrate data from on-prem and cloud sources into BigQuery; develop data integration workflows.
  • Collaborate with analysts and engineers to translate data requirements into actionable insights.
  • Document technical decisions and communicate complex data concepts clearly.

Skills

BigQuery & GCP
SQL proficiency
Python
dbt
Apache Airflow
Data modeling
Data visualization
Stakeholder collaboration
Cloud security/compliance

Tools

dbt
Apache Airflow
Prefect
BigQuery

Job description

Key Responsibilities:
Solution Architecture:
  • Evaluate data ingestion methods, data transformation pipelines, and data visualization techniques to optimize data analysis workflows.
  • Create data models and schema designs that facilitate efficient querying and data retrieval.Ensure data security and compliance with relevant regulations by implementing appropriate access controls and encryption strategies.
  • Assist in the review and enhancements of the data architectures leveraging GCP services like BigQuery, Dataflow, Cloud Storage, Cloud SQL, and Cloud Functions to meet complex data processing needs.
Data Pipelines & Orchestration:
  • dbt (ata Build Tool): Proficiency in writing dbt models (sources, models, tests, snapshots), managing dbt projects, and utilizing dbt's features (version control, documentation, testing).
  • Data Pipelines: Building and maintaining robust data pipelines using tools like Apache Airflow, Prefect, or similar.
  • ETL/ELT Processes: Understanding and implementing data extraction, transformation, and loading processes.
Data Quality & Testing:
  • Data Validation: Implementing data quality checks and validations within dbt models (e.g., data type checks, uniqueness constraints, null checks).
  • Testing Frameworks: Utilizing dbt's testing framework or other testing tools to ensure data accuracy and integrity.
Cloud Integration:
  • Integrate data from diverse sources (on-premise, cloud-based applications, APIs) into BigQuery using data ingestion tools and techniques.
  • Develop data integration workflows to ensure data consistency and quality across different systems.
  • Leverage other GCP services like Cloud Dataflow for real-time data processing and stream analytics.
Collaboration and Communication:
  • Work closely with data analysts, business stakeholders, and software engineers to understand data requirements and translate them into actionable insights.
  • Document technical design decisions and provide clear explanations of complex data concepts.
  • Proactively identify potential issues and propose solutions to ensure data quality and system reliability.
Technical Expertise:
  • Deep understanding of data warehousing principles, data modeling, and dimensional design.
  • Expertise in SQL and proficiency in other programming languages like Python for data manipulation, automation, and interacting with APIs.
  • Familiarity with data visualization tools to present insights effectively.
  • Knowledge of cloud computing concepts and best practices on Google Cloud Platform.
Required Skills and Qualifications:
  • Proven experience in designing and implementing data solutions using Google BigQuery and other GCP services.
  • Strong SQL skills with expertise in complex query optimization.
  • Experience with data ingestion and transformation techniques.
  • Excellent problem-solving and analytical abilities.
  • Ability to work independently and as part of a team.
  • Google Cloud Platform certifications (e.g., Certified Professional Data Engineer, Certified Professional Cloud Architect) are highly desirable.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GCP Data Engineer
GCP Data Engineer

TechDigital Group • Secaucus (NJ)

On-site
USD 140,000 - 190,000
GCP Data Engineer
GCP Data Engineer

Compunnel Inc. • Phoenix (AZ)

On-site
USD 120,000 - 180,000
GCP Data Engineer
GCP Data Engineer

TechDigital Group • Raleigh (NC)

On-site
USD 100,000 - 130,000
GCP Architect
GCP Architect

TechDigital Group • Secaucus (NJ)

On-site
USD 90,000 - 140,000
GCP Data Engineer
GCP Data Engineer

Compunnel Inc. • Lisle (IL)

On-site
USD 90,000 - 120,000
GCP Engineer
GCP Engineer

MAPSYS Inc. • Columbus (OH)

Hybrid
USD 85,000 - 115,000
Data Engineer
Data Engineer

Lingaro • Mountain View (CA)

On-site
MXN 600,000 - 900,000
GCP Data Engineer
GCP Data Engineer

Rivago Infotech Inc • New York (NY)

On-site
USD 120,000 - 160,000
GCP Big Data Engineer
GCP Big Data Engineer

Veriipro • Phoenix (AZ)

On-site
USD 120,000 - 160,000
GCP Data Engineer: Real-Time Pipelines & Kubernetes Lead
GCP Data Engineer: Real-Time Pipelines & Kubernetes Lead

TechDigital Group • Raleigh (NC)

On-site
USD 100,000 - 130,000