GCP Data Engineer

Compunnel, Inc.; Phoenix, Northern (AZ, KY); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Compunnel, Inc. seeks a senior GCP Data Engineer to design and maintain scalable data pipelines, data warehouses, and data lakes on Google Cloud Platform, delivering reliable, secure cloud-native solutions.

The role collaborates with data analysts and application teams to implement ETL/ELT workflows, real-time processing, CI/CD automation, and Infrastructure as Code (IaC), ensuring high data quality and performant analytics.

Qualifications

• 8+ years of experience in Data Engineering.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Hands-on experience with BigQuery, Cloud Storage, Cloud Composer, Cloud Dataflow, Pub/Sub, Dataproc, Cloud Functions, Cloud Run.
• Proficiency in Python or Java.
• Experience with Apache Spark and Apache Beam.
• Strong understanding of ETL/ELT frameworks and data integration techniques.
• Experience with Git, CI/CD pipelines, and DevOps practices.
• Strong understanding of data modeling, data warehousing, and dimensional modeling.
• Familiarity with REST APIs and data integration.
• Experience with monitoring and logging tools.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills with the ability to work independently and within cross-functional teams.
• Strong attention to detail and commitment to data quality.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using GCP services.
• Build and manage data ingestion workflows from multiple data sources.
• Develop batch and real-time data processing pipelines.
• Implement data transformation using SQL, Python, and cloud-native tools.
• Optimize data models and storage for performance and cost.
• Develop and maintain data warehouses and data lakes.
• Monitor, troubleshoot, and optimize data pipelines for reliability and performance.
• Implement data governance, security, and compliance best practices.
• Collaborate with data analysts, data scientists, and application teams to support business requirements.
• Automate deployment processes using CI/CD pipelines and Infrastructure as Code (IaC).
• Apply data modeling, data warehousing, and dimensional modeling practices for scalable analytics.
• Support data integration through REST APIs and other technologies.

Skills

Analytical skills

Problem-solving

Communication

Collaboration

Attention to detail

Education

Bachelor's degree in Computer Science, IT or related field

Tools

Git

CI/CD

Terraform

Docker

Kubernetes

Looker/Tableau

Job description

The GCP Data Engineer will design, develop, and maintain scalable data pipelines and cloud-based data solutions on Google Cloud Platform (GCP). The role will focus on building data ingestion, transformation, batch and real-time processing, data warehousing, and data lake solutions while ensuring high standards of data quality, reliability, security, and performance. The engineer will collaborate with data analysts, data scientists, application teams, and other stakeholders to deliver cloud-native data solutions that support business requirements.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using GCP services.
• Build and manage data ingestion workflows from multiple structured and unstructured data sources.
• Develop batch and real-time data processing pipelines.
• Implement data transformation and orchestration using SQL, Python, and cloud-native tools.
• Optimize data models and storage solutions for performance and cost efficiency.
• Develop and maintain data warehouses and data lakes.
• Monitor, troubleshoot, and optimize data pipelines for reliability and performance.
• Implement data governance, security, and compliance best practices.
• Collaborate with data analysts, data scientists, and application teams to support business requirements.
• Automate deployment processes using CI/CD pipelines and Infrastructure as Code (IaC).
• Apply data modeling, data warehousing, and dimensional modeling practices to support scalable analytics solutions.
• Support data integration through REST APIs and other integration technologies.

Required Qualifications

• 8+ years of experience in Data Engineering.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Hands-on experience with BigQuery, Cloud Storage, Cloud Composer (Apache Airflow), Cloud Dataflow, Pub/Sub, Dataproc, Cloud Functions, and Cloud Run.
• Proficiency in Python or Java.
• Experience with Apache Spark and Apache Beam.
• Strong understanding of ETL/ELT frameworks and data integration techniques.
• Experience with Git, CI/CD pipelines, and DevOps practices.
• Strong understanding of data modeling, data warehousing, and dimensional modeling.
• Familiarity with REST APIs and data integration.
• Experience with monitoring and logging tools.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills with the ability to work independently and within cross-functional teams.
• Strong attention to detail and commitment to data quality.

Preferred Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Experience with Terraform or other Infrastructure as Code tools.
• Experience working in Agile/Scrum environments.
• Experience with Linux, Docker, and Kubernetes.
• Experience with Looker or Tableau.