GCP DevOps Engineer

KANINI; Nashville (TN); On-site; USD 90,000 - 120,000; Full time

Job summary

A leading technology firm in Nashville is seeking an experienced GCP Data Engineer to design, build, and maintain scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will possess strong hands-on experience with GCP services, data modeling, and large-scale data processing. Key responsibilities include developing ETL/ELT data pipelines, optimizing data solutions, and ensuring data quality. Candidates should have 6+ years in data engineering and expertise in relevant technologies like BigQuery and Apache Spark.

Qualifications

• 6+ years of experience in Data Engineering.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Expertise in BigQuery, Cloud Storage, Pub/Sub, Dataflow, Dataproc.
• Strong programming skills in Python and/or Java.
• Experience with Apache Spark, Apache Beam.
• Solid understanding of data warehousing, data modeling, and SQL.
• Experience with Airflow / Cloud Composer.
• Familiarity with CI/CD pipelines and Infrastructure as Code (Terraform).
• Experience working in Agile/Scrum environments.

Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines on GCP.
• Build and optimize data solutions using BigQuery, Cloud Dataflow, Dataproc, and Cloud Composer.
• Develop batch and streaming data pipelines using Apache Beam, Spark, and Pub/Sub.
• Implement data ingestion from multiple sources.
• Ensure data quality, reliability, performance, and security best practices.
• Collaborate with data scientists and analysts to support analytics and reporting needs.
• Optimize query performance and cost management in BigQuery.
• Implement CI/CD pipelines and infrastructure automation.
• Monitor and troubleshoot data pipelines in production environments.
• Follow data governance and compliance standards.

Skills

Data Engineering

Google Cloud Platform (GCP)

BigQuery

Cloud Storage

Pub/Sub

Dataflow

Dataproc

Python

Java

Apache Spark

Apache Beam

SQL

Airflow / Cloud Composer

CI/CD

Terraform

Agile/Scrum

Job description

We are seeking an experienced GCP Data Engineer to join our data engineering team onsite in Denver, CO. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on Google Cloud Platform (GCP). This role requires strong hands-on experience with GCP native services, data modeling, and large-scale data processing.

Key Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines on GCP
• Build and optimize data solutions using BigQuery, Cloud Dataflow, Dataproc, and Cloud Composer
• Develop batch and streaming data pipelines using Apache Beam, Spark, and Pub/Sub
• Implement data ingestion from multiple sources (APIs, databases, flat files, streaming systems)
• Ensure data quality, reliability, performance, and security best practices
• Collaborate with data scientists, analysts, and application teams to support analytics and reporting needs
• Optimize query performance and cost management in BigQuery
• Implement CI/CD pipelines and infrastructure automation using Terraform or Deployment Manager
• Monitor and troubleshoot data pipelines in production environments
• Follow data governance, compliance, and security standards

Required Skills & Qualifications

• 6+ years of experience in Data Engineering
• Strong hands-on experience with Google Cloud Platform (GCP)
• Expertise in BigQuery, Cloud Storage, Pub/Sub, Dataflow, Dataproc
• Strong programming skills in Python and/or Java
• Experience with Apache Spark, Apache Beam
• Solid understanding of data warehousing, data modeling, and SQL
• Experience with Airflow / Cloud Composer
• Familiarity with CI/CD pipelines and Infrastructure as Code (Terraform)
• Experience working in Agile/Scrum environments

Nice to Have

• GCP Professional Data Engineer Certification
• Experience with real-time/streaming data pipelines
• Knowledge of machine learning data pipelines on GCP
• Experience with Looker or other BI tools