Senior GCP Data Engineer: Pipelines, BigQuery & Streaming

KANINI; Nashville (TN); On-site; USD 90,000 - 120,000; Full time

Job summary

A leading technology firm in Nashville is seeking an experienced GCP Data Engineer to design, build, and maintain scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will possess strong hands-on experience with GCP services, data modeling, and large-scale data processing. Key responsibilities include developing ETL/ELT data pipelines, optimizing data solutions, and ensuring data quality. Candidates should have 6+ years in data engineering and expertise in relevant technologies like BigQuery and Apache Spark.

Qualifications

• 6+ years of experience in Data Engineering.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Expertise in BigQuery, Cloud Storage, Pub/Sub, Dataflow, Dataproc.
• Strong programming skills in Python and/or Java.
• Experience with Apache Spark, Apache Beam.
• Solid understanding of data warehousing, data modeling, and SQL.
• Experience with Airflow / Cloud Composer.
• Familiarity with CI/CD pipelines and Infrastructure as Code (Terraform).
• Experience working in Agile/Scrum environments.

Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines on GCP.
• Build and optimize data solutions using BigQuery, Cloud Dataflow, Dataproc, and Cloud Composer.
• Develop batch and streaming data pipelines using Apache Beam, Spark, and Pub/Sub.
• Implement data ingestion from multiple sources.
• Ensure data quality, reliability, performance, and security best practices.
• Collaborate with data scientists and analysts to support analytics and reporting needs.
• Optimize query performance and cost management in BigQuery.
• Implement CI/CD pipelines and infrastructure automation.
• Monitor and troubleshoot data pipelines in production environments.
• Follow data governance and compliance standards.

Skills

Data Engineering

Google Cloud Platform (GCP)

BigQuery

Cloud Storage

Pub/Sub

Dataflow

Dataproc

Python

Java

Apache Spark

Apache Beam

SQL

Airflow / Cloud Composer

CI/CD

Terraform

Agile/Scrum

Job description

A leading technology firm in Nashville is seeking an experienced GCP Data Engineer to design, build, and maintain scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will possess strong hands-on experience with GCP services, data modeling, and large-scale data processing. Key responsibilities include developing ETL/ELT data pipelines, optimizing data solutions, and ensuring data quality. Candidates should have 6+ years in data engineering and expertise in relevant technologies like BigQuery and Apache Spark.