GCP Data Engineer: BigQuery, Dataflow & SQL

TechDigital Group; Nashville (TN); On-site; USD 110,000 - 160,000; Full time

Job summary

TechDigital Group is seeking an experienced GCP Data Engineer to design, develop, and maintain scalable cloud-based data solutions in Nashville. You will build and optimize data pipelines, work with BigQuery, Dataflow, and MS SQL Server, and collaborate with analysts to serve enterprise analytics.

The role emphasizes data quality, governance, and security, with hands-on development in Python and SQL and familiarity with GCS, Pub/Sub, and Composer for end-to-end data processing.

Qualifications

• 3+ years of experience in data engineering on cloud platforms.
• Strong SQL development and performance tuning.
• Experience building scalable data pipelines and data models.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using GCP Dataflow and Python.
• Develop and optimize BigQuery datasets, tables, views, partitioning, and clustering strategies.
• Create and maintain complex SQL queries, stored procedures, functions, and database objects in MS SQL Server.
• Migrate and integrate data from on-premises databases and various source systems into GCP.
• Implement data quality, validation, reconciliation, and monitoring frameworks.
• Work with Cloud Storage (GCS), BigQuery, Dataflow, and Composer/Airflow for end-to-end data processing.
• Analyze performance bottlenecks and optimize large-scale data workloads.
• Build reusable Python components for data ingestion, transformation, and automation.
• Collaborate with business stakeholders, architects, and data analysts to understand requirements.
• Ensure data security, governance, and compliance standards are followed.

Skills

MS SQL Server

Python

Google BigQuery

Google Cloud Dataflow

ETL/ELT

Data Warehousing

Data Modeling

Git

Agile/Scrum

Cloud Monitoring

Tools

Git

Google Cloud Dataflow

BigQuery

Cloud Composer

Cloud Storage

IAM

Monitoring

Pub/Sub

SQL Server

Job description

TechDigital Group is seeking an experienced GCP Data Engineer to design, develop, and maintain scalable cloud-based data solutions in Nashville. You will build and optimize data pipelines, work with BigQuery, Dataflow, and MS SQL Server, and collaborate with analysts to serve enterprise analytics.

The role emphasizes data quality, governance, and security, with hands-on development in Python and SQL and familiarity with GCS, Pub/Sub, and Composer for end-to-end data processing.