Senior Data Engineer - Real-Time Pipelines on GCP

KANINI Software Solutions PTE Ltd.

Nashville (TN)

On-site

USD 110,000 - 170,000

Full time

32 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Kanini Software Solutions, Inc. in Nashville, TN seeks a data engineer to design, build, and optimize scalable data pipelines on Google Cloud Platform.

You will implement Medallion Architecture (Bronze-Silver-Gold) and develop high-performance transformations using Python and PySpark, while tuning BigQuery for large-scale analytics. The role requires strong SQL skills, hands-on experience with Cloud Dataflow and Airflow (Cloud Composer), and familiarity with GCS and Git-based CI/CD.

Qualifications

  • Strong hands-on experience with Google Cloud Platform (GCP).
  • Expertise in BigQuery (partitioning, clustering, query optimization).
  • Strong programming skills in Python and PySpark.

Responsibilities

  • Design, develop, and maintain scalable batch and real-time data pipelines on GCP.
  • Implement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data processing.
  • Develop and optimize complex SQL queries for analytical workloads.

Skills

GCP
BigQuery
Python
PySpark
SQL
Airflow
Git
CI/CD

Education

Bachelor's degree in Computer Science or related field

Tools

Cloud Dataflow
Google Cloud Storage (GCS)

Job description

Kanini Software Solutions, Inc. in Nashville, TN seeks a data engineer to design, build, and optimize scalable data pipelines on Google Cloud Platform.

You will implement Medallion Architecture (Bronze-Silver-Gold) and develop high-performance transformations using Python and PySpark, while tuning BigQuery for large-scale analytics. The role requires strong SQL skills, hands-on experience with Cloud Dataflow and Airflow (Cloud Composer), and familiarity with GCS and Git-based CI/CD.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

KANINI Software Solutions PTE Ltd. • Nashville (TN)

On-site
USD 110,000 - 170,000
Senior Big Data Engineer, GCP Data Pipelines
Senior Big Data Engineer, GCP Data Pipelines

Sgn Global Technologies • Phoenix (AZ)

On-site
USD 86,000 - 104,000
Senior Data Engineer, GCP Cloud Data Pipelines
Senior Data Engineer, GCP Cloud Data Pipelines

InventYOU AB • Kentucky

On-site
USD 120,000 - 180,000
Senior Data Engineer: Real-Time Pipelines & Cloud Analytics
Senior Data Engineer: Real-Time Pipelines & Cloud Analytics

Cloudndata • United States

Hybrid
USD 140,000 - 180,000
Senior GCP Data Engineer – AI-Driven Pipelines
Senior GCP Data Engineer – AI-Driven Pipelines

Quantum Technologies. LLC • Hartford (CT)

On-site
USD 115,000 - 155,000
Senior Data Engineer - Real-Time Pipelines on AWS
Senior Data Engineer - Real-Time Pipelines on AWS

Strategic Staffing Solutions, Inc. • McLean (VA)

On-site
USD 103,000 - 117,000
Senior GCP Data Engineer: AI-Driven Real-Time Pipelines
Senior GCP Data Engineer: AI-Driven Real-Time Pipelines

Ethereum Technologies • Hartford (CT)

On-site
USD 120,000 - 180,000
Data Engineer - Real-Time Streaming (GCP/PySpark)
Data Engineer - Real-Time Streaming (GCP/PySpark)

CloudBigD • Charlotte (NC)

On-site
USD 91,000 - 124,000
Senior Data Engineer: Build Scalable ETL Pipelines on GCP
Senior Data Engineer: Build Scalable ETL Pipelines on GCP

Tata Consultancy Services Limited • Sunnyvale (CA)

On-site
USD 110,000 - 150,000
Discretionary Annual Incentive
Comprehensive Medical Coverage: Health
Dental & Vision
+6
Senior GCP Data Engineer: Pipelines, BigQuery & Streaming
Senior GCP Data Engineer: Pipelines, BigQuery & Streaming

Kanini • Nashville (TN)

On-site
USD 90,000 - 120,000