Senior Data Engineer

KANINI Software Solutions PTE Ltd.

Nashville (TN)

On-site

USD 110,000 - 170,000

Full time

32 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Kanini Software Solutions, Inc. in Nashville, TN seeks a data engineer to design, build, and optimize scalable data pipelines on Google Cloud Platform.

You will implement Medallion Architecture (Bronze-Silver-Gold) and develop high-performance transformations using Python and PySpark, while tuning BigQuery for large-scale analytics. The role requires strong SQL skills, hands-on experience with Cloud Dataflow and Airflow (Cloud Composer), and familiarity with GCS and Git-based CI/CD.

Qualifications

  • Strong hands-on experience with Google Cloud Platform (GCP).
  • Expertise in BigQuery (partitioning, clustering, query optimization).
  • Strong programming skills in Python and PySpark.

Responsibilities

  • Design, develop, and maintain scalable batch and real-time data pipelines on GCP.
  • Implement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data processing.
  • Develop and optimize complex SQL queries for analytical workloads.

Skills

GCP
BigQuery
Python
PySpark
SQL
Airflow
Git
CI/CD

Education

Bachelor's degree in Computer Science or related field

Tools

Cloud Dataflow
Google Cloud Storage (GCS)

Job description

  • Design, develop, and maintain scalable batch and real-time data pipelines on GCP
  • Implement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data processing
  • Build high-performance data transformations using Python and PySpark
  • Develop and optimize complex SQL queries for analytical workloads
  • Work extensively with BigQuery for large-scale data processing and performance tuning
  • Develop and deploy pipelines using Cloud Dataflow
  • Orchestrate workflows using Cloud Composer (Apache Airflow)
  • Manage data storage and lifecycle using Google Cloud Storage (GCS)
  • Implement version control and CI/CD pipelines using Git-based tools
  • Ensure data security, governance, and access control using GCP IAM
  • Optimize data solutions for performance, scalability, reliability, and cost-efficiency
Requirements
Required Skills & Experience
  • Strong hands‑on experience with Google Cloud Platform (GCP)
  • Expertise in BigQuery (partitioning, clustering, query optimization)
  • Strong programming skills in Python and PySpark
  • Advanced proficiency in SQL (complex joins, window functions, performance tuning)
  • Hands‑on experience with Cloud Dataflow
  • Experience with Cloud Composer (Airflow) for orchestration
  • Experience working with Google Cloud Storage (GCS)
  • Knowledge of version control systems (Git) and CI/CD practices
Preferred Qualifications
  • Experience working with large-scale enterprise data platforms
  • Knowledge of data warehousing and data lake concepts
  • Familiarity with real-time streaming frameworks
  • Experience in data governance and data quality frameworks

Kanini Software Solutions, Inc. does not discriminate in employment matters on the basis of race, gender, religion, age, national origin, citizenship, veteran status, family status, disability status, or any other protected class. We support workplace diversity. If you have a disability, please let us know if there is anything we can do to improve the interview process for you; we’re happy to accommodate. Kanini Software Solutions, Inc., 25 Century Blvd., Ste. 602, Nashville, TN 37214.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Quantum Technologies LLC • Hartford (CT)

On-site
USD 115,000 - 155,000
Data Engineer
Data Engineer

Valiant Technologies LLC • Hartford (CT)

On-site
USD 120,000 - 180,000
Data Engineer
Data Engineer

Valiant Technologies LLC • Austin (TX)

On-site
USD 120,000 - 170,000
Data Engineer
Data Engineer

Robotic Process Automation LLC • Austin (TX)

On-site
USD 120,000 - 180,000
GCP Data Engineer
GCP Data Engineer

Quantum Technologies LLC • Tampa (FL)

On-site
USD 120,000 - 180,000
GCP Data Engineer
GCP Data Engineer

Valiant Technologies LLC • Tampa (FL)

On-site
USD 110,000 - 165,000
Data Engineer
Data Engineer

Quantum Technologies LLC • Austin (TX)

On-site
USD 120,000 - 170,000
GCP Data Engineer
GCP Data Engineer

Ethereum Technologies LLC • Tampa (FL)

On-site
USD 110,000 - 150,000
Senior Data Engineer - Real-Time Pipelines on GCP
Senior Data Engineer - Real-Time Pipelines on GCP

KANINI Software Solutions PTE Ltd. • Nashville (TN)

On-site
USD 110,000 - 170,000
GCP Data Engineer
GCP Data Engineer

TechDigital Group • Raleigh (NC)

On-site
USD 100,000 - 130,000