Data Engineer - GCP, PySpark, Airflow & Kafka

Tata Consultancy Services Limited

Sunnyvale (CA)

On-site

USD 100,000 - 120,000

Full time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Discretionary Annual Incentive
Comprehensive Medical Coverage
Family Leave
401K Plan
Certification & Training Reimbursement
Vacation & Holidays

Job summary

Tata Consultancy Services in Sunnyvale, CA is seeking a Data Engineer to design, build, govern, and optimize data platforms and pipelines to support analytics, reporting, AI/ML, and business operations.

You will develop scalable ETL/ELT processes using GCP, PySpark, Python, Airflow, Hive, and Kafka, automate ingestion, ensure reliability, and participate in incidents and improvements.

Qualifications

  • Must have hands-on experience with scalable ETL/ELT pipelines on GCP.
  • Proficient in PySpark and Python for data processing.
  • Experience building and maintaining Airflow workflows.
  • Knowledge of Hive for batch processing and Kafka-based ingestion.
  • Understanding of data quality, governance, and monitoring.

Responsibilities

  • Design, build, govern, and optimize data platforms, pipelines, and integrations for analytics, reporting, AI/ML, and business operations.

Tools

Google Cloud Platform (GCP)
PySpark
Python
Airflow
Hive
Kafka

Job description

Tata Consultancy Services in Sunnyvale, CA is seeking a Data Engineer to design, build, govern, and optimize data platforms and pipelines to support analytics, reporting, AI/ML, and business operations.

You will develop scalable ETL/ELT processes using GCP, PySpark, Python, Airflow, Hive, and Kafka, automate ingestion, ensure reliability, and participate in incidents and improvements.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer: PySpark, Airflow & GCP
Senior Data Engineer: PySpark, Airflow & GCP

Tata Consultancy Services Limited • Sunnyvale (CA)

On-site
USD 110,000 - 150,000
Discretionary Annual Incentive
Comprehensive Medical Coverage
Family Support: Parental Leaves
+4
Data Engineer - Scalable ETL, PySpark & Airflow on GCP
Data Engineer - Scalable ETL, PySpark & Airflow on GCP

Tata Consultancy Services Limited • Herndon (VA)

On-site
USD 100,000 - 120,000
Discretionary Annual Incentive.
Comprehensive Medical Coverage:Medical
Dental & Vision
+7
Senior Data Engineer: Build Scalable ETL Pipelines on GCP
Senior Data Engineer: Build Scalable ETL Pipelines on GCP

Tata Consultancy Services Limited • Sunnyvale (CA)

On-site
USD 110,000 - 150,000
Discretionary Annual Incentive
Comprehensive Medical Coverage: Health
Dental & Vision
+6
AWS Data Engineer | Spark, PySpark, Hive & Airflow
AWS Data Engineer | Spark, PySpark, Hive & Airflow

Tata Consultancy Services Limited • Irving (TX)

On-site
USD 90,000 - 110,000
Cloud Data Platform Engineer (Azure, PySpark, CDP)
Cloud Data Platform Engineer (Azure, PySpark, CDP)

Tata Consultancy Services Limited • San Jose (CA)

On-site
USD 80,000 - 115,000
Discretionary Annual Incentive
Comprehensive Medical Coverage
Family Support & Leaves
+1
Senior GCP Data Engineer: Big Data Pipelines & Analytics
Senior GCP Data Engineer: Big Data Pipelines & Analytics

Tata Consultancy Services Limited • Phoenix (AZ)

On-site
USD 100,000 - 120,000
Medical Coverage
Dental & Vision
401K Plan
+2
Data Engineer
Data Engineer

Compunnel Inc. • Bentonville (AR)

On-site
USD 110,000 - 150,000
Spark Data Engineer (PySpark) - Cloud ETL & Pipelines
Spark Data Engineer (PySpark) - Cloud ETL & Pipelines

Tata Consultancy Services Limited • Irving (TX)

On-site
USD 90,000 - 120,000
Discretionary Annual Incentive
Medical Coverage (Health, Dental & Vis
401K Plan
+1
Real-Time Data Engineer – Spark, Kafka & GCP
Real-Time Data Engineer – Spark, Kafka & GCP

Compunnel Inc. • Sunnyvale (CA)

On-site
USD 100,000 - 140,000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Sunnyvale (CA)

On-site
USD 100,000 - 140,000