GCP Databricks, Data Engineer

Tata Consultancy Services; Hyderabad; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Tata Consultancy Services is seeking a data engineer to build large-scale data and analytics solutions on Google Cloud Platform. You will write code across Dataflow, Pub/Sub, BigQuery and related tools, integrating diverse data sources and enabling visualization and insights.

The role emphasizes hands-on cloud experience, data migration from legacy systems to GCP, and design of data lakes and data warehouses with ETL processes.

Responsibilities

• Build large scale data and analytics solutions on GCP
• Write code in Cloud Dataflow, Pub-Sub, Cloud BigTable, Cloud storage
• Efficiently use the GCP platform to integrate large datasets from multiple data sources, analyse data, data modelling, data exploitation/visualization
• Good to have knowledge in Hadoop - Spark, Hive and AI/ML solutions.
• DevOps, CI/CD implementation
• Build automated data pipelines and work in Data engineering solution on GCP using Cloud BigQuery, Cloud DataProc
• Must have Hands-on experience on Google Cloud
• Experience on Data Migration from legacy systems (Oracle, BigData, Netezza) to GCP
• Experience with Data lake, data warehouse ETL build and design

Skills

GCP

Data pipelines

DevOps

CI/CD

Data modeling

Cloud migration

Tools

Cloud Dataflow

Pub/Sub

Cloud BigTable

Cloud Storage

Cloud BigQuery

DataProc

Hadoop

Spark

Hive

Job description

Role & responsibilities

• Build large scale data and analytics solutions on GCP
• Can write code in Cloud Dataflow, Pub-Sub, Cloud BigTable, Cloud storage .
• Efficiently use the GCP platform to integrate large datasets from multiple data sources, analyse data, data modelling, data exploitation/visualization
• Good to have knowledge in Hadoop - Spark, Hive and AI/Ml solutions.
• DevOps, CI/CD implementation
• Build automated data pipelines and work in Data engineering solution on GCP using Cloud BigQuery, Cloud DataProc,
• Must have Hands-on experience on Google Cloud
• Experience on Data Migration from legacy systems (Oracle, BigData, Netezza) to GCP
• Experience with Data lake, data warehouse ETL build and design