Gcp Data Engineer_Virtual Drive_22nd Sept

Tata Consultancy Services; Hyderabad, Chennai District, Bengaluru; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

Tata Consultancy Services in Hyderabad is seeking a data engineer to design, develop, and optimize large-scale data processing pipelines for analytics and business intelligence.

The role focuses on MongoDB data lakes, Scala, and GCP services (Dataflow, Pub/Sub, BigQuery, Cloud Storage) to deliver efficient storage, retrieval, and streaming architectures.

We value strong problem-solving, clear communication, and hands-on CI/CD experience with Git.

Qualifications

• Experience designing large-scale data pipelines for analytics
• Strong understanding of data lakes and data warehousing concepts
• Proficiency with cloud data services and streaming architectures

Responsibilities

• Design, develop, and optimize large-scale data processing pipelines and ensure efficient data storage and retrieval for analytics and BI

Skills

MongoDB

Scala

GCP Dataflow

Pub/Sub

BigQuery

Cloud Storage

Distributed data processing

Data modeling

ETL processes

CI/CD pipelines

Problem solving

Communication

Tools

Git

Job description

Role & responsibilities

• Strong experience with MongoDB for data lake management.
• Proficiency in Scala programming language.
• Hands-on experience with GCP Dataflow, Pub/Sub, and other GCP services (BigQuery, Cloud Storage, etc.).
• Solid understanding of distributed data processing and streaming architectures.
• Experience with data modeling, ETL processes, and performance tuning.
• Familiarity with CI/CD pipelines and version control (Git).
• Excellent problem-solving and communication skills.

candidate will design, develop, and optimize large-scale data processing pipelines and ensure efficient data storage and retrieval for analytics and business intelligence