Data Engineer (GCP, Python, SQL)

Tata Consultancy Services; Bengaluru; On-site; INR 1,400,000 - 2,100,000; Full time

Job summary

Tata Consultancy Services is seeking a Data Engineer with 6-10 years of hands-on experience in GCP, Python and SQL to join our Bangalore team. You will build and optimize data products and collaborate with cross-functional teams to deliver scalable data solutions.

Role includes managing CI/CD pipelines, Terraform, and cloud infrastructure on GCP, with emphasis on data mesh concepts, security, and performance. Fluency in English is required.

Qualifications

• Hands-on GCP data engineering experience with data products.
• Proficient in BigQuery, Dataflow/Dataproc, and DBT.
• Strong SQL skills and experience with Python/Java/Scala.
• Knowledge of data modelling techniques and trade-offs.
• Experience with NoSQL and RDBMS databases.
• Excellent communication and collaboration skills.
• Ability to work independently and take decisions.
• Experience with data visualization tools.
• Fluent English written and verbal.

Responsibilities

• Build, optimize, and support data products towards the target vision.
• Champion DevOps mindset; manage CI/CD pipelines and Terraform on GCP.
• Ensure deployments are modular with security, scalability, observability, and performance.
• Collaborate with Product Owner and stakeholders on data product vision.
• Engage with data mesh topics across teams and domains.
• Drive continuous improvement and reduce technical debt.
• Maintain expertise in latest data/analytics and cloud technologies.

Skills

GCP hands-on

BigQuery

DBT

SQL

Python/Java/Scala

Data modelling

NoSQL/RDBMS

Data visualization

English fluency

CI/CD

Terraform

Tools

Dataflow

Dataproc

Beam

Spark

Hive

Flink

Terraform

Job description

Role- Data Engineer (GCP, Python, SQL)

Desired Experience Range - 6-10years

Location - Bangalore

Must-Have

• At least 5+ years work experience including hands-on asData engineer on Google Cloud Platform (GCP)
• Experience in GCP tools Dataflow and Bigquery
• Experience in Data Build Tool (DBT)
• Experience in different data formats (Avro, Parquet)
• Experience in data query languages (SQL or similar)
• Experience in data centric programming using one of more programming languages Python, Java /or Scala.
• Good understanding of different data modelling techniques and trade-off
• Knowledge of NoSQL and RDBMS databases
• Have a collaborative and co-creative mindset with excellent communication skills
• Motivated to work in an environment that allows you to work and take decisions independently
• Experience in working with data visualization tools
• Fluent in English both written and verbal

Good to have

• GCP services (Big query, Pub/sub. data flow, cloud functions), DBT, Terraform. SQL), BQ, DBT, CICD
• Experience in GCP tools Dataflow, Dataproc and Bigquery
• Experience in data processing framework Beam, Spark, Hive, Flink
• Business understanding of retail industry

Role & Responsibilities-

1. Take end-to-end responsibility to build, optimize and support of existing and new data products towards the defined target vision
2. Be a champion of DevOps mindset and principles and able to manage CI/CD pipelines and terraform as well as Cloud infrastructure, in our context, it is GCP (Google Cloud Platform).
3. Ensure that our built data products work as independent units of deployment and non-functional aspects of the data products follow the defined standards for security, scalability, observability, and performance.
4. Work close to the Product Owner and other stakeholders around vision for existing data products and identifying new data products to support our customer needs
5. Work with product teams within and outside our domain around topics that relate to the data mesh concept.
6. Evaluate and drive continuous improvement and reducing technical debt in the teams
7. Maintain expertise in latest data/analytics and cloud technologies.