Data Engineer - GCP

Vivanti Consulting; Bengaluru; On-site; INR 3,500,000 - 6,000,000; Full time

Benefits offered by this job

Platform for growth

Global client exposure

Cutting-edge tech stack

Senior mentorship

Paid certifications

Job summary

Vivanti is seeking a Senior GCP Data Engineer to design and optimize our Google Cloud data architecture and pipelines. You’ll lead large-scale data solution implementations, ensure data quality, and promote engineering best practices.

You will work with BigQuery, Dataflow, Dataproc, Pub/Sub, and Airflow, building scalable ETL/ELT pipelines across batch and real-time workloads, while upholding security and governance standards.

Qualifications

• 6+ years of hands-on experience with Google Cloud Platform (GCP) data and analytics services.
• Experience using SQL, python or other relevant technology.
• Core Services: BigQuery (expert level), Cloud Dataflow (Apache Beam), Cloud Storage.
• Processing: Dataproc (Apache Spark/Hadoop), Pub/Sub.
• Orchestration: Cloud Composer (Apache Airflow)
• Deep understanding of Data Warehousing, Data Lake concepts, and advanced data modeling techniques (Star/Snowflake schema, Data Vault).
• Experience with Infrastructure as Code (IaC) tools like Terraform or Cloud Deployment Manager.
• Strong knowledge of version control (Git), software development lifecycle, and Agile/Scrum methodologies.

Responsibilities

• Architect, design, and implement robust, scalable, and fault-tolerant data ingestion and ETL/ELT pipelines for batch and real-time processing on GCP
• Define and enforce data modeling standards (Dimensional, 3NF, Data Vault, etc.) for optimal performance in BigQuery and other storage solutions.
• Lead the technical design and deployment of Data Lakes and Data Warehouses using best-in-class GCP services.
• Develop and maintain complex data pipelines using Python (Pandas, PySpark) and/or Scala/Java with a strong focus on Apache Beam/Dataflow and Dataproc/Spark.
• Write, optimize, and tune advanced SQL queries for efficiency and cost reduction, particularly within BigQuery.
• Implement data orchestration and workflow management using Cloud Composer (Apache Airflow).
• Ensure optimal performance, cost efficiency, and reliability of all data solutions through continuous monitoring and tuning.
• Implement data governance and data quality frameworks, including data validation, lineage tracking, and metadata management (e.g., Data Catalog)
• Establish and enforce security best practices on GCP, including IAM, data encryption (at rest and in transit), and proper network access controls.
• Drive DevOps principles: implement and maintain CI/CD pipelines for data solutions using tools like Cloud Build, Jenkins, or Git Lab.

Skills

GCP Data Engineering

SQL / Python

BigQuery expert

Dataflow / Beam

Dataproc / Spark

Cloud Composer (Airflow)

Data Warehousing basics

Terraform / IaC

Git / DevOps

Agile / Scrum

Tools

Terraform

Apache Airflow

Git

Job description

You’ve got the skills. The curiosity. The hunger to grow, try new things and make a real impact.

We’re a growing global tech consultancy. Some of the world’s biggest businesses turn to us to help bring their data, AI, cloud and digital solutions to life.

We’re the home base for talented technologists who want more and are looking to take their career to the next level by having more learning, more variety, more support and more chances to do meaningful work.

If that sounds like the kind of place you’d thrive in, keep reading.

What You’ll Get

We know you're bringing the skills, the passion and the drive. What we bring is the platform to help you go further. At Vivanti, you're not just taking a job, you're investing in your growth. Here’s a taste:

• A platform for growth: Work across industries, clients and technologies that stretch your thinking and build your personal and professional skills.
• Access global businesses: Work with some of the world's biggest brandsIP, frameworks and accelerators: We share what we know. Our playbooks and toolkits fast-track your success on projects.
• All the shiny tech: Databricks, Snowflake, Azure, GCP, AWS - you’ll use it, play with it and maybe even break it (responsibly)
• Senior consultants who have your back: You’ll always have a guide on your journey, not just be thrown into the deep end.
• Serious learning support: Paid certs, weekly training, guilds, hackathons, mentoring and more.
• Progress that’s transparent: Annual reviews based on 360° feedback, not vague vibes. Clear goals, solid feedback and real growth.
• Kudos and rewards: We celebrate wins, reward impact and offer long-term incentives.
• Real connection: From Friday socials to annual team building days - we work hard and play harder.

What We’re Looking For

We are looking for an accomplished and highly motivated Senior GCP Data Engineer to design, build, and optimize our Google Cloud Platform data architecture and pipelines. This expert will lead large-scale data solution implementation, ensure data quality, and promote engineering best practices.

• 6+ years of hands-on experience with Google Cloud Platform (GCP) data and analytics services.
• Experience using SQL, python or other relevant technology.
• Core Services: BigQuery (expert level), Cloud Dataflow (Apache Beam), Cloud Storage.
• Processing: Dataproc (Apache Spark/Hadoop), Pub/Sub.
• Orchestration: Cloud Composer (Apache Airflow)
• Deep understanding of Data Warehousing, Data Lake concepts, and advanced data modeling techniques (Star/Snowflake schema, Data Vault.
• Experience with Infrastructure as Code (IaC) tools like Terraform or Cloud Deployment Manager.
• Strong knowledge of version control (Git), software development lifecycle, and Agile/Scrum methodologies.

What You’ll Do

• Architect, design, and implement robust, scalable, and fault-tolerant data ingestion and ETL/ELT pipelines for batch and real-time processing on GCP
• Define and enforce data modeling standards (Dimensional, 3NF, Data Vault, etc.) for optimal performance in BigQuery and other storage solutions.
• Lead the technical design and deployment of Data Lakes and Data Warehouses using best-in-class GCP services.
• Develop and maintain complex data pipelines using Python (Pandas, PySpark) and/or Scala/Java with a strong focus on Apache Beam/Dataflow and Dataproc/Spark.
• Write, optimize, and tune advanced SQL queries for efficiency and cost reduction, particularly within BigQuery.
• Implement data orchestration and workflow management using Cloud Composer (Apache Airflow).
• Ensure optimal performance, cost efficiency, and reliability of all data solutions through continuous monitoring and tuning.
• Implement data governance and data quality frameworks, including data validation, lineage tracking, and metadata management (e.g., Data Catalog)
• Establish and enforce security best practices on GCP, including IAM, data encryption (at rest and in transit), and proper network access controls.
• Drive DevOps principles: implement and maintain CI/CD pipelines for data solutions using tools like Cloud Build, Jenkins, or Git Lab

Your work matters—and so do you.

That’s why we back your skills with a structure that supports your development, celebrates your wins, and helps you keep growing - professionally and personally. Here’s what's waiting for you:

• Mentoring Program – with a Senior Support Lead
• 360° Progress Reviews – honest feedback, not fluff
• Guilds & Weekly Training – learn from your peers
• Paid Certifications – across all major technologies
• Hackathons & Innovation Days – challenge yourself, build cool stuff
• Kudos & Recognition Programs – great work doesn’t go unnoticed
• Socials & Team Days – Data-Coolada Fridays, Team Building days, and more

Final Word

If you're looking for the place where your growth will go into overdrive, where you'll work with great humans, get access to cutting-edge tools and genuinely enjoy the ride?

Welcome to Vivanti.

About Vivanti

The Data People Shaping Tomorrow

Vivanti was founded as a haven for talented technologists who want to make a real impact for their clients. Our mission is to transform businesses and to create a smarter, more connected world through the power of data and technology. Together, we are making the future happen - today.