Data Engineer - Senior Consultant

Vivanti Consulting; Bengaluru; On-site; INR 2,400,000 - 4,200,000; Full time

Benefits offered by this job

Dedicated Mentoring

Innovation Days

Employee Assistance Program

Job summary

Vivanti Consulting seeks a seasoned Consulting Data Engineer to design and operate scalable data pipelines on Databricks, Spark, and Delta Lake. You will architect secure Lakehouse solutions, collaborate with analysts and ML engineers, and implement governance practices across the platform.

You will work with a global tech consultancy that rewards growth through mentoring, learning programs, and cross-functional collaboration.

Qualifications

• 8+ years of experience using Python, Spark, and SQL to build scalable data pipelines in Databricks.
• Deep hands-on experience with Delta Lake, Unity Catalog, and MLflow.
• Production experience with workflow orchestration tools like Airflow or Databricks Workflows.
• Integration experience with modern data stack automation (dbt, Fivetran, Terraform).
• Familiarity across major cloud platforms (Azure, AWS, or GCP).
• Strong grasp of data modeling techniques (Inmon, Data Vault, Kimball).
• Solid understanding of the data lifecycle, governance, and platform optimization techniques.

Responsibilities

• Design and build robust data pipelines using Databricks, Spark, and Delta Lake.
• Implement scalable and secure Lakehouse architectures on Databricks.
• Collaborate with analysts, ML engineers, and platform teams to deliver Databricks-native solutions.
• Apply best practices in data governance, CI/CD, and orchestration within the Databricks ecosystem.
• Ensure data platform systems are secure, reliable, and cost-effective.

Skills

Python

Spark

SQL

Delta Lake

Unity Catalog

MLflow

Airflow

Databricks Workflows

dbt

Fivetran

Terraform

Azure

AWS

GCP

Data Modeling

Data Governance

CI/CD

Tools

Databricks

Job description

About Vivanti: The Data People Shaping Tomorrow

Vivanti was founded as a haven for talented technologists who want to make a real impact for their clients. Our mission is to transform businesses and create a smarter, more connected world through the power of data and technology. Together, we are making the future happen today.

Your Career, Accelerated

We’re a growing global tech consultancy. Some of the world’s biggest businesses turn to us to help bring their data, AI, cloud, and digital solutions to life. We are the home base for talented technologists looking to take their career to the next level with more learning, more variety, more support, and more chances to do meaningful work.

If you have the skills, curiosity, and hunger to grow, we have the platform to help you go further.

What You’ll Get

At Vivanti, you're investing in your growth. Here’s a taste of what we offer:

• A Platform for Growth: Work across industries, clients, and technologies that stretch your thinking.
• Global Impact: Collaborate with some of the world's biggest brands and modern data stacks.
• Proven Frameworks: Access to playbooks, toolkits, and accelerators that fast-track your project success.
• Unparalleled Support: Learn from senior consultants who genuinely have your back.
• Serious Learning Support: Paid certifications, weekly training, guilds, hackathons, and structured mentoring.
• Transparent Progress: Annual reviews based on 360-degree feedback with clear goals.
• Perks & Community: Friday socials (Data-Coolada Fridays!), team building days, and long-term incentives.

The Role: Consulting Data Engineer

As a Consulting Data Engineer, you’re the builder—making sure data flows cleanly and reliably.

What you’ll do:

• Design and build robust data pipelines using Databricks, Spark, and Delta Lake.
• Implement scalable and secure Lakehouse architectures on Databricks.
• Collaborate with analysts, ML engineers, and platform teams to deliver Databricks-native solutions.
• Apply best practices in data governance, CI/CD, and orchestration within the Databricks ecosystem.
• Ensure data platform systems are secure, reliable, and cost-effective.

What You Will Bring:

We are looking for critical thinkers who love untangling complex architectures.

• 8+ years of experience using Python, Spark, and SQL to build scalable data pipelines in Databricks.
• Deep hands-on experience with Delta Lake, Unity Catalog, and MLflow.
• Production experience with workflow orchestration tools like Airflow or Databricks Workflows.
• Integration experience with modern data stack automation (dbt, Fivetran, Terraform).
• Familiarity across major cloud platforms (Azure, AWS, or GCP).
• Strong grasp of data modeling techniques (Inmon, Data Vault, Kimball).
• Solid understanding of the data lifecycle, governance, and platform optimization techniques.

The Vivanti Experience (Perks & Benefits)

• Dedicated Mentoring – Direct alignment with a Senior Support Lead.
• Innovation Days – regular hackathons to challenge yourself and build cool stuff.
• Holistic Support – 24/7 Employee Assistance Program for medical and mental wellbeing.

If you're looking for a place where your growth will go into overdrive, where you'll work with great humans, and where you'll get access to cutting-edge tools - welcome to Vivanti. Let's talk.