Data Engineer - Senior Consultant

Vivanti Consulting; Bengaluru; On-site; INR 1,800,000 - 3,200,000; Full time

Benefits offered by this job

Dedicated Mentoring

Innovation Days

Holistic Support

Job summary

Vivanti Consulting is seeking a seasoned Consulting Data Engineer in Bengaluru to design and build robust data pipelines on Databricks, Spark, and Delta Lake. You will collaborate with analysts, ML engineers, and platform teams to deliver Databricks-native solutions and scalable Lakehouse architectures.

The role emphasizes data governance, CI/CD, and cost-efficient operations, with mentoring, learning, and cross-industry projects.

Qualifications

• 8+ years of experience building scalable data pipelines with Python, Spark and SQL.
• Strong knowledge of data modeling techniques and governance principles.
• Experience with Databricks, Delta Lake and MLflow is a plus.

Responsibilities

• Design and build robust data pipelines using Databricks, Spark and Delta Lake.
• Implement scalable Lakehouse architectures on Databricks.
• Collaborate with analysts, ML engineers and platform teams to deliver Databricks-native solutions.
• Apply best practices in data governance, CI/CD and orchestration within the Databricks ecosystem.
• Ensure data platform systems are secure, reliable and cost-effective.

Job description

About Vivanti: The Data People Shaping Tomorrow

Vivanti was founded as a haven for talented technologists who want to make a real impact for their clients. Our mission is to transform businesses and create a smarter, more connected world through the power of data and technology. Together, we are making the future happen today.

Your Career, Accelerated

We’re a growing global tech consultancy. Some of the world’s biggest businesses turn to us to help bring their data, AI, cloud, and digital solutions to life. We are the home base for talented technologists looking to take their career to the next level with more learning, more variety, more support, and more chances to do meaningful work.

If you have the skills, curiosity, and hunger to grow, we have the platform to help you go further.

What You’ll Get

At Vivanti, you're investing in your growth. Here’s a taste of what we offer:

• A Platform for Growth: Work across industries, clients, and technologies that stretch your thinking.
• Global Impact: Collaborate with some of the world's biggest brands and modern data stacks.
• Proven Frameworks: Access to playbooks, toolkits, and accelerators that fast-track your project success.
• Unparalleled Support: Learn from senior consultants who genuinely have your back.
• Serious Learning Support: Paid certifications, weekly training, guilds, hackathons, and structured mentoring.
• Transparent Progress: Annual reviews based on 360° feedback with clear goals.
• Perks & Community: Friday socials (Data-Coolada Fridays!), team building days, and long-term incentives.

The Role: Consulting Data Engineer

As a Consulting Data Engineer, you’re the builder—making sure data flows cleanly and reliably.

What you’ll do:

• Design and build robust data pipelines using Databricks, Spark, and Delta Lake.
• Implement scalable and secure Lakehouse architectures on Databricks.
• Collaborate with analysts, ML engineers, and platform teams to deliver Databricks-native solutions.
• Apply best practices in data governance, CI/CD, and orchestration within the Databricks ecosystem.
• Ensure data platform systems are secure, reliable, and cost-effective.

What You Will Bring:

We are looking for critical thinkers who love untangling complex architectures.

• 8+ years of experience using Python, Spark, and SQL to build scalable data pipelines in Databricks.
• Deep hands‑on experience with Delta Lake, Unity Catalog, and MLflow.
• Production experience with workflow orchestration tools like Airflow or Databricks Workflows.
• Integration experience with modern data stack automation (dbt, Fivetran, Terraform).
• Familiarity across major cloud platforms (Azure, AWS, or GCP).
• Strong grasp of data modeling techniques (Inmon, Data Vault, Kimball).
• Solid understanding of the data lifecycle, governance, and platform optimization techniques.

The Vivanti Experience (Perks & Benefits)

• Dedicated Mentoring – Direct alignment with a Senior Support Lead.
• Innovation Days – regular hackathons to challenge yourself and build cool stuff.
• Holistic Support – 24/7 Employee Assistance Program for medical and mental wellbeing.

If you're looking for a place where your growth will go into overdrive, where you'll work with great humans, and where you'll get access to cutting‑edge tools - welcome to Vivanti. Let’s talk.