Data Engineer - Senior Consultant

Vivanti Consulting; Bengaluru; On-site; INR 1,500,000 - 2,500,000; Full time

Benefits offered by this job

Paid certifications

Weekly training

Hackathons

Structured mentoring

Employee Assistance Program

Job summary

Vivanti Consulting is looking for a Consulting Data Engineer in Bengaluru, India. You will be responsible for designing and building data pipelines using Databricks, Spark, and Delta Lake. Ideal candidates have over 8 years of experience and expertise in modern data stack technologies.

The role offers collaboration with leading analysts and engineers. Perks include mentorship and continuous learning opportunities in a supportive environment, making it perfect for those eager to grow in the tech field.

Qualifications

• 8+ years of experience using Python, Spark, and SQL to build scalable data pipelines.
• Deep hands-on experience with Delta Lake, Unity Catalog, and MLflow.
• Production experience with workflow orchestration tools like Airflow or Databricks Workflows.
• Familiarity across major cloud platforms (Azure, AWS, or GCP).

Responsibilities

• Design and build robust data pipelines using Databricks, Spark, and Delta Lake.
• Implement scalable and secure Lakehouse architectures on Databricks.
• Collaborate with analysts, ML engineers, and platform teams for Databricks-native solutions.
• Ensure data platform systems are secure, reliable, and cost-effective.

Skills

Python

Spark

SQL

Data modeling techniques (Inmon, Data Vault, Kimball)

Workflow orchestration tools (Airflow, Databricks Workflows)

Integration with modern data stack automation (dbt, Fivetran, Terraform)

Familiarity with cloud platforms (Azure, AWS, GCP)

Tools

Databricks

Delta Lake

Unity Catalog

MLflow

Job description

About Vivanti: The Data People Shaping Tomorrow

Vivanti was founded as a haven for talented technologists who want to make a real impact for their clients. Our mission is to transform businesses and create a smarter, more connected world through the power of data and technology. Together, we are making the future happen today.

Your Career, Accelerated

We’re a growing global tech consultancy. Some of the world’s biggest businesses turn to us to help bring their data, AI, cloud, and digital solutions to life. We are the home base for talented technologists looking to take their career to the next level with more learning, more variety, more support, and more chances to do meaningful work.

If you have the skills, curiosity, and hunger to grow, we have the platform to help you go further.

What You’ll Get

At Vivanti, you're investing in your growth. Here’s a taste of what we offer:

• A Platform for Growth: Work across industries, clients, and technologies that stretch your thinking.
• Global Impact: Collaborate with some of the world's biggest brands and modern data stacks.
• Proven Frameworks: Access to playbooks, toolkits, and accelerators that fast-track your project success.
• Unparalleled Support: Learn from senior consultants who genuinely have your back.
• Serious Learning Support: Paid certifications, weekly training, guilds, hackathons, and structured mentoring.
• Transparent Progress: Annual reviews based on 360-degree feedback with clear goals.
• Perks & Community: Friday socials (Data-Coolada Fridays!), team building days, and long-term incentives.

The Role: Consulting Data Engineer

As a Consulting Data Engineer, you’re the builder—making sure data flows cleanly and reliably.

What you’ll do:

• Design and build robust data pipelines using Databricks, Spark, and Delta Lake.
• Implement scalable and secure Lakehouse architectures on Databricks.
• Collaborate with analysts, ML engineers, and platform teams to deliver Databricks-native solutions.
• Apply best practices in data governance, CI/CD, and orchestration within the Databricks ecosystem.
• Ensure data platform systems are secure, reliable, and cost-effective.

What You Will Bring:

We are looking for critical thinkers who love untangling complex architectures.

• 8+ years of experience using Python, Spark, and SQL to build scalable data pipelines in Databricks.
• Deep hands-on experience with Delta Lake, Unity Catalog, and MLflow.
• Production experience with workflow orchestration tools like Airflow or Databricks Workflows.
• Integration experience with modern data stack automation (dbt, Fivetran, Terraform).
• Familiarity across major cloud platforms (Azure, AWS, or GCP).
• Strong grasp of data modeling techniques (Inmon, Data Vault, Kimball).
• Solid understanding of the data lifecycle, governance, and platform optimization techniques.

The Vivanti Experience (Perks & Benefits)

• Dedicated Mentoring – Direct alignment with a Senior Support Lead.
• Innovation Days – regular hackathons to challenge yourself and build cool stuff.
• Holistic Support – 24/7 Employee Assistance Program for medical and mental wellbeing.

If you're looking for a place where your growth will go into overdrive, where you'll work with great humans, and where you'll get access to cutting-edge tools - welcome to Vivanti. Let’s talk.