Data Engineer - Databricks

Vivanti Consulting; Bengaluru; On-site; INR 1,800,000 - 3,000,000; Full time

Benefits offered by this job

Mentoring Program

360 Reviews

Guilds & Training

Paid Certifications

Hackathons

Recognition Programs

Team Socials

Employee Assistance Program

Job summary

Vivanti is a growing global tech consultancy where data, AI, cloud and digital solutions come to life. As a Consulting Data Engineer, you will design and build robust data pipelines and contribute to secure lakehouse architectures across Databricks.

You will collaborate with analysts, ML engineers, and platform teams, benefit from mentoring, paid certs, weekly training, and regular progress reviews as part of our commitment to your development and growth.

Qualifications

• 6+ years of experience in Python, Spark, and SQL for building scalable data pipelines in Databricks.
• Deep experience with Databricks features including Delta Lake, Unity Catalog, and MLflow.
• Workflow orchestration using Airflow or Databricks Workflows.
• Integration experience with dbt, Fivetran, and Terraform for modern data stack automation.

Responsibilities

• Designing and building robust data pipelines using Databricks, Spark, and Delta Lake
• Implementing scalable and secure Lakehouse architectures on Databricks
• Collaborating with analysts, ML engineers, and platform teams to deliver Databricks-native solutions
• Applying best practices in data governance, CI/CD, and orchestration within the Databricks ecosystem
• Ensuring systems are secure, reliable and cost-effective

Skills

SQL

Python

Spark

Databricks

Delta Lake

MLflow

Airflow

dbt

Terraform

Unity Catalog

Tools

Databricks

Spark

Airflow

Terraform

dbt

Fivetran

Unity Catalog

MLflow

Delta Lake

Job description

You’ve got the skills. The curiosity. The hunger to grow, try new things and make a real impact.

We’re a growing global tech consultancy. Some of the world’s biggest businesses turn to us to help bring their data, AI, cloud and digital solutions to life.

We’re the home base for talented technologists who want more and are looking to take their career to the next level by having more learning, more variety, more support and more chances to do meaningful work.

If that sounds like the kind of place you’d thrive in, keep reading.

What You’ll Get

We know you're bringing the skills, the passion and the drive. What we bring is the platform to help you go further.

At Vivanti, you're not just taking a job, you're investing in your growth.

Here’s a taste:

• A platform for growth: Work across industries, clients and technologies that stretch your thinking and build your personal and professional skills.
• Access global businesses: Work with some of the world's biggest brands
• IP, frameworks and accelerators: We share what we know. Our playbooks and toolkits fast-track your success on projects.
• Access to a broad ecosystem of technologies
• Senior consultants who have your back: You’ll always have a guide on your journey, not just be thrown into the deep end.
• Serious learning support: Paid certs, weekly training, guilds, hackathons, mentoring and more.
• Progress that’s transparent: Annual reviews based on 360° feedback, not vague vibes. Clear goals, solid feedback and real growth.
• Kudos and rewards: We celebrate wins, reward impact and offer long-term incentives.
• Real connection: From Friday socials to annual team building days - we work hard and play harder.

What We’re Looking For

We're on the hunt for people who love solving problems, thinking critically and staying curious. If you’ve worked in data or tech before - amazing. If you’ve got a brain that enjoys untangling complex stuff and applying what you’ve learned - Even better!

We're less about ticking boxes and more about whether you'd thrive in this environment:

• Do you get excited about helping clients move forward?
• Do you want to learn from people who are really good at what they do?
• Are you keen to experiment with the latest tools and ideas?
• Can you balance working independently and being a great teammate?
• 5 years experience using SQL, python or other relevant technology?
• Experience working with Databricks and relevant certifications in Databricks or cloud platforms?

If you said “yes” more than once, let’s talk.

Key Skills

As a Consulting Data Engineer, you’re the builder - making sure data flows cleanly and reliably.

What you’ll do:

• Designing and building robust data pipelines using Databricks, Spark, and Delta Lake
• Implementing scalable and secure Lakehouse architectures on Databricks
• Collaborating with analysts, ML engineers, and platform teams to deliver Databricks-native solutions
• Applying best practices in data governance, CI/CD, and orchestration within the Databricks ecosystem
• Ensuring systems are secure, reliable and cost-effective

What you will bring:

• 6+ years of experience in Python, Spark, and SQL for building scalable data pipelines in Databricks
• Deep experience with Databricks features including Delta Lake, Unity Catalog, and MLflow
• Workflow orchestration using Airflow or Databricks Workflows
• Integration experience with dbt, Fivetran, and Terraform for modern data stack automation
• Familiarity with cloud platforms (Azure, AWS, GCP)
• Knowledge and experience of data modelling techniques (Inmon, Data Vault, Kimball)
• Knowledge and experience of the data lifecycle, data management & governance, data platform architectures
• Knowledge and experience of Databricks data pipeline & data platform optimisation techniques

Your work matters—and so do you.

That’s why we back your skills with a structure that supports your development, celebrates your wins, and helps you keep growing - professionally and personally.

Here’s what’s waiting for you:

• Mentoring Program – with a Senior Support Lead
• 360° Progress Reviews – honest feedback, not fluff
• Guilds & Weekly Training – learn from your peers
• Paid Certifications – across all major technologies
• Hackathons & Innovation Days – challenge yourself, build cool stuff
• Kudos & Recognition Programs – great work doesn’t go unnoticed
• Socials & Team Days – Data-Coolada Fridays, Team Building days, and more
• Employee Assistance Program - 24/7 personal safety, medical and mental wellbeing support

Final Word

If you're looking for the place where your growth will go into overdrive, where you'll work with great humans, get access to cutting-edge tools and genuinely enjoy the ride?

Welcome to Vivanti.

About Vivanti

The Data People Shaping Tomorrow

Vivanti was founded as a haven for talented technologists who want to make a real impact for their clients. Our mission is to transform businesses and to create a smarter, more connected world through the power of data and technology. Together, we are making the future happen - today.