Consultant / Sr. Consultant, Data Engineer - Databricks + AI Engineer

Fresh Gravity; Pune District; Hybrid; INR 1,500,000 - 2,700,000; Full time

Benefits offered by this job

5D Benefits program

Job summary

Fresh Gravity is seeking a data engineer to design and optimize data pipelines on the Databricks platform. You will develop AI agents to automate data processing and workflow orchestration, and collaborate with data scientists to operationalize ML models.

The role involves building scalable ETL/ELT solutions, ensuring data quality and performance across pipelines, and working with Spark, Delta Lake, and related technologies. This is a Pune-based, full-time opportunity.

Qualifications

• 3 to 5 years of data engineering experience.
• Experience designing and optimizing data pipelines on the Databricks platform.
• Strong Python and SQL programming skills.
• Experience with Spark, Delta Lake, and big data technologies.
• Ability to collaborate with data science and engineering teams.

Responsibilities

• Design, build, and optimise data pipelines and workflows on the Databricks platform.
• Develop and integrate AI agents to automate data processing, decision-making, and workflow orchestration.
• Build scalable ETL/ELT solutions using Spark, Delta Lake, and related big data technologies.
• Collaborate with data scientists and architects to operationalize machine learning and generative AI models.
• Ensure data quality, reliability, and performance across pipelines and platforms.
• Troubleshoot and continuously improve existing data engineering solutions.
• Ability to work with LLM frameworks or generative AI tools within Databricks, creating AI Agents to accelerate Data Engineering tasks.
• Hands-on experience with Databricks, Apache Spark, and Delta Lake.

Skills

Python

SQL

Data engineering

ETL/ELT design

Spark

Delta Lake

Databricks

LLM frameworks / generative AI tools

AI agents

Collaboration

Tools

Databricks

Apache Spark

Delta Lake

Job description

Who we are:

Founded in 2015, Fresh Gravity helps businesses make data-driven decisions. We are driven by data and its potential as an asset to drive business growth and efficiency. Our consultants are passionate innovators who solve clients business problems by applying best-in-class data and analytics solutions. We provide a range of consulting and systems integration services and solutions to our clients in the areas of Data Management, Analytics and Machine Learning, and Artificial Intelligence.

In the last 10 years, we have put together an exceptional team and have delivered 200+ projects for over 80 clients ranging from startups to several fortune 500 companies. We are on a mission to solve some of the most complex business problems for our clients using some of the most exciting new technologies, providing the best of learning opportunities for our team.

We are focused and intentional about building a strong corporate culture in which individuals feel valued, supported, and cared for. We foster an environment where creativity thrives, paving the way for groundbreaking solutions and personal growth. Our open, collaborative, and empowering work culture is the main reason for our growth and success. To know more about our culture and employee benefits, visit our website https://www.freshgravity.com/employee- benefits/. We promise rich opportunities for you to succeed, to shine, to exceed even your own expectations.

We are data driven. We are passionate. We are innovators. We are Fresh Gravity.

What We’re Looking For:

• Years of Experience 3 to 5 Years.
• Design, build, and optimise data pipelines and workflows on the Databricks platform
• Develop and integrate AI agents to automate data processing, decision-making, and workflow orchestration
• Build scalable ETL/ELT solutions using Spark, Delta Lake, and related big data technologies
• Collaborate with data scientists and architects to operationalize machine learning and generative AI models.
• Ensure data quality, reliability, and performance across pipelines and platforms.
• Troubleshoot and continuously improve existing data engineering solutions.
• Ability to work with LLM frameworks or generative AI tools within Databricks. Creating AI Agents to accelerate Data Engineering tasks.
• Hands-on experience with Databricks, Apache Spark, and Delta Lake -Ability to work with LLM frameworks or generative AI tools within Databricks. Creating AI Agents.
• Practical experience building or integrating AI agents or agentic workflows into data pipelines.
• Strong programming skills in Python and SQL.
• Solid understanding of data engineering principles, including pipeline design, orchestration, and performance tuning.
• Ability to work collaboratively across engineering and data science teams.

Good to have skills:

• Experience with cloud platforms such as Azure, AWS, or GCP
• Exposure to CI/CD practices for data engineering workflows

Why us:

In addition to a competitive package, we promise rich opportunities for you to succeed, to shine, to exceed even your own expectations. In keeping with Fresh Gravitys challenger ethos, we have developed the 5Dimensions (5D) benefits program. This program recognizes the multiple dimensions within each of us and seek to provide opportunities for deep development across these dimensions. Enrich MySelf; Enhance My Client; Build my Company, Nurture My Family; and Better Humanity.