DBT, Databricks-Data Engineer

Xoriant; Pune District, Gurugram District, Bengaluru; Hybrid; INR 1,400,000 - 2,400,000; Full time

Job summary

Xoriant in Pune, India, seeks a Senior Data Engineer with hands-on experience in DBT, Databricks, SQL, and Databricks Genie Agent to develop data transformation pipelines, curated data models, and Conversational BI solutions.

You will build DBT models, work with Delta Lake and Unity Catalog, ensure governance, and collaborate with BI, Data Engineering, Architecture, and Business teams across environments.

Qualifications

• 7+ years of experience in Data Engineering/Analytics Engineering.
• Strong hands-on experience with DBT (Data Build Tool).
• Strong SQL skills and experience in data modeling.
• Hands-on experience with Databricks Lakehouse, Delta Lake, Databricks SQL, Notebooks, and Workflows.
• Hands-on experience with Databricks Genie / Genie Agent.
• Understanding of Genie semantic modeling, ontology, metrics, dimensions, relationships, and natural-language-to-SQL.
• Experience with data quality, governance, RLS/RBAC, and Unity Catalog.
• Good knowledge of Python/PySpark.

Responsibilities

• Develop and maintain DBT models, macros, tests, snapshots, and data transformations.
• Build scalable data pipelines and curated datasets using Databricks and Delta Lake.
• Develop complex SQL queries and optimize data transformation processes.
• Work with Bronze, Silver, and Gold data layers.
• Develop and configure Databricks Genie Agents for Conversational BI use cases.
• Configure Genie datasets, instructions, business context, metrics, dimensions, and relationships.
• Support semantic/ontology modeling for Genie Agent.
• Ensure Genie Agent solutions use governed and approved reporting datasets.
• Implement data quality checks, validation, and reconciliation.
• Work with Unity Catalog, RLS/RBAC, and data governance.
• Troubleshoot data, SQL, Genie Agent, and performance-related issues.
• Collaborate with BI, Data Engineering, Architecture, and Business teams.
• Support documentation and deployment across environments.

Skills

SQL

Python/PySpark

Conversations BI

Data modeling

DBT (Data Build Tool)

Notebooks

Workflows

RLS/RBAC

Unity Catalog

Tools

Databricks

Databricks Genie Agent

Delta Lake

Git

Azure DevOps/CI-CD

Job description

Experience: 7+ Years

Role Overview

We are looking for a Senior Data Engineer with strong hands-on experience in DBT, Databricks, SQL, and Databricks Genie Agent. The candidate will be responsible for developing data transformation pipelines, curated data models, and supporting Conversational BI solutions using Databricks Genie.

Key Responsibilities

• Develop and maintain DBT models, macros, tests, snapshots, and data transformations.


• Build scalable data pipelines and curated datasets using Databricks and Delta Lake.


• Develop complex SQL queries and optimize data transformation processes.


• Work with Bronze, Silver, and Gold data layers.


• Develop and configure Databricks Genie Agents for Conversational BI use cases.


• Configure Genie datasets, instructions, business context, metrics, dimensions, and relationships.


• Support semantic/ontology modeling for Genie Agent.


• Ensure Genie Agent solutions use governed and approved reporting datasets.


• Implement data quality checks, validation, and reconciliation.


• Work with Unity Catalog, RLS/RBAC, and data governance.


• Troubleshoot data, SQL, Genie Agent, and performance-related issues.


• Collaborate with BI, Data Engineering, Architecture, and Business teams.


• Support documentation and deployment across environments.

Required Skills

• 7+ years of experience in Data Engineering / Analytics Engineering.


• Strong hands-on experience with DBT (Data Build Tool).


• Strong SQL skills and experience in data modeling.


• Hands-on experience with Databricks Lakehouse, Delta Lake, Databricks SQL, Notebooks, and Workflows.


• Hands-on experience with Databricks Genie / Genie Agent.


• Understanding of Genie semantic modeling, ontology, metrics, dimensions, relationships, and natural-language-to-SQL.


• Experience with data quality, governance, RLS/RBAC, and Unity Catalog.


• Good knowledge of Python/PySpark.

Experience with Git and Azure DevOps/CI-CD is preferred