SEMANTIC & GENIE ENGINEER (DATABRICKS)

Jobgether; India; Remote; INR 1,350,000 - 1,650,000; Full time

Benefits offered by this job

Competitive ₹15 LPA

Fully remote within India

Full-time employment

Databricks tech stack experience

AI-enabled data solutions

Job summary

Jobgether, listing on behalf of a partner company in India, seeks a Semantic & Genie Engineer (Databricks) to build advanced data architecture and intelligent automation within the Databricks ecosystem.

You will design Unity Catalog strategies, maintain Delta Lake structures, optimize SQL, and develop Python/Streamlit apps to visualize insights, collaborating with data engineering and AI teams in a remote IT services environment.

Qualifications

• 5+ years in data engineering or related field.
• Strong Python and advanced SQL skills.
• Deep Databricks expertise: Unity Catalog, Delta Lake, Genie.
• Understanding of data governance and lineage.
• Experience with data quality and profiling techniques.
• Experience building dashboards with Streamlit.

Responsibilities

• Design and implement Unity Catalog data access and governance.
• Architect Delta Lake structures for scalable data storage.
• Profile data and establish validation frameworks.
• Optimize complex SQL queries for analytics and reporting.
• Develop Python apps and Databricks Apps for visualization.
• Build multi-agent orchestration with Genie Agents.
• Configure Databricks Metric Views for performance tracking.
• Manage Git-based collaborative development workflows.
• Integrate MCPs into data workflows.
• Ensure integration between data engineering, semantic layers, and AI.
• Improve platform reliability, governance, and automation.

Skills

Python

SQL

Databricks

Unity Catalog

Delta Lake

Git

Streamlit

Databricks Genie

MCP

Data governance

Tools

Databricks Apps

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a SEMANTIC & GENIE ENGINEER (DATABRICKS) based in India.

We are seeking an experienced Semantic & Genie Engineer to build advanced data architecture and intelligent automation solutions within the Databricks ecosystem. In this role, you will strengthen data governance, improve query performance, and develop sophisticated multi-agent orchestration capabilities. You will work across data engineering and generative AI technologies to create reliable, scalable, and well-governed data environments. Your expertise will help establish semantic layers, maintain data quality, and make enterprise data more accessible for analytics and automated decision-making. Collaborating across technical functions, you will develop applications and intelligent agents that transform complex data into actionable insights. This is an opportunity to contribute to modern data platforms and AI-driven solutions in a remote IT services environment.

Accountabilities

As a Semantic & Genie Engineer, you will design, implement, and optimize data platform capabilities while integrating intelligent automation into enterprise workflows. Your responsibilities will include:

• Design and implement Unity Catalog strategies to manage data access, lineage, permissions, and governance effectively.

• Architect and maintain Delta Lake structures to support reliable, scalable, and high-performance data storage and processing.

• Conduct comprehensive data profiling and establish validation frameworks to maintain data accuracy, consistency, and integrity.

• Optimize complex SQL queries and database performance to support efficient analytics and reporting requirements.

• Develop custom applications using Python, Streamlit, and Databricks Apps to visualize insights and automate business workflows.

• Engineer advanced multi-agent systems and Databricks Genie Agents to enable intelligent data operations and automated decision-making.

• Configure and monitor Databricks Metric Views to track key performance indicators and evaluate data and system performance.

• Manage version control and collaborative development workflows using Git across codebases and configurations.

• Integrate Machine Learning Pipelines (MCP) into data workflows to enhance predictive capabilities and analytical solutions.

• Ensure seamless integration between data engineering components, semantic layers, and generative AI capabilities.

• Continuously improve platform reliability, query efficiency, data governance, and automation processes.

Requirements

The ideal candidate combines strong data engineering expertise with practical experience in Databricks, intelligent automation, and application development. You should be comfortable managing complex data environments, optimizing performance, and implementing emerging AI capabilities. Key qualifications include:

• At least 5 years of professional experience in data engineering or a related technical field.

• Strong proficiency in Python programming and advanced SQL for data manipulation, analysis, and optimization.

• Deep expertise in the Databricks ecosystem, particularly Unity Catalog, Delta Lake, and Databricks Genie.

• Strong understanding of data governance, access management, and data lineage.

• Proven experience with data quality assurance, profiling techniques, and validation methodologies.

• Demonstrated ability to optimize SQL queries and improve data pipeline performance.

• Experience building interactive dashboards and applications using Streamlit and Databricks Apps.

• Knowledge of multi-agent orchestration patterns and practical experience implementing Genie Agents and Genie Spaces.

• Familiarity with Git version control and collaborative software development practices.

• Understanding of Machine Learning Pipelines (MCP) and their integration into data workflows.

• Strong analytical and problem-solving skills, with the ability to translate complex technical requirements into reliable data solutions.

Benefits

• Competitive annual compensation of ₹15 LPA.

• Full-time employment.

• Fully remote working arrangement within India.

• Opportunity to work with advanced Databricks technologies and generative AI solutions.

• Exposure to intelligent automation, multi-agent orchestration, and modern data architecture.

• Opportunity to contribute to data governance, analytics, and enterprise-scale engineering initiatives.

Data Privacy Notice:

By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.