Databricks + Genie

Hoonartek; Pune District; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Hoonartek in Pune, India, is seeking a data engineer to design and maintain modern data pipelines using Databricks, PySpark, and SQL. You will optimize Genie integration and collaborate with business teams to translate requirements into scalable solutions.

You will work with Delta Lake, Medallion Architecture, Unity Catalog, and related technologies, ensuring data quality and reliable delivery. Preferred skills include Azure data services and knowledge of Gen AI concepts to enhance analytics

Qualifications

• Hands-on experience with Databricks and PySpark.
• Working knowledge of Databricks AI/BI Genie.
• Strong SQL and Python skills.
• Understanding of Delta Lake and Medallion Architecture.
• Knowledge of Unity Catalog.

Responsibilities

• Develop and maintain data pipelines using Databricks, SQL, and PySpark.
• Configure and manage Databricks AI/BI Genie Spaces.
• Enable natural language-based querying and analytics using Genie.
• Prepare and optimize datasets for Genie integration.
• Validate Genie-generated SQL queries and results.
• Troubleshoot data pipeline and Genie-related issues.
• Work with business teams to understand requirements and deliver solutions.

Skills

Databricks

Databricks AI/BI Genie

SQL

Python

PySpark

Tools

Delta Lake

Medallion Architecture

Unity Catalog

Job description

We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.

Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.

Using centuries of cumulative experience, research and leadership, we help our clients eliminate the complexities & risk of legacy modernization and safely deliver big data hubs, operational data integration, business intelligence, risk & compliance solutions and traditional data warehouses & marts.

At Hoonartek, we work to ensure that our customers, partners and employees all benefit from our unstinting commitment to delivery, quality and value. Hoonartek is increasingly the choice for customers seeking a trusted partner of vision, value and integrity

How We Work?

Define, Design and Deliver (D3) is our in-house delivery philosophy. It’s culled from agile and rapid methodologies and focused on ‘just enough design’. We embrace this philosophy in everything we do, leading to numerous client success stories and indeed to our own success.

We embrace change, empowering and trusting our people and building long and valuable relationships with our employees, our customers and our partners. We work flexibly, even adopting traditional/waterfall methods where circumstances demand it. At Hoonartek, the focus is always on delivery and value.

Job Description

Primary Skills: Databricks, Databricks AI/BI Genie, SQL, Python, PySpark

Key Responsibilities:

• Develop and maintain data pipelines using Databricks, SQL, and PySpark.
• Configure and manage Databricks AI/BI Genie Spaces.
• Enable natural language-based querying and analytics using Genie.
• Prepare and optimize datasets for Genie integration.
• Validate Genie-generated SQL queries and results.
• Troubleshoot data pipeline and Genie-related issues.
• Work with business teams to understand requirements and deliver solutions.

Required Skills:

• Hands-on experience with Databricks and PySpark.
• Working knowledge of Databricks AI/BI Genie.
• Strong SQL and Python skills.
• Understanding of Delta Lake and Medallion Architecture.
• Knowledge of Unity Catalog.
• Good analytical, debugging, and problem-solving skills.

Preferred: Azure Data Factory, Azure DevOps, and basic Generative AI knowledge.