Databricks

Arrow Point Management Services; Bengaluru; On-site; INR 2,000,000 - 2,800,000; Full time

Job summary

Appsierra Group in Bengaluru is seeking an experienced Databricks Developer with hands-on Databricks Genie expertise to build AI-powered data applications and conversational analytics.

You will design scalable data pipelines, optimize Spark jobs, and collaborate with data engineers, scientists, and business stakeholders to deliver enterprise-grade analytics solutions.

The role demands strong PySpark, SQL, and Python skills and a passion for secure, governed data architectures.

Qualifications

• Hands-on Databricks experience with Genie and AI-enabled apps.
• Strong PySpark, Spark SQL, and Python proficiency.
• Experience building ETL/ELT pipelines and data models.
• Familiarity with Delta Lake and Lakehouse architecture.
• REST APIs and enterprise data integration understanding.

Responsibilities

• Design, develop, and maintain data solutions using Databricks.
• Build apps leveraging Genie for conversational analytics.
• Create AI-enabled apps using Genie integrated with datasets.
• Develop notebooks with PySpark and SQL.
• Design scalable ETL/ELT pipelines on Lakehouse.
• Collaborate with Data Engineers, Data Scientists, and business stakeholders.
• Implement data models, transformations, and data quality validations.
• Integrate Databricks workflows with cloud storage and sources.
• Optimize Spark jobs and Databricks workloads.
• Support deployment, testing, and maintenance of Databricks-based apps.
• Ensure security, governance, and scalable data architecture.

Skills

Databricks

Databricks Genie

Genie Applications

PySpark

Spark SQL

SQL

Python

ETL/ELT

Delta Lake

REST APIs

Data Pipelines

Education

Bachelor's degree

Tools

Databricks notebooks

Databricks workflows

Databricks job scheduling

Unity Catalog

Job description

We are looking for an experienced Databricks Developer with strong hands-on expertise in Databricks and Databricks Genie. The ideal candidate should have experience building AI-powered data applications, creating conversational analytics solutions using Genie, and developing scalable data engineering solutions within the Databricks ecosystem.

Key Responsibilities

• Design, develop, and maintain data solutions using Databricks.

• Build applications leveraging Databricks Genie for conversational analytics and business user interaction.

• Create AI-enabled apps using Genie integrated with enterprise datasets.

• Develop and optimize notebooks using PySpark and SQL.

• Design scalable ETL/ELT pipelines within the Databricks Lakehouse platform.

• Collaborate with Data Engineers, Data Scientists, and Business stakeholders to deliver analytics solutions.

• Implement data models, transformations, and data quality validations.

• Integrate Databricks workflows with cloud storage and external data sources.

• Optimize performance of Spark jobs and Databricks workloads.

• Support deployment, testing, and maintenance of Databricks-based applications.

• Ensure best practices for security, governance, and scalable data architecture.

Mandatory Skills

• Strong hands-on experience with Databricks.

• Experience working with Databricks Genie.

• Experience creating applications using Genie.

• Proficiency in PySpark and Spark SQL.

• Strong SQL development skills.

• Experience with Databricks notebooks, workflows, and job scheduling.

• Understanding of Delta Lake and Lakehouse architecture.

• Experience building ETL/ELT pipelines.

• Knowledge of data modeling and performance optimization.

• Good understanding of REST APIs and application integration is preferred.

Preferred Skills

• Experience with Azure Databricks or AWS Databricks.

• Knowledge of Unity Catalog and Databricks governance.

• Exposure to Generative AI and LLM-based enterprise applications.

• Experience developing data visualization or analytics applications.

• Python programming beyond PySpark.

• CI/CD knowledge for Databricks deployment.

Experience

3–8+ years of relevant experience in Data Engineering / Databricks Development.

Education

Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.

Keywords for sourcing

Databricks Developer, Databricks Engineer, Azure Databricks, Databricks Genie, Genie Apps, PySpark Developer, Spark SQL, Delta Lake, Lakehouse, Data Engineer, Generative AI Databricks, Databricks AI Applications, Unity Catalog.

ChatGPT

Option 2

Job Description: Databricks Genie / AI Application Developer

Job Title: Databricks Genie / AI Application Developer
Experience: 3–8 Years
Location: [Location]
Employment Type: Full-time

Job Overview

We are looking for a skilled Databricks Developer with hands-on experience in Databricks Genie and building AI-powered data applications. The ideal candidate should have strong expertise in the Databricks ecosystem, data engineering, SQL, Python, and the ability to create user-friendly applications leveraging Databricks Genie.

Key Responsibilities

• Develop and implement data and AI solutions using the Databricks platform.

• Work hands-on with Databricks Genie to create and configure intelligent data experiences.

• Build applications and conversational interfaces using Genie capabilities.

• Enable users to interact with enterprise data using natural language queries.

• Create and optimize data pipelines using PySpark, Python, and SQL.

• Develop and manage Databricks notebooks, workflows, and jobs.

• Work with Delta Lake and Databricks SQL for data transformation and analytics.

• Design semantic layers and prepare datasets to support Genie-based applications.

• Integrate Databricks applications with enterprise data sources and downstream systems.

• Ensure data quality, performance, security, and scalability.

• Collaborate with Data Engineers, Data Scientists, AI/ML teams, and business stakeholders.

• Troubleshoot and optimize Databricks workloads and applications.

• Participate in solution design, development, testing, deployment, and production support.

Mandatory Skills

• Strong hands-on experience with Databricks.

• Experience working with Databricks Genie.

• Experience creating applications or solutions using Databricks Genie.

• Strong knowledge of SQL and Python/PySpark.

• Experience with Databricks SQL and Delta Lake.

• Understanding of data engineering and ETL/ELT processes.

• Experience developing and optimizing Spark jobs.

• Knowledge of Databricks notebooks, workflows, and job scheduling.

• Understanding of cloud platforms such as Azure, AWS, or GCP.

• Experience working with REST APIs and application integrations.

• Strong problem-solving and analytical skills.

Preferred Skills

• Experience with Generative AI and LLM-based applications.

• Knowledge of Databricks AI/BI capabilities.

• Experience with Unity Catalog and Databricks security/governance.

• Experience with MLflow.

• Knowledge of RAG, Vector Search, or AI agent-based applications.

• Experience developing web applications using Streamlit or similar frameworks.

• Databricks certification will be an added advantage.

Experience

• Overall Experience: 5–8 years

• Relevant Databricks Experience: Minimum 2+ years

• Databricks Genie Experience: Hands-on experience is mandatory

Education

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

Key Requirement: The candidate must have practical experience working with Databricks Genie and creating business applications or AI-powered solutions using Genie, along with strong Databricks, SQL, Python, and PySpark expertise.