Databricks AI Engineer

Kiya.ai

Hyderabad, Bengaluru

Hybrid

INR 900,000 - 1,300,000

Full time

12 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Kiya.ai in Hyderabad, India, seeks a hands-on AI/ML engineer to design, build and deploy Generative AI solutions on the Databricks platform. You will develop RAG-based applications, integrate LLMs with enterprise data, and optimize AI pipelines using PySpark, Python and Spark SQL.

You will collaborate with clients and stakeholders, refine requirements, and demonstrate solutions while applying MLOps practices for deployment, monitoring, and lifecycle management.

Qualifications

  • Hands-on Databricks experience.
  • Strong Python programming skills.
  • Proficient with PySpark and Spark SQL.
  • Experience with AI/ML or Generative AI development.
  • Hands-on with Large Language Models (LLMs).
  • Experience developing and deploying RAG-based applications.
  • Knowledge of embeddings, vector databases, and semantic search.
  • Experience with MLflow or equivalent model lifecycle tools.
  • Experience deploying AI solutions in cloud environments.
  • Strong analytical, problem-solving, and communication skills.

Responsibilities

  • Design, develop, and deploy AI/ML and Generative AI solutions on the Databricks platform.
  • Build and implement LLM-powered applications, including Retrieval-Augmented Generation (RAG) solutions.
  • Develop scalable data processing and AI pipelines using PySpark, Python, and Spark SQL.
  • Utilize Databricks Mosaic AI capabilities for developing and deploying AI applications.
  • Implement Vector Search, embedding models, and semantic search capabilities.
  • Integrate Large Language Models (LLMs) with enterprise data sources and applications.
  • Develop and optimize prompt engineering strategies for LLM-based applications.
  • Use MLflow for model tracking, experimentation, evaluation, and deployment.
  • Implement MLOps practices for model deployment, monitoring, and lifecycle management.
  • Collaborate with clients and stakeholders to understand requirements and provide technical solutions.
  • Participate in client discussions, technical design sessions, and solution demonstrations.
  • Troubleshoot and optimize AI application performance, scalability, and reliability.

Skills

Databricks
Python
PySpark
Generative AI
LLMs
RAG
Vector search
MLflow
MLOps
Cloud deployment
Client communication

Tools

Databricks

Job description

Key Responsibilities
  • Design, develop, and deploy AI/ML and Generative AI solutions using the Databricks platform.
  • Build and implement LLM-powered applications, including Retrieval-Augmented Generation (RAG) solutions.
  • Develop scalable data processing and AI pipelines using PySpark, Python, and Spark SQL.
  • Utilize Databricks Mosaic AI capabilities for developing and deploying AI applications.
  • Implement Vector Search, embedding models, and semantic search capabilities.
  • Integrate Large Language Models (LLMs) with enterprise data sources and applications.
  • Develop and optimize prompt engineering strategies for LLM-based applications.
  • Use MLflow for model tracking, experimentation, evaluation, and deployment.
  • Implement MLOps practices for model deployment, monitoring, and lifecycle management.
  • Work closely with clients and stakeholders to understand requirements and provide technical solutions.
  • Participate in client discussions, technical design sessions, and solution demonstrations.
  • Troubleshoot and optimize AI application performance, scalability, and reliability.
Mandatory Skills
  • Strong hands‑on experience with Databricks.
  • Experience in Python programming and PySpark.
  • Practical experience in AI/ML or Generative AI development.
  • Hands‑on experience with Large Language Models (LLMs).
  • Experience in developing RAG-based applications.
  • Knowledge of embeddings, vector databases, and semantic search.
  • Experience with MLflow or equivalent model lifecycle management tools.
  • Experience in developing and deploying AI solutions in cloud environments.
  • Strong analytical, problem‑solving, and communication skills.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks+ Gen AI
Databricks+ Gen AI

Infosys • Hyderabad, Chennai District, Bengaluru

On-site
INR 1,800,000 - 3,800,000
Senior Data Scientist (ML Engineer)
Senior Data Scientist (ML Engineer)

Indsafri • India

On-site
INR 1,800,000 - 3,200,000
Data Science Lead – R01570347
Data Science Lead – R01570347

Brillio • Bengaluru

On-site
INR 3,200,000 - 5,200,000
AI/ML Engineer (with Databricks Cloud Skills)
AI/ML Engineer (with Databricks Cloud Skills)

Infosys • Pune District

On-site
INR 1,200,000 - 1,800,000
Senior AI Engineer
Senior AI Engineer

TheMathCompany Inc. • Bengaluru

On-site
INR 2,400,000 - 4,200,000
AI/ML Engineer - Senior Consultant
AI/ML Engineer - Senior Consultant

Winfo Solutions • Hyderabad

On-site
INR 1,200,000 - 1,800,000
Databricks GenAI Solutions Architect
Databricks GenAI Solutions Architect

Celebal Technologies • Bengaluru

On-site
INR 4,200,000 - 7,000,000
Databricks ecosystem exposure
AI Engineer (Gen AI, Databricks)
AI Engineer (Gen AI, Databricks)

Infosys • Bengaluru

On-site
INR 2,500,000 - 4,500,000
Senior AI Engineer - Databricks
Senior AI Engineer - Databricks

Adesso SE • Bengaluru

On-site
INR 1,800,000 - 3,600,000
Gen AI+Databricks-L
Gen AI+Databricks-L

Infosys • Hyderabad, Pune District, Bengaluru

On-site
INR 1,200,000 - 1,900,000