Dbdemos.ai is moving to https://databricks.com/demos for even more content! dbdemos links will redirect there over the next days.

<< back to the demos

Demo: Build your Chat Bot with Dolly

Democratizing the magic of ChatGPT with open models and Databricks Lakehouse (starts GPU)

Large Language Models produce some amazing results, chatting and answering questions with seeming intelligence.
But how can you get LLMs to answer questions about your specific datasets? Imagine answering questions based on your company's knowledge base, docs or Slack chats.
The good news is that this is easy to build on Databricks, leveraging open-source tooling and open LLMs.
Databricks released Dolly, Dolly the first truly open LLM. Because Dolly was fine tuned using databricks-dolly-15k (15,000 high-quality human-generated prompt / response pairs specifically designed for instruction tuning large language models), it can be used as starting point to create your own commercial model.
In this demo, we'll show you how to leverage Dolly to build your own chat bot:

  • Data ingestion & preparation
  • Vector database for similarity search
  • Prompt engineering using langchain and hugging face transformers
  • Q&A bot to answer our customers
  • More advance bot with memory to chain answers


Note: this cluster will start a 64GB RAM GPU

Installing the demos

%pip install dbdemos
import dbdemos
dbdemos.install('llm-dolly-chatbot')


Databricks demos components

Delta Live Table
Data Science
Unity Catalog
BI/DW/DBSQL

Assets available in the Databricks demo