|
@@ -1,5 +1,29 @@
|
|
|
{
|
|
|
"cells": [
|
|
|
+ {
|
|
|
+ "cell_type": "markdown",
|
|
|
+ "id": "47a9adb3",
|
|
|
+ "metadata": {},
|
|
|
+ "source": [
|
|
|
+ "## This demo app shows how to query Llama 2 using the Gradio UI.\n",
|
|
|
+ "\n",
|
|
|
+ "Since we are using Replicate in this example, you will need to replace `<your replicate api token>` with your API token.\n",
|
|
|
+ "\n",
|
|
|
+ "To get the Replicate token: \n",
|
|
|
+ "\n",
|
|
|
+ "- You will need to first sign in with Replicate with your github account\n",
|
|
|
+ "- Then create a free API token [here](https://replicate.com/account/api-tokens) that you can use for a while. \n",
|
|
|
+ "\n",
|
|
|
+ "**Note** After the free trial ends, you will need to enter billing info to continue to use Llama2 hosted on Replicate.\n",
|
|
|
+ "\n",
|
|
|
+ "To tun this example:\n",
|
|
|
+ "- Set up your Replicate API token and enter it in place of `<your replicate api token>`\n",
|
|
|
+ "- Run the notebook\n",
|
|
|
+ "- Enter your question and click Submit\n",
|
|
|
+ "\n",
|
|
|
+ "In the notebook or a browser with URL http://127.0.0.1:7860 you should see a UI with your answer."
|
|
|
+ ]
|
|
|
+ },
|
|
|
{
|
|
|
"cell_type": "code",
|
|
|
"execution_count": 1,
|