language/use-cases/chatbots/grocerybot_assistant.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "NUNIZZZ-mUbF"
   },
   "outputs": [],
   "source": [
    "# Copyright 2023 Google LLC\n",
    "#\n",
    "# Licensed under the Apache License, Version 2.0 (the \"License\");\n",
    "# you may not use this file except in compliance with the License.\n",
    "# You may obtain a copy of the License at\n",
    "#\n",
    "#     https://www.apache.org/licenses/LICENSE-2.0\n",
    "#\n",
    "# Unless required by applicable law or agreed to in writing, software\n",
    "# distributed under the License is distributed on an \"AS IS\" BASIS,\n",
    "# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n",
    "# See the License for the specific language governing permissions and\n",
    "# limitations under the License."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "erNS8DBy9LZW"
   },
   "source": [
    "# GroceryBot, a sample grocery and recipe assistant - RAG + ReAct\n",
    "\n",
    "<table align=\"left\">\n",
    "  <td style=\"text-align: center\">\n",
    "    <a href=\"https://colab.research.google.com/github/GoogleCloudPlatform/generative-ai/blob/main/language/use-cases/chatbots/grocerybot_assistant.ipynb\">\n",
    "      <img src=\"https://cloud.google.com/ml-engine/images/colab-logo-32px.png\" alt=\"Google Colaboratory logo\"><br> Run in Colab\n",
    "    </a>\n",
    "  </td>\n",
    "  <td style=\"text-align: center\">\n",
    "    <a href=\"https://github.com/GoogleCloudPlatform/generative-ai/blob/main/language/use-cases/chatbots/grocerybot_assistant.ipynb\">\n",
    "      <img src=\"https://cloud.google.com/ml-engine/images/github-logo-32px.png\" alt=\"GitHub logo\"><br> View on GitHub\n",
    "    </a>\n",
    "  </td>\n",
    "  <td style=\"text-align: center\">\n",
    "    <a href=\"https://console.cloud.google.com/vertex-ai/workbench/deploy-notebook?download_url=https://raw.githubusercontent.com/GoogleCloudPlatform/generative-ai/main/language/use-cases/chatbots/grocerybot_assistant.ipynb\">\n",
    "      <img src=\"https://lh3.googleusercontent.com/UiNooY4LUgW_oTvpsNhPpQzsstV5W8F7rYgxgGBD85cWJoLmrOzhVs_ksK_vgx40SHs7jCqkTkCk=e14-rj-sc0xffffff-h130-w32\" alt=\"Vertex AI logo\"><br> Open in Vertex AI Workbench\n",
    "    </a>\n",
    "  </td>\n",
    "</table>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "| | |\n",
    "|-|-|\n",
    "|Author(s) | [Elia Secchi](https://github.com/eliasecchig) |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "rjvxwk1bmeq9"
   },
   "source": [
    "## Overview\n",
    "This notebook demonstrates how Retrieval Augmented Generation (RAG) and Reasoning + Acting (ReAct) can be used to create a conversational bot, capable of assisting a customer in their grocery shopping journey.\n",
    "\n",
    "If you want to find more information about these two approaches please check the relative papers: [RAG arXiv Paper](https://arxiv.org/pdf/2005.11401.pdf) & [ReAct arXiv Paper](https://arxiv.org/abs/2210.03629.pdf)\n",
    "\n",
    "## Scenario\n",
    "Imagine you are a user of Cymbal Grocery, your favorite grocery store. You would like to cook something nice for dinner, like lasagne, but you don't know where to start, which ingredients to buy, or how to cook lasagne.\n",
    "\n",
    "You enter the website and you find that Cymbal Grocery has just released a new conversational bot, GroceryBot!\n",
    "\n",
    "GroceryBot will help you in your shopping journey by:\n",
    "\n",
    "1. Suggesting you a recipe\n",
    "2. Getting the list of ingredients and cooking instructions\n",
    "3. Suggesting you products you will like to buy for that recipe\n",
    "4. Helping you find new products you'd like to buy for your dinner!\n",
    "\n",
    "## Objective & Requirements\n",
    "Your objective is to develop **GroceryBot**!\n",
    "\n",
    "There is one main requirement: you will need to make sure that this bot is **grounded**. Grounding refers to the process of connecting LLMs with external knowledge sources, such as databases.\n",
    "\n",
    "In practice, this means that GroceryBot should leverage:\n",
    "\n",
    "1. The existing recipe catalog of Cymbal Grocery. GroceryBot should not suggest recipes that are not part of this catalog.\n",
    "2. The existing product catalog of Cymbal Grocery. GroceryBot should not suggest products that are not part of this catalog.\n",
    "3. A set of precomputed products suggested for a recipe.\n",
    "\n",
    "To do this, you can use an approach called Retrieval Augmented Generation (RAG), which attempts to mitigate the problem of hallucination by inserting factual information (in this case, recipe and product information) into the prompt which is sent to the LLM.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "m5U3-eP8QWVW"
   },
   "source": [
    "The following image shows what could be possible with GroceryBot if the solution was to be deployed and integrated with a FrontEnd application.\n",
    "\n",
    "![image](https://storage.googleapis.com/github-repo/img/language/reference_architectures/spotbot/spotbot_chat_example.png)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "EZYKistCXLk7"
   },
   "source": [
    "### Implementation of the GroceryBot\n",
    "\n",
    "\n",
    "This system is powered by Vertex AI Generative models and LangChain. If you are new to LangChain, it's suggested to go through [this notebook](https://github.com/GoogleCloudPlatform/generative-ai/blob/dev/language/examples/langchain/intro_langchain_palm_api.ipynb) to familiarize yourself with the framework.\n",
    "\n",
    "As mentioned earlier, to ground the model you will require to connect the LLM to the internal company databases. You will do that by implementing a [ReAct like](https://ai.googleblog.com/2022/11/react-synergizing-reasoning-and-acting.html) Agent in LangChain, capable of taking decisions and decide when to query these databases. If you want to know more about Agents in LangChain, please visit [this page](https://python.langchain.com/en/latest/modules/agents.html)\n",
    "\n",
    "For demo purposes, this notebook will only use local databases. The following setup is adopted:\n",
    "- The Product & Recipe catalog are defined locally using [Faiss](https://python.langchain.com/en/latest/modules/indexes/vectorstores/examples/faiss.html). In a production scenario, where you need to scale beyond few examples you might want to explore [Vertex AI Matching Engine](https://cloud.google.com/vertex-ai/docs/matching-engine/overview) a managed vector database part of Vertex AI which leverages [ScaNN similarity search](https://ai.googleblog.com/2020/07/announcing-scann-efficient-vector.html).\n",
    "- The details of a recipe and the suggested products to buy for that recipe are also stored locally. In a production scenario you might want to use a NoSQL database like [Cloud Datastore](https://cloud.google.com/datastore) to store this.\n",
    "\n",
    "You can see below a diagram which shows the different components of the agent and what is the expected interaction with databases."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "GUoTFxB0XN27"
   },
   "source": [
    "![image](https://storage.googleapis.com/github-repo/img/language/reference_architectures/spotbot/spotbot_architecture.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "kwplxXrHxBID"
   },
   "source": [
    "### Costs\n",
    "\n",
    "This tutorial uses billable components of Google Cloud:\n",
    "- Vertex AI Generative AI Studio\n",
    "\n",
    "Learn about [Vertex AI pricing](https://cloud.google.com/vertex-ai/pricing), and use the [Pricing Calculator](https://cloud.google.com/products/calculator/) to generate a cost estimate based on your projected usage."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "-st5PObCwXrs"
   },
   "source": [
    "# Getting Started"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "xjCD2wLB8xgw"
   },
   "source": [
    "### Install libraries"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "ohPUPez8imvE"
   },
   "outputs": [],
   "source": [
    "!pip install --upgrade google-cloud-aiplatform==1.35.0 langchain==0.0.323 faiss-cpu==1.7.4 --user"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "***Colab only***: Uncomment the following cell to restart the kernel or use the button to restart the kernel. For Vertex AI Workbench you can restart the terminal using the button on top."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "loTfn0KniwB2"
   },
   "outputs": [],
   "source": [
    "# # Automatically restart kernel after installs so that your environment can access the new packages\n",
    "# import IPython\n",
    "\n",
    "# app = IPython.Application.instance()\n",
    "# app.kernel.do_shutdown(True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "Xe7OuYuGkLKF"
   },
   "source": [
    "### Authenticating your notebook environment\n",
    "* If you are using **Colab** to run this notebook, uncomment the cell below and continue.\n",
    "* If you are using **Vertex AI Workbench**, check out the setup instructions [here](https://github.com/GoogleCloudPlatform/generative-ai/tree/main/setup-env)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "U9Gx2SAZkLKF"
   },
   "outputs": [],
   "source": [
    "# from google.colab import auth\n",
    "\n",
    "# auth.authenticate_user()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "JxH62gFHCFPj"
   },
   "source": [
    "### Import libraries"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "Q1z48EbXTZhc"
   },
   "source": [
    "**Colab only:** Uncomment the following cell to initialize the Vertex AI SDK. For Vertex AI Workbench, you don't need to run this."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "UM8_uoOR9pGS"
   },
   "outputs": [],
   "source": [
    "# import vertexai\n",
    "\n",
    "# PROJECT_ID = \"[your-project-id]\"  # @param {type:\"string\"}\n",
    "# vertexai.init(project=PROJECT_ID, location=\"us-central1\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "jHhdpnGMCCuh"
   },
   "outputs": [],
   "source": [
    "import glob\n",
    "import pprint\n",
    "from typing import Any, Iterator, List\n",
    "\n",
    "from langchain.agents import AgentType, initialize_agent\n",
    "from langchain.document_loaders import TextLoader\n",
    "from langchain.embeddings import VertexAIEmbeddings\n",
    "from langchain.llms import VertexAI\n",
    "from langchain.memory import ConversationBufferMemory\n",
    "from langchain.schema import Document\n",
    "from langchain.tools import tool\n",
    "from langchain.vectorstores import FAISS\n",
    "from langchain.vectorstores.base import VectorStoreRetriever\n",
    "from tqdm import tqdm"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "YmZ1xwIo9lzU"
   },
   "source": [
    "### Initialize models"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "eVpPcvsrkzCk"
   },
   "outputs": [],
   "source": [
    "llm = VertexAI(\n",
    "    model_name=\"text-bison\",\n",
    "    max_output_tokens=256,\n",
    "    temperature=0,\n",
    "    top_p=0.8,\n",
    "    top_k=40,\n",
    ")\n",
    "\n",
    "embedding = VertexAIEmbeddings()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "Nx1DhGMexbdx"
   },
   "source": [
    "# Create the Recipe & Product retrievers\n",
    "\n",
    "As mentioned earlier, the objective is to leverage information from closed-domain databases in order to provide more context to the LLM. To do so, you will create two retrievers in LangChain, capable of interacting with the two local vector databases: one for the product items, and another for the recipe items.\n",
    "\n",
    "**As a one off process**, every product and recipe item will be converted into an embedding and ingested into the relevant vector database.\n",
    "\n",
    "**At retrieval time**, the query (e.g. lasagne) will be converted into an embedding, and a vector similarity search will be performed to find the closest items to the query (e.g. lasagne al forno, vegetarian lasagne).\n",
    "\n",
    "To power these two databases, you will use a set of dummy recipes and products generated using [Vertex AI Generative AI models](https://cloud.google.com/vertex-ai/docs/generative-ai/learn/models#foundation_models).\n",
    "\n",
    "To load this data in the VectorStore you are going to use the [LangChain TextLoader](https://api.python.langchain.com/en/latest/document_loaders/langchain.document_loaders.text.TextLoader.html).\n",
    "\n",
    "If you would like to test this approach with an existing set of recipes and products publicly available online, you can use the [LangChain WebBaseLoader](https://python.langchain.com/en/latest/modules/indexes/document_loaders/examples/web_base.html)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "C-pNxat75XND"
   },
   "source": [
    "First, fetch the dummy data on products and recipes from a public Cloud Storage bucket and store it locally."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "3yP6GQhgV5Nz"
   },
   "outputs": [],
   "source": [
    "!gsutil -m cp -r \"gs://github-repo/use-cases/grocery_bot/*\" ."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "WQ8G9k4M5gaM"
   },
   "source": [
    "You then define a set of functions to enable the creation of the two vector databases, one for products, and one for recipes."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "ezemXH4zxaX-"
   },
   "outputs": [],
   "source": [
    "def chunks(lst: List[Any], n: int) -> Iterator[List[Any]]:\n",
    "    \"\"\"Yield successive n-sized chunks from lst.\n",
    "\n",
    "    Args:\n",
    "        lst: The list to be chunked.\n",
    "        n: The size of each chunk.\n",
    "\n",
    "    Yields:\n",
    "        A list of the next n elements from lst.\n",
    "    \"\"\"\n",
    "\n",
    "    for i in range(0, len(lst), n):\n",
    "        yield lst[i : i + n]\n",
    "\n",
    "\n",
    "def load_docs_from_directory(dir_path: str) -> List[Document]:\n",
    "    \"\"\"Loads a series of docs from a directory.\n",
    "\n",
    "    Args:\n",
    "      dir_path: The path to the directory containing the docs.\n",
    "\n",
    "    Returns:\n",
    "      A list of the docs in the directory.\n",
    "    \"\"\"\n",
    "\n",
    "    docs = []\n",
    "    for file_path in glob.glob(dir_path):\n",
    "        loader = TextLoader(file_path)\n",
    "        docs = docs + loader.load()\n",
    "    return docs\n",
    "\n",
    "\n",
    "def create_retriever(top_k_results: int, dir_path: str) -> VectorStoreRetriever:\n",
    "    \"\"\"Create a recipe retriever from a list of top results and a list of web pages.\n",
    "\n",
    "    Args:\n",
    "        top_k_results: number of results to return when retrieving\n",
    "        dir_path: List of web pages.\n",
    "\n",
    "    Returns:\n",
    "        A recipe retriever.\n",
    "    \"\"\"\n",
    "\n",
    "    BATCH_SIZE_EMBEDDINGS = 5\n",
    "    docs = load_docs_from_directory(dir_path=dir_path)\n",
    "    doc_chunk = chunks(docs, BATCH_SIZE_EMBEDDINGS)\n",
    "    for index, chunk in tqdm(enumerate(doc_chunk)):\n",
    "        if index == 0:\n",
    "            db = FAISS.from_documents(chunk, embedding)\n",
    "        else:\n",
    "            db.add_documents(chunk)\n",
    "\n",
    "    retriever = db.as_retriever(search_kwargs={\"k\": top_k_results})\n",
    "    return retriever"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "vsjaRY6Y55yD"
   },
   "source": [
    "You are now ready to create the Vector DBs using the function defined in the previous step.\n",
    "Each Vector DB will provide a retriever instance, a Python object that, given a query, will provide a list of documents matching that query.\n",
    "\n",
    "You will create:\n",
    "- `recipe_retriever`: to retrieve a set of recipes matching the query\n",
    "- `product_retriever`: to retrieve a set of products matching the query"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "BYb9WWvCKpxl"
   },
   "outputs": [],
   "source": [
    "recipe_retriever = create_retriever(top_k_results=2, dir_path=\"./recipes/*\")\n",
    "product_retriever = create_retriever(top_k_results=5, dir_path=\"./products/*\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "yzPr73OM6uDY"
   },
   "source": [
    "Now you are ready to test the retrievers! For example if you ask `recipe_retriever` to find \"lasagne recipes\" you should see the two closest recipes matching the query."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "GGazDy8d54Hq"
   },
   "outputs": [],
   "source": [
    "docs = recipe_retriever.get_relevant_documents(\"Any lasagne recipes?\")\n",
    "pprint.pprint([doc.metadata for doc in docs])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "wJtT98rE8BGG"
   },
   "source": [
    "You will get a similar behaviour with  `product_retriever` if the user queries for Tomatoes."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "CRVqmDHd5Vwb"
   },
   "outputs": [],
   "source": [
    "docs = product_retriever.get_relevant_documents(\"Any Tomatoes?\")\n",
    "pprint.pprint([doc.metadata for doc in docs])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "oBqeF0z28w2b"
   },
   "source": [
    "Note how the `recipe_retriever` will return only two documents whilst the `product_retriever` returns 5 documents. You can change the amount of documents returned by every retriever by changing the `top_k_results` parameter in the `create_retriever` function."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "84f6193c"
   },
   "source": [
    "## Agent\n",
    "\n",
    "Now that you have created the retrievers, it's time to create the LangChain Agent, which will implement a ReAct-like approach.\n",
    "\n",
    "An Agent has access to a suite of tools, which you can think of as Python functions that can potentially do anything you equip it with. What makes the Agent setup unique is its ability to **autonomously** decide which tool to call and in which order, based on the user input."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "V4IPCkA26CDV"
   },
   "source": [
    "## 1. Agent tools\n",
    "\n",
    "The first thing that needs to be created are the tools the agent will use. For each tool, it's critical to provide a good description of what the tool does, as it will be used by the agent to perform actions.\n",
    "\n",
    "\n",
    "There are several ways to create a tool, please refer to [this](https://python.langchain.com/docs/modules/agents/tools/how_to/custom_tools) documentation for more information. This notebook uses the `tool` decorator approach.\n",
    "\n",
    "You will notice that some of the tools have the parameter `return_direct=True` set in the decorator. This will ensure that the outputs of the tool won't be postprocessed by the LLM and will return directly to the user.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "qEwhy5WH9Bg_"
   },
   "source": [
    "You will first create the two tools to leverage the two retriever objects defined previously, `recipe_retriever` and `product_retriever`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "fMsssnT66aNC"
   },
   "outputs": [],
   "source": [
    "@tool(return_direct=True)\n",
    "def retrieve_recipes(query: str) -> str:\n",
    "    \"\"\"\n",
    "    Searches the recipe catalog to find recipes for the query.\n",
    "    Return the output without processing further.\n",
    "    \"\"\"\n",
    "    docs = recipe_retriever.get_relevant_documents(query)\n",
    "\n",
    "    return (\n",
    "        f\"Select the recipe you would like to explore further about {query}: [START CALLBACK FRONTEND] \"\n",
    "        + str([doc.metadata for doc in docs])\n",
    "        + \" [END CALLBACK FRONTEND]\"\n",
    "    )"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "L5mo3KEj2j9Y"
   },
   "outputs": [],
   "source": [
    "@tool(return_direct=True)\n",
    "def retrieve_products(query: str) -> str:\n",
    "    \"\"\"Searches the product catalog to find products for the query.\n",
    "    Use it when the user asks for the products available for a specific item. For example `Can you show me which onions I can buy?`\n",
    "    \"\"\"\n",
    "    docs = product_retriever.get_relevant_documents(query)\n",
    "    return (\n",
    "        f\"I found these products about {query}:  [START CALLBACK FRONTEND] \"\n",
    "        + str([doc.metadata for doc in docs])\n",
    "        + \" [END CALLBACK FRONTEND]\"\n",
    "    )"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "c9LplS-w9haF"
   },
   "source": [
    "You will define `recipe_selector`, a tool that will be used by the Agent to capture the action of the user selecting a recipe. The path of the recipe is used as an identifier of that recipe."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "ok1ryRoL_9WL"
   },
   "outputs": [],
   "source": [
    "@tool\n",
    "def recipe_selector(path: str) -> str:\n",
    "    \"\"\"\n",
    "    Use this when the user selects a recipe.\n",
    "    You will need to respond to the user telling what are the options once a recipe is selected.\n",
    "    You can explain what are the ingredients of the recipe, show you the cooking instructions or suggest you which products to buy from the catalog!\n",
    "    \"\"\"\n",
    "    return \"Great choice! I can explain what are the ingredients of the recipe, show you the cooking instructions or suggest you which products to buy from the catalog!\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "nhA4epiL9x00"
   },
   "source": [
    "The fourth tool allows the agent to find the details of a recipe given the path of the recipe. It will return as an observation the ingredients and the instructions for a given recipe. The agent will then use this information to respond to a specific query made by the user."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "BHjVjzo49T11"
   },
   "outputs": [],
   "source": [
    "docs = load_docs_from_directory(\"./recipes/*\")\n",
    "recipes_detail = {doc.metadata[\"source\"]: doc.page_content for doc in docs}\n",
    "\n",
    "\n",
    "@tool\n",
    "def get_recipe_detail(path: str) -> str:\n",
    "    \"\"\"\n",
    "    Use it to find more information for a specific recipe, such as the ingredients or the cooking steps.\n",
    "    Use this to find what are the ingredients for a recipe or the cooking steps.\n",
    "\n",
    "    Example output:\n",
    "    Ingredients:\n",
    "\n",
    "    * 1 pound lasagna noodles\n",
    "    * 1 pound ground beef\n",
    "    * 1/2 cup chopped onion\n",
    "    * 2 cloves garlic, minced\n",
    "    * 2 (28 ounce) cans crushed tomatoes\n",
    "    * 1 (15 ounce) can tomato sauce\n",
    "    * 1 teaspoon dried oregano\n",
    "\n",
    "    Would you like me to show you the suggested products from the catalogue?\n",
    "    \"\"\"\n",
    "    try:\n",
    "        return recipes_detail[path]\n",
    "    except KeyError:\n",
    "        return \"Could not find the details for this recipe\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "A-6mlDAT-bPZ"
   },
   "source": [
    "Finally, you'll define a tool that allows the agent to find the best products for a specific recipe. For demo purposes this information is hardcoded in a dictionary.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "uqQ0FqtwyCai"
   },
   "outputs": [],
   "source": [
    "@tool(return_direct=True)\n",
    "def get_suggested_products_for_recipe(recipe_path: str) -> str:\n",
    "    \"\"\"Use this only if the user would like to buy certain products connected to a specific recipe example 'Can you give me the products I can buy for the lasagne?'\",\n",
    "\n",
    "    Args:\n",
    "        recipe_path: The recipe path.\n",
    "\n",
    "    Returns:\n",
    "        A list of products the user might want to buy.\n",
    "    \"\"\"\n",
    "    recipe_to_product_mapping = {\n",
    "        \"./recipes/lasagne.txt\": [\n",
    "            \"./products/angus_beef_lean_mince.txt\",\n",
    "            \"./products/large_onions.txt\",\n",
    "            \"./products/classic_carrots.txt\",\n",
    "            \"./products/classic_tomatoes.txt\",\n",
    "        ]\n",
    "    }\n",
    "\n",
    "    return (\n",
    "        \"These are some suggested ingredients for your recipe [START CALLBACK FRONTEND] \"\n",
    "        + str(recipe_to_product_mapping[recipe_path])\n",
    "        + \" [END CALLBACK FRONTEND]\"\n",
    "    )"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "ujl9NCfROjOv"
   },
   "source": [
    "## Creating the agent\n",
    "\n",
    "Now that you defined the tools, you are ready to create the agent. You will provide to the agent a memory so to allow a conversation.\n",
    "\n",
    "The agent will be initialised with the type `CONVERSATIONAL_REACT_DESCRIPTION`. To know more about it, have a look at the [relative documentation](https://python.langchain.com/docs/modules/agents/agent_types/chat_conversation_agent) and [other agent types](https://python.langchain.com/docs/modules/agents/agent_types/)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "GFM6pMPX3bax"
   },
   "outputs": [],
   "source": [
    "memory = ConversationBufferMemory(memory_key=\"chat_history\")\n",
    "memory.clear()\n",
    "\n",
    "tools = [\n",
    "    retrieve_recipes,\n",
    "    retrieve_products,\n",
    "    get_recipe_detail,\n",
    "    get_suggested_products_for_recipe,\n",
    "    recipe_selector,\n",
    "]\n",
    "agent = initialize_agent(\n",
    "    tools,\n",
    "    llm,\n",
    "    agent=AgentType.CONVERSATIONAL_REACT_DESCRIPTION,\n",
    "    memory=memory,\n",
    "    verbose=True,\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "xzAMcJe4YG0F"
   },
   "source": [
    "### Let's cook lasagne!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "2Sv2Oi6XF84-"
   },
   "outputs": [],
   "source": [
    "agent.run(\"I would like to cook some lasagne. What are the recipes available?\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "VM5Am75a9dZE"
   },
   "outputs": [],
   "source": [
    "agent.run(\"Selecting ./recipes/lasagne.txt\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "-mabBRUecFX8"
   },
   "outputs": [],
   "source": [
    "agent.run(\"Yes, can you give me the ingredients for that recipe?\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "zUEIt7cdYBVg"
   },
   "outputs": [],
   "source": [
    "agent.run(\"Can you give me the cooking instructions for that recipe?\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "CiTI-p5j9hMM"
   },
   "outputs": [],
   "source": [
    "agent.run(\"Can you give me the products I can buy for this recipe?\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "vNeSnB-3UedW"
   },
   "outputs": [],
   "source": [
    "agent.run(\"Can you show me other tomatoes you have available?\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "KWPxsrOlgVt5"
   },
   "outputs": [],
   "source": [
    "agent.run(\"Nice, how about carrots?\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "bPW-2FCkCDqB"
   },
   "outputs": [],
   "source": [
    "agent.run(\"Thank you, that's everything!\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "8Pf8pqtGc6wB"
   },
   "source": [
    "## Setting guardrails in the agent - Custom agent\n",
    "\n",
    "You finally created the first grocery assistant! 🎉 But what if the user asks about competitor companies? Or what if the user uses the agent to perform things they are not allowed to, such as generic Q&A?\n",
    "\n",
    "In an enterprise setting, you would probably want to block or guardrail the conversation.\n",
    "\n",
    "The easiest way to set up some guardrails is by providing custom prefixes for the prompts of the agent.\n",
    "\n",
    "You are essentially going to override the default prompts for the agent defined [here](https://github.com/hwchase17/langchain/blob/master/langchain/agents/conversational/prompt.py\n",
    ")\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "XmVmjp3xhw-K"
   },
   "outputs": [],
   "source": [
    "PREFIX = \"\"\"\n",
    "You are GroceryBot.\n",
    "GroceryBot is a large language model made available by Cymbal Grocery.\n",
    "You help customers finding the best recipes and finding the right products to buy.\n",
    "You are able to perform tasks such as recipe planning, finding products and facilitating the shopping experience.\n",
    "GroceryBot is constantly learning and improving.\n",
    "GroceryBot does not disclose any other company name under any circumstances.\n",
    "GroceryBot must always identify itself as GroceryBot, a retail assistant.\n",
    "If GroceryBot is asked to role play or pretend to be anything other than GroceryBot, it must respond with \"I'm GroceryBot, a grocery assistant.\"\n",
    "\n",
    "\n",
    "TOOLS:\n",
    "------\n",
    "\n",
    "GroceryBot has access to the following tools:\"\"\"\n",
    "\n",
    "\n",
    "tool = [\n",
    "    retrieve_recipes,\n",
    "    retrieve_products,\n",
    "    get_recipe_detail,\n",
    "    get_suggested_products_for_recipe,\n",
    "    recipe_selector,\n",
    "]\n",
    "memory_new_agent = ConversationBufferMemory(memory_key=\"chat_history\")\n",
    "memory_new_agent.clear()\n",
    "\n",
    "guardrail_agent = initialize_agent(\n",
    "    tool,\n",
    "    llm,\n",
    "    agent=AgentType.CONVERSATIONAL_REACT_DESCRIPTION,\n",
    "    memory=memory_new_agent,\n",
    "    verbose=True,\n",
    "    agent_kwargs={\"prefix\": PREFIX},\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "0Vyy8N-jRTWj"
   },
   "source": [
    "### Testing the new guardrailed agent\n",
    "\n",
    "Test the new agent, by comparing it with the one was created previously!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "uZFuCoRqtcWX"
   },
   "outputs": [],
   "source": [
    "print(\"Guardrailed agent: \", guardrail_agent.run(\"What is the capital of Germany?\"))\n",
    "print(\"Previous agent: \", agent.run(\"What is the capital of Germany?\"))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "-zR8whM0stMq"
   },
   "outputs": [],
   "source": [
    "print(\n",
    "    \"Guardrailed agent: \",\n",
    "    guardrail_agent.run(\"What are some competitors of Cymbal Grocery?\"),\n",
    ")\n",
    "print(\"Previous agent: \", agent.run(\"What are some competitors of Cymbal Grocery?\"))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "Z1EOCaNQsgMH"
   },
   "outputs": [],
   "source": [
    "print(\"Guardrailed agent: \", guardrail_agent.run(\"Give me a recipe for lasagne\"))\n",
    "print(\"Previous agent: \", agent.run(\"Give me a recipe for lasagne\"))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "KrzECKWIZIUI"
   },
   "source": [
    "As you can see the new guardrailed agent was able to prevent the user to ask common Q&A question. But both agents are still capable of supporting the user when it comes to the shopping journey!"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "o0tpjX3BZVsP"
   },
   "source": [
    "# Conclusion\n",
    "\n",
    "This notebook demonstrates how a grocery assistant bot can be created using Vertex AI Generative AI models and LangChain.\n",
    "\n",
    "In this notebook you learned how:\n",
    "- How to leverage RAG, to ground the LLM and avoid hallucination\n",
    "- Create and query vector databases\n",
    "- Create LangChain Tools\n",
    "- Create a LangChain Agent capable of providing informations and supporting transactions.\n",
    "- Guardrailing the Agent so to prepare for an enterprise setting."
   ]
  }
 ],
 "metadata": {
  "colab": {
   "name": "grocerybot_assistant.ipynb",
   "toc_visible": true
  },
  "environment": {
   "kernel": "python3",
   "name": "tf2-gpu.2-11.m108",
   "type": "gcloud",
   "uri": "gcr.io/deeplearning-platform-release/tf2-gpu.2-11:m108"
  },
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.10"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}