Use collections to store conversations

[ozanarmagan]

Use collection to store conversations

To use a collection to store conversations, first create a collection with given schema:

{
    "name": "conversation_store",
    "fields": [
        {
            "name": "conversation_id",
            "type": "string",
            "facet": true
        },
        {
            "name": "role",
            "type": "string"
        },
        {
            "name": "message",
            "type": "string"
        },
        {
            "name": "timestamp",
            "type": "int32",
            "sort": true
        }
    ]
}

Set conversation history collection for conversation model

curl 'http://localhost:8108/conversations/models' \
  -X POST \
  -H 'Content-Type: application/json' \
  -H "X-TYPESENSE-API-KEY: ${TYPESENSE_API_KEY}" \
  -d '{
        "model_name": "openai/gpt-3.5-turbo",
        "api_key": "OPENAI_API_KEY",
        "system_prompt": "You are an assistant for question-answering. You can only make conversations based on the provided context. If a response cannot be formed strictly using the provided context, politely say you don’t have knowledge about that topic."
        "max_bytes": 16384,
        "conversation_history": "conversation_store"
      }'