Edit online

Site AI Threads

The AI Threads page provides an overview of initial messages that users have sent to the AI Assistant on the current site. Users with an Owner, Admin, or Moderator role have access to this page.

Filtering Threads

You can filter AI threads using several options:

  • You can click on the status filter buttons to view threads based on the category:
    • Useful - Helpful or informative messages.
    • Not Useful - Messages deemed to be unhelpful.
    • Inaccurate - Messages flagged by the AI Assistant for containing inaccurate or irrelevant information.
    • Error - Cases where the AI Assistant failed to respond correctly.
    • All - Displays all messages.
  • You can use the drop-down menus to the right of the filter buttons to filter threads by specific site versions or a time frame.
  • You can enter keywords in the search field to search for specific content within threads.

Thread Indicators

Each message includes tags on the right side to indicate its assessment:

  • Useful- The message is helpful or informative.
  • Not Useful - The message lacks helpful information.
  • Inaccurate - The message contains unrelated information according to the AI Assistant.
  • Error - The AI Assistant encountered an issue and failed to provide a valid response.

Reviewing Threads

To review an individual thread:

  1. Locate the desired message in the list.
  2. Click the View Thread button next to the message.
  3. Access the full conversation to review user interactions and take appropriate actions.

AI Assistant Conversation Details

Clicking the View Thread button opens a new page that displays the full conversation with the AI Assistant. This page provides a detailed view of the interaction between the user and the AI Assistant, along with context and analysis to help administrators evaluate the AI Assistant's performance. Key features include:

Header Information
The header at the top of the page contains essential details about the conversation:
  • Date and Time - When the interaction occurred.
  • Site Version - The version of your site where the conversation took place, allowing you to track changes across different versions.
Response Summary
A quick overview of the AI Assistant's replies is displayed, breaking down the interaction into these categories:
  • Total Responses - The total number of replies from the assistant.
  • Useful Responses - Messages categorized as helpful or informative.
  • Not Useful Responses - Messages that lacked helpful information.
  • Inaccurate Responses - Replies that contain unrelated information according to the AI Assistant.
  • Errors - Instances where the AI Assistant encountered an issue and failed to provide a valid response.
Interaction Insights
Gain a deeper understanding of the user's experience:
  • User Input - Review the questions or statements provided by the user.
  • AI Responses - See the AI Assistant’s replies and evaluate their accuracy and relevance.
  • Referenced Documentation - Identify the topics from your documentation that the AI Assistant cited in its responses.
Actionable Insights
Use this detailed view to assess the quality of the AI Assistant's performance, identify trends in user queries, and improve responses by updating your documentation or AI settings.