Skip to main content

Review search results

The Search tab on a knowledge detail screen shows search results without generating an AI answer. After adding documents, test whether the expected content is retrieved. This separates troubleshooting of retrieval from answer generation.

Relevant search results do not guarantee an accurate AI answer. In Chat, compare the answer with the cited source again.

Screenshot TODO

Capture: Search term, search method, result count, and score threshold together with results showing scores and sources.

  1. Open the knowledge and select the Search tab.
  2. Enter a search term.
  3. Review the current search method, result count, and score threshold.
  4. If needed, select the documents to search.
  5. Run the search.
  6. Review the document name, contents, and relevance score for the top results.

Compare search methods

Available search methods depend on the settings selected when the knowledge was created.

MethodBehaviorQuestion to check
SemanticFinds document chunks with similar meaning.Does a relevant document appear even when the query uses different wording?
KeywordFinds document chunks containing the entered words.Does the document containing the proper noun or exact term appear?
HybridCombines semantic and keyword search results.Do results from both methods appear in the required order?

Run the same term with each method and compare the results.

Adjust result count and score threshold

Top-K sets the maximum number of displayed results. Increasing it provides more results to compare but may include less relevant results.

The score threshold sets the minimum relevance score displayed. Raising it reduces the number of results; lowering it displays more. Score calculation differs by search method, so the same value does not always have the same meaning.

Search with the current on-screen values first. If a required document is missing, lower the threshold or increase the result count. If many irrelevant results appear, raise the threshold gradually.

When the expected result is missing

CheckAction
The required document is not in the knowledgeAdd the document.
Document processing is incompleteReview processing status on the Documents tab.
An exact term is not retrievedReview keyword search results.
Similar wording is not retrievedReview semantic search results.
Result chunks are too short or too longReview the source document and chunking settings.
Only one document should be checkedLimit search scope with the document filter.

To split an existing document with different chunking settings, delete it and add it again with the required settings. Reindex reuses the settings already stored on the document. See Apply different chunking settings to an existing document for selection guidance and scope.

Use the full reset in Change knowledge settings only when changing the search method or embedding model. A full reset deletes every document and chunk in the knowledge.

Troubleshoot together with AI Chat

If an AI answer differs from what you expect, check in this order.

  1. Confirm that the answer's citations are relevant to the question.
  2. Run the same question on the Search tab.
  3. If the relevant document is not retrieved, review the document, search method, and chunking settings.
  4. If the document is retrieved but the answer is wrong, compare another model and use the source as the authority.

Both retrieval and answer generation can cause an error.

Next tasks