Semantic Index Configuration form
Summarize
Summary of Semantic Index Configuration form
The Semantic Index Configuration form in ServiceNow allows you to define semantic indexing settings for an AI Search indexed source. This configuration is essential for enabling semantic vector search capabilities, improving search relevance by understanding the meaning of content rather than relying solely on keyword matching. The form is only available when the AI Search Semantic Controller plugin is active, which requires at least one Now Assist application installed on your instance.
Show less
Key Features
- Name: Assign a unique name to your semantic index configuration. This name must avoid special characters, underscores, or whitespace for compatibility.
- Embedding Models: Choose from several embedding models to encode content semantics:
- ServiceNow Embedding (E5): Default model with a 512-term encoder limit.
- Azure OpenAI Embedding: External fine-tuned model option.
- Google Gemini Embedding: External fine-tuned model option.
- Custom Embedding: Use your own fine-tuned embedding model.
- Active: Toggle to activate or deactivate the semantic index configuration. Only active configurations are used during AI Search indexing.
- Indexed Source: Automatically references the AI Search indexed source to which the configuration applies.
- Application: Automatically sets the application scope for the configuration record.
- Chunking Configuration: Defines how text is divided into chunks for embedding processing, critical for optimizing semantic search performance:
- Chunking Strategy: Choose from Passage, Truncate, or Full Text based on text length and indexing needs.
- Passage: Suitable for longer text, breaks content into manageable chunks with overlap options.
- Truncate: Concatenates short text fields and indexes up to a maximum total words limit.
- Full Text: Concatenates short text fields and indexes all terms up to the embedding model’s encoder limit.
- Overlap Sentences: Number of overlapping sentences between chunks (only for Passage strategy), balancing between recall and performance.
- Chunk Unit: Defines whether chunks are measured in words or sentences (only for Passage strategy).
- Chunk Size: Maximum number of words or sentences per chunk (only for Passage strategy).
- Maximum Total Words: Limit on the total number of words indexed when using the Truncate strategy.
- Chunking Strategy: Choose from Passage, Truncate, or Full Text based on text length and indexing needs.
Practical Implications for ServiceNow Customers
By configuring semantic indexing settings appropriately, you can tailor AI Search to better understand and retrieve relevant content from your indexed sources. Selecting the right embedding model and chunking strategy enables optimized search performance and result accuracy based on your data characteristics. Activating and managing these configurations properly ensures your AI Search indexes include meaningful semantic vectors, enhancing knowledge discovery and user experience within your ServiceNow environment.
The Semantic Index Configuration form enables you to define semantic indexing settings for an AI Search indexed source.
| Field | Description |
|---|---|
| Name | Unique name for the semantic index generated by this semantic index configuration. As an example, if you're creating a semantic index configuration for the Knowledge Table indexed source, you might name it
Knowledge-Table-semantic-index. Note: The semantic index's name can't contain special characters, underscores, or whitespace. |
| Embedding Models | List of embedding models to use for the semantic index configuration.
|
| Active | Option to make the semantic index configuration active for your instance. AI Search ignores inactive semantic index configurations when indexing content from the specified index source. |
| Indexed Source | Reference to the AI Search indexed source that you want to apply this semantic index configuration to. This field is automatically set.
For more details on indexed sources, see Indexed sources in AI Search. |
| Application | Application scope for the semantic index configuration record. This field is automatically set. |
| Chunking Configuration For Embedding | |
| Chunking Strategy | Strategy to use when chunking semantically indexed text for the embedding model.
|
| Overlap Sentences | Number of sentences to overlap between chunks when indexing text from semantic index field values. Higher overlap values increase recall for semantic vector search at the expense of performance.
This field appears only when Passage is selected from Chunking Strategy.
|
| Chunk Unit | Textual unit to use as the basis for chunk size when indexing semantic field values for semantic vector search.
This field appears only when Passage is selected from Chunking Strategy.
|
| Chunk Size | Maximum number of words or sentences (depending on your Chunk Unit selection) to include in a chunk when indexing semantic field values for semantic vector search.
This field appears only when Passage is selected from Chunking Strategy.
|
| Maximum Total Words | Maximum number of words to index for semantic vector search from the concatenated values of all semantic index fields.
This field appears only when Truncate is selected from Chunking Strategy.
|