Zing computes document scores using three components

  • Release version: Washingtondc
  • Updated February 1, 2024
  • 2 minutes to read
  • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of Zing Computes Document Scores Using Three Components

    The Zing search engine in ServiceNow calculates document scores based on three key components: frequency, sequence, and weight of search terms. Understanding these components helps optimize search results and enhances user experience when searching for documents within the platform.

    Show full answer Show less

    Key Features

    • Frequency: Points are awarded based on how often search terms appear in a document. For example, a document containing the search terms "distributed database server" can have a cumulative frequency score based on individual term occurrences.
    • Sequence: Points are given for the order of search terms. The scoring is exponential, rewarding documents that contain search terms in the exact sequence they were typed. For example, a two-term sequence earns 100 points, while a three-term sequence earns 1000 points.
    • Weight: Each field has a scoring weight (tsweight) that enhances the score based on where the search terms appear. Higher weights are assigned to key fields such as Knowledge record numbers and task descriptions.

    Key Outcomes

    Enabling term frequency–inverse document frequency (TF-IDF) can significantly improve search relevance by increasing the weight of less common search terms across the document set. By configuring tsweight attributes, users can tailor search results to ensure more relevant documents are prioritized based on their specific needs. Overall, these scoring mechanisms facilitate effective and efficient document retrieval within ServiceNow.

    The Zing search engine computes document scores based on the frequency, sequence, and weight of search terms in the document.

    Document scores

    The components of a document score for a search query are:
    • Frequency: how often the search terms appear in the document.
    • Sequence: how often the search terms appear in the same order as the search query.
    • Weight: how heavily weighted the source field is in which the search terms appear.
    Figure 1. Sample document score computation
    Graphic showing frequency and sequence scoring for sample search query and document.

    Frequency points

    Zing awards one point whenever a search term appears anywhere in the document. For example, when searching for distributed database server, a document that contains distributed three times, database five times, and server 17 times would have 25 frequency points.

    To increase search result scores of search terms that appear more frequently in a document, but less frequently in a document set, you can Score search terms by inverse document frequency (IDF). When TF-IDF is enabled, search term scores are calculated by multiplying the term frequency score by the inverse document frequency score. Because enabling TF-IDF increases the weight of less common search terms, search results for that table are more likely to be relevant. For example, when searching for distributed database server, the term distributed might receive a higher score than server if it appears frequently in one document but less frequently in the document set as a whole.

    Zing applies a multiplier to frequency points based on the value of the ts_weight attribute for the field in which the search term appears. A field with a text search scoring weight of 30 (ts_weight=30) would add 30 points for each inclusion of a search term.

    Sequence points

    Zing awards a document more points when it contains the search terms in the same order in which they were typed. The more search terms in sequence there are, the exponentially higher the score becomes. Zing awards sequence points as 10^x, where x is the number of search terms that appear in sequence.

    In the distributed database server search example, Zing awards a document 100 (10^2) sequence points for each time it includes the two-term string database server. Likewise, Zing awards a document 1000 (10^3) sequence points each time it includes the three-term string distributed database server.

    Zing applies a multiplier to sequence points based on the value of the ts_weight attribute for the field in which the sequence appears. The sequence points use the calculation (10^x * field ts_weight attribute).

    Field scoring weights

    The system elevates the default scoring weight of Knowledge record numbers, Knowledge short descriptions and metadata, task record numbers, and task short descriptions. Default ts_weight attributes for these fields are as follows:
    • kb_knowledge.number = 50
    • kb_knowledge.short_description = 10
    • kb_knowledge.meta = 10
    • task.number = 50
    • task.short_description = 10

    All other fields have a default ts_weight attribute of 1. The maximum possible weight value is 255.