Configure tables to use the Japanese tokenizer

  • Release version: Yokohama
  • Updated January 30, 2025
  • 1 minute to read

    • Improve search results in Japanese language searches by configuring individual tables to use the Japanese tokenizer.

    Before you begin

    Role required: admin

    About this task

    Japanese language searches use the Kuromoji Japanese tokenizer in Zing. The Japanese tokenizer attribute is active by default, but you must configure individual tables to use it and then regenerate the text index.

    Procedure

    1. Navigate to All > System Definition > Dictionary.
    2. Search for the table name.
    3. In the search results, open the table, which is the list item that has an empty Column name and a Type of Collection.
    4. Scroll down the page and select the Attributes tab, and then select New.
    5. Fill in the fields on the form.
      Table 1. Attributes fields
      Field Description
      Attribute Enter Text index tokenizer language.
      Dictionary entry Defaults to the name of the table.
      Value Enter ja for the Japanese tokenizer.
    6. Select Submit.
    7. Regenerate a text index for a table.
      Note:
      Text indexing can be a resource-intensive task that may take a while to complete. You may notice performance degradation or incomplete search results during index generation. To estimate text indexing duration, you can view historical statistics.

    Result

    When the text index is generated and you go to the table you configured, the table now uses the Japanese tokenizer.