XpoLog Search Engine help - Indexing

Log indexing is the process of scanning a log and creating an index - the structure that holds the information needed to quickly search for a text. In order to index a log, you need to turn on its 'use indexing' option. By default, all newly created logs have this option set. Most logs created by wizards also have this option set. Setting the 'use indexing' option can be done from 3 separate locations: from the log administration, the log customization and the search engine administration. Certain log types, such as remote logs, do not support indexing (remote logs could then be indexed on the XpoLog node on which they are defined).

All indexes are saved under the 'index' directory under XpoLog's root directory or under the external root directory, if one is set, or under a user defined indexing directory. The index size created for a log is usually about 20% of that log's size, or in the case of a zipped log, 20% of the size of the extracted log. In average, it takes XpoLog about 15 minutes to index 1 Gigabyte of data. Indexing is quite expensive in terms of resources consumption, therefore you should always consider running heavy indexing operations in times in which the system is more idle.
XpoLog supports interval indexing, which means that only the new portions of previously indexed log are indexed. This way indexing times are kept to a minimum.

Manual indexing
On top of running log indexing using the scheduler as defined in the search engine administration, you can also run logs indexing manually.
Click the 'XpoSearch' component and select the 'Indexing' menu to enter the 'Search Engine Indexing' screen. A log tree is displayed showing all the logs with enabled indexing and their last indexing time. Select the logs you want to index and click the 'run' link. An 'indexing started running' message will be displayed. Press 'ok' to return to the indexing page. The status of the current log being indexed is displayed in the upper part of the view and in the log tree.

In the log view, if a filter was activated or a search term was entered and the log is set for indexing, a message prompting the user to run an index update will pop up in case the index is not up-to-date.

 

 

Additional links

      Log view