Log indexing is the process of scanning a log and
creating an index - the structure that holds the information
needed to quickly search for a text. In order to index a log, you need to
turn on its 'use indexing' option. By default, all newly created
logs have this option set. Most logs created by wizards
also have this option set. Setting the 'use indexing' option can
be done from 3 separate locations: from the log administration, the
log customization and the
search engine administration. Certain
log types, such as remote logs, do not support indexing (remote
logs could then be indexed on the XpoLog node on which they are
defined).
All indexes are saved under the 'index' directory
under XpoLog's root directory or under the external root
directory, if one is set, or under a user defined indexing
directory. The index size created for a log is
usually about 20% of that log's size, or in the case of a zipped
log, 20% of the size of the extracted log. In average, it takes XpoLog about 15 minutes to index 1 Gigabyte of data. Indexing is quite
expensive in terms of resources consumption, therefore you
should always consider
running heavy indexing operations in times in which the system
is more idle.
XpoLog supports interval indexing, which means that only the new
portions of previously indexed log are indexed. This way
indexing times are kept to a minimum.
On top of running log indexing using the
scheduler as defined in the search engine
administration, you can also run logs indexing manually.
Click the 'XpoSearch' component and select the 'Indexing' menu to
enter the 'Search Engine Indexing' screen. A log tree is displayed
showing all the logs with enabled indexing and their last indexing
time. Select the logs you want to index and click the 'run'
link. An 'indexing started running' message will be displayed. Press
'ok' to
return to the indexing page. The status of the current log being
indexed is displayed in the upper part of the view and in the log
tree.
In the log view, if a filter was activated or a search term
was entered and the log is set for indexing, a message prompting
the user to run an index update will pop up in case the index is not
up-to-date.