Indexing and Search Logs

Help

Copyright ©

Mindbreeze GmbH, A-4020 Linz, 2017.

All rights reserved. All hardware and software names are brand names and/or trademarks of their respective manufacturers.

These documents are strictly confidential. The submission and presentation of these documents does not confer any rights to our software, our services and service outcomes or other protected rights.

The dissemination, publication or reproduction hereof is prohibited.

For ease of readability, gender differentiation has been waived. Corresponding terms and definitions apply within the meaning and intent of the equal treatment principle for both sexes.

.

Log filesPermanent link for this heading

The directory for the Mindbreeze enterprise search services log files can be configured in "Advanced Settings".

It is entered by default under Linux “/var/opt/mindbreeze/log“ and under Windows “c:/Users/<service user>/App Data/Local/Temp“. In the following chapters, this directory is referred to as "Log Directory".

Client service log filesPermanent link for this heading

The client service log files are located in the directory "Log Directory/log-mesclientservice-<client-port>", where a subdirectory with the corresponding time stamp is created for each restart.

Query service log filesPermanent link for this heading

  • The query service log files are located under "Log Directory/log-mesindex<index path>" with subdirectories for each restart. Relevant query service log files are:
  • log-mesindex.log
  • performance-findservlet.csv  

The following columns of the "performance-findservlet.csv" file have an essential role in the analysis of search queries:

  • Starting Timestamp: Start time
  • Query: Contains the search term
  • Authorized Hit Count: The number of authorized documents
  • Rejected Hit Count: The number of unauthorized documents

The authorization and contextualization as part of the query service will be performed in separate processes. The log files are located under "Log Directory/log-messdkjavasandbox-bootstrapped-<query-port>", "Log Directory/log-messdkcsandbox-<query-port>" or in the file "Log Directory/log-messdknetsandbox-<query-port>.txt", depending on the implementation (Java, C or .NET).

Crawler log filesPermanent link for this heading

The crawler logs are located in the "Log Directory/log-mescrawler-launchedservice-<Category>_<Source Name>" directory.

Microsoft Exchange 2010Permanent link for this heading

log-mescrawler_launchedservice_Microsoft_Exchange_<Source Name>.log includes all information such as: start time, mailboxes found (AD), crawler status fetch, time when a mailbox search is completed, and end time with the collected statistics on the total number of documents found, indexed, and deleted.

Additionally, CSV log files are generated. The names of the CSV log files correspond to the associated "crawl run" or "scope". The following files have a significant role in the analysis of delta indexing:

per-folder-finditems-<crawlrun>_<scope>.csv: Contains the information of all found folders of the mailboxes that were created or modified within the time frame (scope). The main columns are:

  • Timestamp: Start time
  • Mailbox: E-mail address
  • Path: Path of the folder <mailbox>/ordner/unterordner/…
  • PerFolderFoundItemsSize: Number of found items that are newly created or modified.

mindbreeze-dispatcher-<crawlrun>_<scope>.csv: All documents or e-mails that have been sent to the filter service. The main columns are:

  • Timestamp: Start time
  • Key:
  • Mailbox: E-mail address
  • Folder: The folder in which the e-mail is located

FilesystemPermanent link for this heading

"Log Directory/log-mesfscrawler_<indexpath>.log" contains all information that is generated by the filesystem crawler.

Filter service log filesPermanent link for this heading

The filter service log files are located in the directory "Log Directory/log-mesfilterservice-<port>." The statistic-filter-rpc.csv file provides information, for example about the filter plugin used, file extensions and possible errors in filtering. The main columns are:

  • Timestamp: Start time
  • Extension: file extension
  • Used Filter ID: Filter plugin
  • Internal Exception: possible errors

The actual filtering happens in separate processes. Depending on the implementation of the filter plugins (Java, C or .NET), the "Log Directory/log-messdkjavasandbox2-Filter@<port>", "Log Directory/log-messdkcsandbox2-Filter@<port>" directories or the "Log Directory/log-messdknetsandbox-<port>.txt" file will be generated.

Index service log filesPermanent link for this heading

The index service log files are located in the "Log Directory/log-mesindex<index path>“ directory. All information concerning the state of the indexing (inverting, merging and announcements) is located in the file log-mesindex.log.

performance-servlet-mes3_indexeddocuments.csv provides information about the number of documents that have been obtained by the index service.

performance-servlet-mes3_deletedocuments.csv provides information about the number of documents that have been deleted from the index.

performance-servlet-mes3_updatedocuments.csv provides information about the number of documents that have been updated in the index.