Configure file attachment indexing settings

Home

Configure file attachment indexing settings

Edit settings in the search-config.xml file to configure search for file attachments.

To edit configuration files, use the IBM WebSphere Application Server wsadmin client. See Start wsadmin for details.

IBM Lotus Connections supports the indexing of file content from the Files feature. Search also provides a dedicated document conversion service. When a files indexing task is run, the document conversion service downloads files, converts them to plain text, and then indexes the content. During this process, content from different MIME types is indexed. For a list of the MIME types supported by search, see Supported MIME types.
The behavior of the document conversion service can be altered by modifying various settings, allowing administrators to control the file content indexing process. Attention: When file indexing is enabled, the content of files is not indexed the first time that the index is run. The first index starts the process of retrieving the file content, but the actual indexing of the content only takes place when the index is run for the second time. To configure file attachment indexing settings...
Open a command window and start the wsadmin command-line tool.
After the wsadmin command environment has initialized, use one of the following commands to initialize the search environment and start the search script interpreter:

Stand-alone deployment:
execfile("searchAdmin.py")

Network deployment:
execfile("WAS_HOME/profiles/Dmgr01/config/bin_lc_admin/searchAdmin.py")

When asked to select a server, you can select any server.
Check out the search cell-level configuration file...
SearchCellConfig.checkOutConfig("<working_dir>", "<cellName>")

where:

<working_dir> is the temporary to which you want to check out the cell level configuration file. This must exist on the server where you are running wsadmin.
<cellName> is the name of the cell that the search node belongs to. This argument is required even in stand-alone deployments. This argument is also case-sensitive, so type it with care. If you do not know the cell name, do one of the following to determine it:

Stand-alone deployment: Look at the name after the following in the file system:
WAS_HOME\profiles\profile_name\config\cells\
Network deployment: From wsadmin...
print AdminControl.getCell()

For example:
SearchCellConfig.checkOutConfig("c:/search_temp", "SearchServerNode01Cell")
Use the following commands to control the file content indexing process.
Commands for configuring search for file attachments
Property Description
SearchCellConfig.enableAttachmentHandling() Enables the indexing of files in the Files feature.
If you already disabled the attachment handling of files during the last indexing, you need to rebuild the index again after enabling attachment handling. Otherwise, this command won't take effect.
This command does not take any input parameters.
SearchCellConfig.disableAttachmentHandling() Disables the indexing of files in the Files feature.
This command does not take any input parameters.
SearchCellConfig.setMaximumAttachmentSize(int maxAttachmentSize)
Sets the upper limit on the size of files that can be downloaded for indexing. Files above this limit are not downloaded for content indexing.
Files are downloaded to a temporary directory, which is located in the index The temporary size available must be greater than the maximum file size allowed for content indexing. This command accepts one argument:

maxAttachmentSize. The maximum file size in bytes of any file attachment eligible for indexing. This is an integer value.

For example:
SearchCellConfig.setMaximumAttachmentSize("204800")
SearchCellConfig.setCacheExpiryTime(int numberOfDays)
Sets the number of days for which a downloaded file's indexable content is cached in the database. This information is cached for potential reuse at indexing time. If a file is not reused in the number of days specified, its entry in the database cache is deleted. If the file content has changed, the file is downloaded again and the cache is updated with the revised content.
This command allows you to ensure that the database cache used for indexing files is kept up-to-date.
The expiry time is measured in days. Specify a positive integer greater than zero. For example:
SearchCellConfig.setCacheExpiryTime("30")
SearchCellConfig.setCacheFileSize(int cacheFileSize)
Specifies the maximum amount of indexable text per file.
The size is specified in bytes. Use a positive integer greater than zero.
The cache file size is set to 200 KB by default. This is also the maximum amount of content that can be indexed. If this value is set to a value greater than 200 KB, the search feature only caches 200 KB of data per file. This command accepts one argument:

cacheFileSize. The number of bytes of indexable and searchable file content stored in the database cache. This is an integer value.

For example:
SearchCellConfig.setCacheFileSize("8435456")
SearchCellConfig.setMaximumConcurrentDownloads(int maxConcurrentDownloads)
Sets the maximum number of threads that perform file downloading on a search server.This command takes a single argument that specifies the number of threads. The argument must be an integer greater than zero. The default is 3.CAUTION:Increasing this value increases the load on the Files server. For example:
SearchCellConfig.setMaximumConcurrentDownloads("10")
SearchCellConfig.setMaximumTempDirSize(int maxTempDirSize)
Sets the maximum size of a temporary used by a search server for the files conversion process.
This command takes a single argument that specifies the maximum size in bytes. The argument must be an integer greater than zero. The default value is 100 MB.
Files are downloaded to a temporary directory, which is located in the index The temporary size available must be greater than the maximum file size allowed for content indexing. For example:
SearchCellConfig.setMaximumTempDirSize("51200")
SearchCellConfig.setDownloadThrottle(long downloadThrottle)
Sets the duration of a rest period between successive files downloads in a single file-download thread.This command takes a single argument that specifies the download throttle size in milliseconds. The download throttle is set to 500 by default.CAUTION:Increasing this value increases the load on the Files server. For example:
SearchCellConfig.setDownloadThrottle("500")
Check in the changed configuration property keys using the following wsadmin client command:
SearchCellConfig.checkInConfig()

To exit wsadmin, type
exit

at the prompt.
Stop the server or servers hosting the search feature, delete the index, and then restart the search servers. The next time the scheduled task fires, it recreates the index.
Supported MIME types
Search supports the indexing of content from a number of MIME types.

Manage the index

Related tasks

Apply property changes

Related reference

SearchCellConfig commands

+
Search Tips | Advanced Search

Property	Description
SearchCellConfig.enableAttachmentHandling()	Enables the indexing of files in the Files feature. If you already disabled the attachment handling of files during the last indexing, you need to rebuild the index again after enabling attachment handling. Otherwise, this command won't take effect. This command does not take any input parameters.
SearchCellConfig.disableAttachmentHandling()	Disables the indexing of files in the Files feature. This command does not take any input parameters.
SearchCellConfig.setMaximumAttachmentSize(int maxAttachmentSize)	Sets the upper limit on the size of files that can be downloaded for indexing. Files above this limit are not downloaded for content indexing. Files are downloaded to a temporary directory, which is located in the index The temporary size available must be greater than the maximum file size allowed for content indexing. This command accepts one argument: maxAttachmentSize. The maximum file size in bytes of any file attachment eligible for indexing. This is an integer value. For example: SearchCellConfig.setMaximumAttachmentSize("204800")
SearchCellConfig.setCacheExpiryTime(int numberOfDays)	Sets the number of days for which a downloaded file's indexable content is cached in the database. This information is cached for potential reuse at indexing time. If a file is not reused in the number of days specified, its entry in the database cache is deleted. If the file content has changed, the file is downloaded again and the cache is updated with the revised content. This command allows you to ensure that the database cache used for indexing files is kept up-to-date. The expiry time is measured in days. Specify a positive integer greater than zero. For example: SearchCellConfig.setCacheExpiryTime("30")
SearchCellConfig.setCacheFileSize(int cacheFileSize)	Specifies the maximum amount of indexable text per file. The size is specified in bytes. Use a positive integer greater than zero. The cache file size is set to 200 KB by default. This is also the maximum amount of content that can be indexed. If this value is set to a value greater than 200 KB, the search feature only caches 200 KB of data per file. This command accepts one argument: cacheFileSize. The number of bytes of indexable and searchable file content stored in the database cache. This is an integer value. For example: SearchCellConfig.setCacheFileSize("8435456")
SearchCellConfig.setMaximumConcurrentDownloads(int maxConcurrentDownloads)	Sets the maximum number of threads that perform file downloading on a search server.This command takes a single argument that specifies the number of threads. The argument must be an integer greater than zero. The default is 3.CAUTION:Increasing this value increases the load on the Files server. For example: SearchCellConfig.setMaximumConcurrentDownloads("10")
SearchCellConfig.setMaximumTempDirSize(int maxTempDirSize)	Sets the maximum size of a temporary used by a search server for the files conversion process. This command takes a single argument that specifies the maximum size in bytes. The argument must be an integer greater than zero. The default value is 100 MB. Files are downloaded to a temporary directory, which is located in the index The temporary size available must be greater than the maximum file size allowed for content indexing. For example: SearchCellConfig.setMaximumTempDirSize("51200")
SearchCellConfig.setDownloadThrottle(long downloadThrottle)	Sets the duration of a rest period between successive files downloads in a single file-download thread.This command takes a single argument that specifies the download throttle size in milliseconds. The download throttle is set to 500 by default.CAUTION:Increasing this value increases the load on the Files server. For example: SearchCellConfig.setDownloadThrottle("500")