Home

 

Backing up Files data


Overview

Files stores data in both the database and a file system. This adds some complication in keeping the application available to users while backing up data.

Files stores a large amount of data. If it were only stored in the database, maintenance and backups would be complex and costly. To prevent this, Files stores file metadata in the database, and stores the bulk of file data in binary files in a on a file system. You specify the during Lotus Connections installation, and you can find it at any time in the files-config.xml properties file, in the file.storage.rootDirectory element.

The file.storage.rootDirectory element will contain either the path itself, or a WAS variable whose value is the path. If it contains a variable, you can find the path by opening the WAS console, clicking...

..and finding the variable. For example, if the element's value is...

..find FILES_CONTENT_DIR in the console to find the path. File data is actually stored in unique directories below...

Each file's data is stored in a sub-directory below /files, generated from the file's randomly generated UUID. Part of the UUID is used to create a with a number between 0 and 127. Another part is used to create another below that, with another number between 0 and 127, and the UUID itself is located in that For example:

Files are only written once, so their identities are clear if one is missing during a restore.

This storage architecture means maintain consistency between the database and file system during backups. The simplest way to maintain consistency is to perform "off-line" backups, making the application inaccessible and then backing up both locations. But often you will want to perform "on-line" backups, keeping the application accessible. During an on-line backup, users can continue to add and delete content from the application.

During on-line backups of Files, back up the database before the file system. The database enforces transactional integrity between the two locations. If you start the file system backup first, files added between the time the file system backup starts and the database backup later completes will be missing from the file system on restoration. Backing up the database first ensures that you capture all new files during backup.

You must also stop a file-deletion task from running during on-line backup. When a user deletes a file it is removed from the user interface, but the application actually adds it to a queue of files that must be deleted from the file system. This task runs regularly to delete the top item from the queue. Alternatively, you can increase the time files can sit in the queue before they are deleted, by adjusting the value in the file.softDelete.minimumPendingTimeInMins property in files-config.xml. This could give you enough time to run incremental backups and make sure your archive is never missing data.


Perform an on-line backup of Files

  1. Start the wsadmin client.

  2. Start the Files script...

  3. Stop the task that deletes files from the queue with the following command:

      FilesTaskService.pause("com.ibm.quickr.share.platform.task.file.delete")

  4. Back up the database according to the database documentation.

  5. Back up the file system in whatever way makes sense in your environment. For example, for small deployments you can just zip the system, or for large deployments you can use a tool like Tivoli Storage Manager.

  6. Start the task that deletes files from the queue with the following command:

      FilesTaskService.resume("com.ibm.quickr.share.platform.task.file.delete")


You can run a task that checks for inconsistencies between the database and the file system. It might be useful to compare database and file system images in a test environment before restoring them. See the topic Checking Files data integrity for more information.

 

Related tasks

Backing up and restoring data
Administer Files
Start the wsadmin client
Change configuration property values
Files administrative commands
Files configuration properties

+

Search Tips   |   Advanced Search