Data management and backup

Data Warehouse

The data warehouse is used for permanent storage of statistical and descriptive data. There is a possibility to manage how old data will be stored in data warehouse and if database backup should be created during cleanup procedure. System creates partition for each new year to manage data effectively and delete old partitions.

Data warehouse cleanup and backup procedures use following configuration:

This settings can be changed later in <SAFEQ_DIR>\conf\modules\crs.conf

enableDBCleanup = true

  • Used for enabling data warehouse cleanup. Cleanup removes data older than specified in archiveDataYears from the warehouse.

enableDBBackup = true

  • Used for enabling data warehouse backup

archiveDataYears = 1

  • Used for defining period, how old data will be kept in data warehouse. The value is specified in calendar years (e.g. all data since 1.1.2013 will be held in cube in case the current date is 1.1.2014 or 12.12.2014).

cdcDbBackupPath = c:/SafeQCRS/backup/

  • Path used for storing backups (data warehouse, cubes)

OLAP Cube

OLAP cubes use data from data warehouse as its direct source. There is possibility to manage how old information will be stored in base OLAP cube. There is also possibility of creating cubes backup during cleanup procedure. System creates partition for each month to manage data effectively and delete old partitions.

Cubes cleanup and backup procedures use following configuration:

This settings cannot be changed later. To change these options YSoft SafeQ CRS has to be reinstalled with newly defined settings.

enableBaseCubeCleanup = 1

  • Used for enabling base cube cleanup. Cleanup removes data older than specified in cdcArchiveCubePeriod from the Base cube.

cdcEnableBackupCubeBase = 1

  • Used for enabling base cube backup

cdcEnableBackupCubeFull = 1

  • Used for enabling full cube backup; if enabled, each month the full cubes older than specified in cdcArchiveCubeMonths property will be moved to backup directory.

cdcArchiveCubePeriod = 1

  • Used for defining period, how old data will be stored in base cube. The value is specified in calendar years (e.g. all data since 1.1.2013 will be held in cube in case the current date is 1.1.2014 or 12.12.2014).

cdcDbBackupPath = c:/SafeQCRS/backup/

  • Path used for storing backups (data warehouse, cubes)

Web Reports (SSRS)

Web reports database uses data mirrored from data warehouse. User can specify how old data will be stored in web reports database.

Web reports database cleanup procedure use following configuration:

This settings can be changed later in <SAFEQ_DIR>\conf\modules\crs.conf

enableReportsCleanup = true

  • Used for enabling web reports database cleanup. Cleanup removes data older than specified in archiveReportsYears from the web reports database.

archiveReportsYears = 1

  • Used for defining period, how old data will be stored in web reports database. The value is specified in calendar years (e.g. all data since 1.1.2013 will be held in cube in case the current date is 1.1.2014 or 12.12.2014).

Initial backup

When update of YSoft SafeQ CRS is performed, an initial backup of data warehouse and / or base cube is created (depends on settings of enableDBBackup, cdcEnableBackupCubeBase properties). This backup contains all data in data warehouse / base cube before YSoft SafeQ CRS update. To avoid creating an empty partitions, dataYearStart property should be used. No initial backup is created when clean installation of YSoft SafeQ CRS is performed.