Data Cleaning

Content Type: Module
Categories: Data

Overview

This module helps you to clean old records from your database. You can select a entity and decide to use delete behaviour.

The cleaning run will use batches of 100 records, so there is no worry about memory problems with large cascading deletes

Documentation

Typical usage scenario

Select the data entity that must be cleaned, and select the date attribute that is used to decide for older records then the given number of days.

You can run it directly, or use the scheduled event to run on your desired time.

Features and limitations

  • disable delete behaviour : if you disbale delete behaviour, the cascading delete will not be executed, only the selected entity will be deleted (even if ther is a reference delete behaviour). You use this option only when you realy know that this will not harm your data integrity and you can't get rid of these records in normal mode
    • delete behaviour enabled can cause problems with entities with reference delete behaviour. This is only shown in de Log as an erro and is not visible in the module.
  • export to be deleted data to CSV
  • runs in batches of 100 records

Dependencies 

Installation

Install the dependend modules, then install this module.

Use Mx Model Reflection to select all entities that can be used with this module

Add CleaningRecord_Overview page from the pages folder to the Navigation , optional you can add CleaningRun_Overview to the Navifgation

 

Configuration 

Enable scheduled event SE_RunCleaningJobs to run all cleaning jobs automitic or create your own scheduled event and run microflow DataCleaning.SUB_RunAllJobs

 

Warning

Before using this module in production create a backup of your database.

This module will delete data from your database. The developer nor Achmea can be made responsible for any data loss. 

 

Known Issues

- error when exporting selected records (solved when you give the role acces to OQL/Admin)

- delete messages only show up in the error log

Releases

Version: 1.1.6
Framework Version: 9.24.34
Release Notes: Templates to Atlas Core
Version: 1.1.5
Framework Version: 9.24.34
Release Notes: Correct date attribute in overview pages
Version: 1.1.4
Framework Version: 9.24.31
Release Notes: - delete with behaviour now synchone - bugfixes where 2 jobs overlapped execution, delay included
Version: 1.1.1
Framework Version: 9.24.31
Release Notes: default number of days to 7 years
Version: 1.1.0
Framework Version: 9.24.31
Release Notes: Added counters records to remove and records removed
Version: 1.0.0
Framework Version: 9.24.31
Release Notes: First release