Cleanup Attachments without mail reference

Coffee_is_life

first time i hear about a cronjob, managing the softdelete setup… - so the answer is no

is there a guide or can you provide me how this should look like?

fbartels

@Coffee_is_life said in Cleanup Attachments without mail reference:

is there a guide or can you provide me how this should look like?

there is an extensive tuning guide than you can request from our support. this also covers the manual trigger of softdelete (which is by the way just kopano-admin --purge-softdelete 30). using a cron for this instead of the builtin functionality is recommended for installations above 100 users (and the internal trigger for it is currently broken, but fixed for 8.3.3 final - https://jira.kopano.io/browse/KC-638).

Coffee_is_life

Thanks, this will help a lot!

just to be sure, if i use “kopano-admin --purge-softdelete 180” once a day (21:00, 1h before the backup starts) than it will delete all items older 180 days including attachments, right?

Coffee_is_life

fbartels

@Coffee_is_life said in Cleanup Attachments without mail reference:

it will delete all items older 180 days including attachments

no, it will delete items from the softdelete that are older than 180 days.

Coffee_is_life

@fbartels said in Cleanup Attachments without mail reference:

no, it will delete items from the softdelete that are older than 180 days.

Makes sense :sweat_smile:

is there a way to easy delete all items older 180 days (or mark them as deleted) from db including attachments? - as i mention we got an archive system and wont need double data

Coffee_is_life

fbartels

@Coffee_is_life said in Cleanup Attachments without mail reference:

is there a way to easy delete all items older 180 days (or mark them as deleted) from db

I don’t think there is a ready made solution for that yet, but this is certainly possible with python-kopano. If you open a support case we could collect your requirements, investigate and see how much effort it would be to create such a script for you.

Coffee_is_life

I will see if we really need this function - since no script exists yet.

I did the kopano-admin --purge-softdelete 30 to clean up some data…
deleted nearly 13 GB, seems fine… but:

since 13:00 it is doing nothing (0,0 CPU usage, 0,0 Mem usage), trying to start the purge again:

Fri Jul 28 14:14:24 2017: [info   ] Start forced softdelete clean up
Fri Jul 28 14:14:24 2017: [error  ] Softdelete already running

The command isnt running anymore (ps wwwaux |grep kopano-admin shows nothing)
Dont want to restart the server/service now so i dont know if it happens everytime…

If yes, the cronjob also needs to restart the kopano-server but this is not an option, since the users are accessing it nearly 24/7.

Something i can do while server is running?

Coffee_is_life

fbartels

@Coffee_is_life give it a bit more patience. even if its nut running anymore in the foreground, the task kicked off in the server may very well still be active.

and no you don’t need to restart kopano-server during or after running purge-softdelete.

isol

Can we be sure that this has really been fixed in 8.3.3? I just had a case where (with a pre-8.3.3 version) I had no space left for attachments and after reading this post, I ran softdelete manually. However this seems to have created a hude load on the database (100 of 400 GB attachements deleted, so I suppose about 25% of database entries), i.e. softdelete has probably never worked since setting this up. And, what was a real problem, I then had users with empty inboxes that had to be resynced (might be a load issue). But I also saw entries like these in the z-push-error logs:

StatusException: PHPWrapper->ImportMessageDeletion(): Received 13708 remove requests from ICS for folder ‘34e26d5db12f428f8105c4110045f1a3612903000000’ (max. 1000 allowed). Triggering folder
re-sync. - code: 3 - file: /usr/share/z-push/backend/kopano/mapiphpwrapper.php:171

But why should the final deletion of already deleted objects trigger anything at the z-push level??? These objects should not be user-visible anyway?

How can I check that softdelete is working as intended to avoid such accumulations in the future?

fbartels

@isol said in Cleanup Attachments without mail reference:

Can we be sure that this has really been fixed in 8.3.3

yes, its in the changelog and the fix has been verified.