Filter Rules disappearing
-
If you have any more information
Better yet, if you have any disk images, shell prompts, etc., …
SQL Statement to list all [dagent] rules from the database directly?
SELECT h.owner, val_binary FROM properties AS p INNER JOIN hierarchy AS h ON p.hierarchyid=h.id WHERE tag=0x3FE1 -
@jengelh Ok, I have executed the statement on my updated system and imported a database-dump from some months ago into an other database and executed the statement. I don’t think that I changed the rules since then - just created one rule after the update when all rules got lost.
Both are returning exactly one record with a binary field. The size of the field is very different: about 58kb on the old and about 2kb on the new.I’m not really able to read the content of the binary, but I was able to find the sender addresses I use with the rules to sort the mail into different folders inside the binary blob.
In the old one there are many addresses (I expect all addresses of all rules) in the blob and in the new one only one for the one rule I created.So it seams to me all rules get lost also in the database and/or the whole blob was thrown away.
Could I help you in some way to find the problem? Perhaps exporting my old blob in some way and sending it to you?
-
Update: I just saw, that the blob is an XML dokument.
So i started to recreate my rules over the Webapp. I entered my 6 rules and clicked to save. Then I went to Mail view and back to settings / rules and my rules where gone (they are still in database now and kopano-rules lists them, but not shown in the webapp).
Perhaps the number of sendes in a rule is the problem…
-
Update: I tried to recreate the rules with Webapp several times in different orders. And lost the rules two times after saving them, going to Mail and returning to Rules.
So I think the problem is the size of the whole blob. I think the limit is somewhere between 50kB and 62kB. -
Update: I saved my rules an hour ago and they where there in the WebApp when I check the last time. I didn’t do anything since then, but now they are lost in tde WebApp. They are still displayed by kopano-rules.py, but they are not respected when processing mails.
-
@fbartels Is this issue fixed? As already said I"m able to reproduce it.
-
Hi @bmaehr ,
no no luck reproducing it on our side and therefore also no fix for this. We have added two changes though to get some additional logging:
https://stash.kopano.io/projects/KC/repos/kopanocore/commits/5f7b0f351f78266a773d323f657b89ce34f60a61
https://stash.kopano.io/projects/KC/repos/kopanocore/commits/614469db65191788ef15d6416e7a83192a4afbf0 -
@fbartels I just have to add enough rules on my running instance and the rules get lost without any upgrade. I can provide you the information to reproduce it.
-
I tried to reproduce this with 66 kB of rules, unfortunately I wasn’t able to reproduce. Could you perhaps send us your rules? If you don’t want to post it here on the forum, you could alternatively send it to: feedback@kopano.io
To backup your rules:
kopano-backup --only-meta -u <username> -f Inbox -
This post is deleted! -
This post is deleted! -
Hello,
I have the same issue with the filter rules.
I have created about 20 rules in the WebApp. And after the next mail ist processed by dagent the rules disappeared in the WebApp.
But they can be displayed via kopano-rules.py --list. So they are still available.
And after they disappeared in the WebApp they don’t show up in the dagent log, so they aren’t used any more.
After I delete the last rule they show up again in the WebApp and in the dagent log. But they aren’t used by dagent. Every log entry says: Rule “***” does not match: not found (8004010f)
And afterwards the rules tab is empty again in the WebApp. -
@freyuh to prevent spam bots (usually newly registered accounts) from posting messages there is a moderation queue for new users which you tripped into three times. I have approved all three of your posts, maybe you want to trim them down into a single post (the largely cover the same, but each one has different details).
also posting the exact version where you encounter an issue would be helpful as well.
-
Hello Felix,
sorry, the message disappeared out of the quick reply box and nothing happened so I thought, that I did something wrong …
Version info:
WebApp: 3.4.17.1613+72.1
Kopano Core: 8.6.80
Z-Push: 2.4.3+0-0 -
@lherrmann Is the problem fixed? Should I try with a new version?
-
Hi
We have seen the same issue of rules and signatures missing from accounts in 8.6.80 in both Debian Stretch and Jessie.
Will run those tests to see what we can find. -
I’m really disappointed.
I found out what’s the problem, sent you the data for the testcase and 2 months later it is still not fixed…
-
@bmaehr said in Filter Rules disappearing:
I’m really disappointed.
I found out what’s the problem, sent you the data for the testcase and 2 months later it is still not fixed…
greate you found the problem, since you did, would you share the solution?
best regards
coffee_is_life -
I have created about 20 rules in the WebApp. And after the next mail ist processed by dagent the rules disappeared in the WebApp. But they can be displayed via kopano-rules.py --list. So they are still available.
Well if kopano-rules.py shows any part of it and WebApp does not, that would initially point to WebApp.
And after they disappeared in the WebApp they don’t show up in the dagent log, so they aren’t used any more.
After I delete the last ruleIf they are not shown in WebApp, there is nothing to delete.
they show up again in the WebApp and in the dagent log. But they aren’t used by dagent. Every log entry says: Rule “***” does not match: not found (8004010f)
If it is what I think it is, then: This message means that destination folder of the rule action was not found.
-
Hello,
now I can’t even print the rules with the kopano-rules.py script.
I get the following error message:Traceback (most recent call last):
File “/usr/local/bin/kopano-rules.py”, line 1110, in <module>
main()
File “/usr/local/bin/kopano-rules.py”, line 1104, in main
kopano_rule()
File “/usr/local/bin/kopano-rules.py”, line 885, in kopano_rule
printrules(filters, user, server)
File “/usr/local/bin/kopano-rules.py”, line 665, in printrules
condition_message = convertcondition(rule[4].Value)
File “/usr/local/bin/kopano-rules.py”, line 311, in convertcondition
totalconditions = len(conditions.lpRes)
TypeError: object of type ‘SPropertyRestriction’ has no len()Ulrich.
