Upgrade core 11.0.1.2 to 11.0.2.41 - High search cpu usage

JungleMarc

I experience same issue.

I am not on mariadb, but on mysql.

My sql is not part of the same machine. I can confirm mysql is very stable and no performance issues. It does not appear the issue is with the database server.

On the application server for Kopano, yes I can reach high cpu usage for both kopano-server and kopano-search after several weeks of uptime.

My only workaround is a restart of kopano-server, kopano-search

How can we debug this further?

umgfoin

@icey said in Upgrade core 11.0.1.2 to 11.0.2.41 - High search cpu usage:

does nobody has an idea how this could be fixed?

Hello @icey ,
I fixed the possible cause some time ago, but didn’t have time to create a qualified PR, yet.
You can resolve the problem by replacing a few lines in /usr/lib/python3.6/site-packages/kopano_search-11.0.2-py3.6.egg/kopano_search/__init__.py (the exact path on your system depends on distribution, python- and kopano-version).
Take a look here.

bg,
umgfoin.

umgfoin

(the exact path on your system depends on distribution, python- and kopano-version).

In your case more likely to be found here: /usr/lib/python3/dist-packages/kopano_search/__init__.py
++umgfoin.

stan23

@umgfoin that did the trick, thanks a lot!

externa1

@umgfoin
works also for 8.7.23

rg
Christian

icey

Hi umgfoin,

THANKS a lot --> That did the needed magic ;)

Thanks.
Icey

Joost

@naspelupo Thank you for reporting this issue, I’ve created a ticket to track it:
https://jira.kopano.io/browse/KC-2005

And thanks to @umgfoin’s fix, I’ve also been able to quickly create a PR:
https://stash.kopano.io/projects/KC/repos/kopanocore/pull-requests/3559/overview

umgfoin

@joost said in Upgrade core 11.0.1.2 to 11.0.2.41 - High search cpu usage:

I’ve also been able to quickly create a PR:

Yeah - and an impressively minimalistic one ;-) …
Thanks!

zara-kopa

The fix from @umgfoin is great! Works for me either!

Thanks a lot.

naspelupo

Yep: fix did the trick. Load is normal again!
Many thanks for this!
_paul

nanathlor

This edit plus a reboot fixed the high CPU for me too, now CPU is negligible.

core-11.0.2.43

mhope

@umgfoin Thank you very much! That did the trick for me too :)
Kopano 11.0.2, running under Ubuntu 18.04 as LXC on QNAP NAS.

dev107

@umgfoin thank you so much. It also works in supported version 8.7.23 and Debian 10.

kapeleha

The fix also works for my environment: KC 8.7.23 and virtual ucs-4.4.8 on a QNAP NAS. Thx a lot ;-)

JungleMarc

I applied the patch. Thank you for getting this fixed. :)

index_processes = 1 in /etc/kopano/search.cfg

Made a big difference on system load during cache rebuild.

Marc

fbartels

Just to have it said, the fix is part of the nightly releases for a few days already.

JungleMarc

@fbartels amazing. :)