kopano-search AttributeError

Coffee_is_life

Hello Forum,

we encountered a problem with kopano-search.
Users cant search for elements younger than friday 09.07.2021 09:00 - elements before this date are shown.
The log is full of:

2021-07-14 12:54:37,707 - search - ERROR - Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/kopano/log.py", line 103, in log_exc
    try: yield
  File "/usr/lib/python2.7/site-packages/kopano_search/__init__.py", line 393, in incremental_sync
    new_state = self.server.sync(importer, self.state, log=self.log)
  File "/usr/lib/python2.7/site-packages/kopano/server.py", line 866, in sync
    return _ics.sync(self, self.mapistore, importer, state, max_changes, window=window, begin=begin, end=end, stats=stats)
  File "/usr/lib/python2.7/site-packages/kopano/ics.py", line 272, in sync
    (steps, step) = exporter.Synchronize(step)
  File "/usr/lib/python2.7/site-packages/MAPICore.py", line 1347, in Synchronize
    def Synchronize(self, *args): return _MAPICore.IExchangeExportChanges_Synchronize(self, *args)
  File "/usr/lib/python2.7/site-packages/kopano/ics.py", line 134, in ImportMessageChange
    self.log.error('could not process change for entryid %s (%r):', _benc(entryid.Value), props)
AttributeError: 'NoneType' object has no attribute 'Value'

if i do

kopano-search -r -u $user

and reindex the searcher for one specific user, the elements younger friday can be found too.

For handling this issue i ran the following command over night:

declare -i i=5; for e in $(kopano-admin -l | tail -n +$i | awk -F" " '{print $1}' | grep "^[a-z]"); do echo "$(date) - start reindex for $e (Index $i)"; kopano-search -r -u $e; i+=1; sleep 300; done

this will queue the reindex-command for each user known in “kopano-admin -l” and waits 300sec.
Most of the users got reindexed and can search again, but for some useres the kopano-search just logs:

query - INFO - queued store XY for reindexing

but it didnt reindex the store/user.
kopano-search is configured with “index_processes = 4” - when we did the first indexing (2 years ago) we used the recommended 1 indexer, after finishing we increased it to “4”

When reindexing the users, the mailserver freed up nearly 30GB of diskspace which was only consumed over the last month.

some suggestions on this problem?

best regards
coffee_is_life

Coffee_is_life

Update:

after reindexing every user the error occured again some minutes/hours (at random).

Restarting the services wasnt helping so we restarted the whole server while doing some minor yum-updates.
Since then the error seems to be gone.

best regards
Cofee_is_life

flobian

Hello @coffee_is_life,

have you found a solution meanwhile?

After upgrade of kopano from 8.7.17 to 78.7.23 search index is not updating any more. My kopano is running on top of UCS server.

grep  kopano history.log
Upgrade: z-push-config-apache:amd64 (2.6.2+0-0, 2.6.4+0-0), z-push-kopano-gabsync:amd64 (2.6.2+0-0, 2.6.4+0-0), z-push-common:amd64 (2.6.2+0-0, 2.6.4+0-0), z-push-kopano:amd64 (2.6.2+0-0, 2.6.4+0-0), z-push-backend-kopano:amd64 (2.6.2+0-0, 2.6.4+0-0), z-push-ipc-sharedmemory:amd64 (2.6.2+0-0, 2.6.4+0-0)
Upgrade: libkcarchiver0:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), kopano-dagent:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), python3-mapi:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), libkcfreebusy0:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), libkcsoap0:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), php7-mapi:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), libkcrosie0:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), python3-kopano-utils:amd64 (8.7.17.0-0+27.1, 8.7.23.0-0+ucs4.3~33.1), kopano-monitor:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), libkcserver0:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), kopano-python-utils:amd64 (8.7.17.0-0+27.1, 8.7.23.0-0+ucs4.3~33.1), kopano-common:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), python3-kopano-search:amd64 (8.7.17.0-0+27.1, 8.7.23.0-0+ucs4.3~33.1), libkcarchivercore0:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), libkcicalmapi0:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), kopano-server-packages:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), libkcinetmapi0:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), libkcpyplug0:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), kopano-backup:amd64 (8.7.17.0-0+27.1, 8.7.23.0-0+ucs4.3~33.1), kopano-dagent-pytils:amd64 (8.7.17.0-0+27.1, 8.7.23.0-0+ucs4.3~33.1), kopano-gateway:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), libmapi1:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), kopano-search:amd64 (8.7.17.0-0+27.1, 8.7.23.0-0+ucs4.3~33.1), kopano-spooler:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), kopano-ical:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), libkcutil0:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), kopano-migration-pst:amd64 (8.7.17.0-0+27.1, 8.7.23.0-0+ucs4.3~33.1), python3-kopano:amd64 (8.7.17.0-0+27.1, 8.7.23.0-0+ucs4.3~33.1), kopano-server:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), kopano-client:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1), kopano-lang:amd64 (8.7.17.0-0+50.1, 8.7.23.0-0+ucs4.3~58.1)

Any ideas?
Thank you!!
Florian

Coffee_is_life

@flobian
The solution was a complete reboot of my CentOS7 machine
I dont know what happend or why, but since the reboot the error was gone.

Further i dont know if your error is comparable to what is mentioned above.
whats the exact error your kopano-search.log?

best regards,
coffee_is_life