Results missing from search

Hi there,

I’m running Kopano 8.6.2 on UCS, upgraded from ZCP7.2 some time ago. I’m noticing that there are results missing from searches.

The Kopano server.log file was showing a lot of lines like:

Wed Oct  3 16:04:57 2018: [warning] SSL_accept() failed in soap_ssl_accept()
Wed Oct  3 16:05:00 2018: [error  ] setSyncStatus(): collision
Wed Oct  3 16:13:20 2018: [error  ] Previous message logged 100 times

So, as suggested in other topics i ran a:

service kopano-server stop
kopano-server --restart-searches

After this Kopano server.log is showing the rebuild:

Wed Oct  3 19:58:08 2018: [=======] Server shutdown complete.
Wed Oct  3 19:59:19 2018: [=======] Starting kopano-server version 8.6.2 (pid 28190)
Wed Oct  3 19:59:19 2018: [error  ] Coredumps will not be generated: kopano-server requires the fs.suid_dumpable sysctl to contain the value 2, not 0. See kopano-coredump(5) for details.
Wed Oct  3 19:59:20 2018: [crit   ] ECSearchFolders::Search() GetEntryListToObjectList failed: 0x80000015
Wed Oct  3 19:59:20 2018: [crit   ] Starting rebuild of search folders... This may take a while.
Wed Oct  3 19:59:20 2018: [crit   ]   Rebuilding searchfolders of store 3
Wed Oct  3 19:59:20 2018: [error  ] Error while querying search on "file:///var/run/kopano/search.sock", 0x80040115
Wed Oct  3 19:59:21 2018: [crit   ] ECSearchFolders::Search() GetEntryListToObjectList failed: 0x80000015
Wed Oct  3 19:59:24 2018: [crit   ]   Rebuilding searchfolders of store 449
Wed Oct  3 19:59:24 2018: [crit   ]   Rebuilding searchfolders of store 496
Wed Oct  3 19:59:24 2018: [crit   ]   Rebuilding searchfolders of store 555
Wed Oct  3 19:59:24 2018: [crit   ]   Rebuilding searchfolders of store 2815
Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 276725
Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 378212
Wed Oct  3 19:59:25 2018: [crit   ] ECSearchFolders::Search() CreateSessionInternal failed: 0x80000002
Wed Oct  3 19:59:25 2018: [crit   ] Previous message logged 4 times
Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 688235
Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 895341
Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 1028850
Wed Oct  3 19:59:26 2018: [crit   ]   Rebuilding searchfolders of store 1298896
Wed Oct  3 19:59:26 2018: [crit   ]   Rebuilding searchfolders of store 1298922
Wed Oct  3 19:59:26 2018: [crit   ] ECSearchFolders::Search() CreateSessionInternal failed: 0x80000002
Wed Oct  3 19:59:26 2018: [crit   ]   Rebuilding searchfolders of store 1383326
Wed Oct  3 19:59:26 2018: [crit   ]   Rebuilding searchfolders of store 1438396
Wed Oct  3 19:59:27 2018: [crit   ]   Rebuilding searchfolders of store 1617777
Wed Oct  3 19:59:29 2018: [crit   ]   Rebuilding searchfolders of store 1698844
Wed Oct  3 19:59:29 2018: [crit   ]   Rebuilding searchfolders of store 1870814
Wed Oct  3 19:59:30 2018: [crit   ]   Rebuilding searchfolders of store 1939568
Wed Oct  3 19:59:31 2018: [crit   ]   Rebuilding searchfolders of store 2040006
Wed Oct  3 19:59:31 2018: [crit   ]   Rebuilding searchfolders of store 2088383
Wed Oct  3 19:59:31 2018: [crit   ]   Rebuilding searchfolders of store 2156442
Wed Oct  3 19:59:31 2018: [error  ] setSyncStatus(): collision

But Kopano search.log is showing the following message a few times:

2018-10-03 19:58:10,059 - search - ERROR - Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/kopano/log.py", line 89, in log_exc
    try: yield
  File "/usr/lib/python2.7/dist-packages/kopano_search/__init__.py", line 382, in incremental_sync
    new_state = self.server.sync(importer, self.state, log=self.log)
  File "/usr/lib/python2.7/dist-packages/kopano/server.py", line 715, in sync
    return _ics.sync(self, self.mapistore, importer, state, log or self.log, max_changes, window=window, begin=begin, end=end, stats=stats)
  File "/usr/lib/python2.7/dist-packages/kopano/ics.py", line 218, in sync
    exporter.Config(stream, flags, importer, restriction, None, None, 0)
  File "/usr/lib/python2.7/dist-packages/MAPICore.py", line 1902, in Config
    return _MAPICore.IExchangeExportChanges_Config(self, lpStream, ulFlags, lpUnk, lpRestriction, lpIncludeProps, lpExcludeProps, ulBufferSize)
MAPIErrorNetworkError: MAPI error 80040115 (MAPI_E_NETWORK_ERROR)

After restarting the Kopano server, the server.log still shows the setSyncStatus(): collision message:

Wed Oct  3 20:20:49 2018: [=======] Server shutdown complete.
Wed Oct  3 20:21:06 2018: [=======] Starting kopano-server version 8.6.2 (pid 31476)
Wed Oct  3 20:21:06 2018: [error  ] Coredumps will not be generated: kopano-server requires the fs.suid_dumpable sysctl to contain the value 2, not 0. See kopano-coredump(5) for details.
Wed Oct  3 20:21:06 2018: [crit   ] ECSearchFolders::Search() GetEntryListToObjectList failed: 0x80000015
Wed Oct  3 20:21:08 2018: [error  ] setSyncStatus(): collision

And searches are still incomplete.

Anything i can do to resolve this?

Same effect here with Ubuntu 18.04, core-8.6.81.475_0+86-Ubuntu_18.04-amd64
Also did a kopano-server --restart-searches

@jmx said in Results missing from search:

MAPIErrorNetworkError: MAPI error 80040115 (MAPI_E_NETWORK_ERROR)

MAPI_E_NETWORK_ERROR usually means that kopano-search could not connect to kopano-server.

@umgfoin
Thanx for your reply. Saw those topics, seemed similar but because of slightly different error messages could not tell if they are the same.

@fbartels
They are both on the same machine. Default KC install on UCS 4.3.1 (no manual config changes except for log output).
Is this most likely cause or side-effect, and if cause: any hints on where to look?

I have the same issue.
Also did a kopano-server --restart-searches

Centos 7 latest kopano packages.

I have the feeling that some things are mixed up here. That setSyncStatus(): collision is a logged is a known issue in the master builds, for more info see (as already linked by @umgfoin https://forum.kopano.io/topic/1745/kopano-server-setsyncstatus-collision/11). While restarting searches can cure a specific case of setSyncStatus(): collision this has nothing to do if the kopano-search service will be successful in creating a complete search index or not.

If there are items missing from search, then most of the time the cure is to drop the search index or reindex a single user (if you don’t want to drop the while index). The man page for kopano-search contains instructions how to reindex a single user.