Results missing from search

jmx

Hi there,

I’m running Kopano 8.6.2 on UCS, upgraded from ZCP7.2 some time ago. I’m noticing that there are results missing from searches.

The Kopano server.log file was showing a lot of lines like:

Wed Oct  3 16:04:57 2018: [warning] SSL_accept() failed in soap_ssl_accept()
Wed Oct  3 16:05:00 2018: [error  ] setSyncStatus(): collision
Wed Oct  3 16:13:20 2018: [error  ] Previous message logged 100 times

So, as suggested in other topics i ran a:

service kopano-server stop
kopano-server --restart-searches

After this Kopano server.log is showing the rebuild:

Wed Oct  3 19:58:08 2018: [=======] Server shutdown complete.
Wed Oct  3 19:59:19 2018: [=======] Starting kopano-server version 8.6.2 (pid 28190)
Wed Oct  3 19:59:19 2018: [error  ] Coredumps will not be generated: kopano-server requires the fs.suid_dumpable sysctl to contain the value 2, not 0. See kopano-coredump(5) for details.
Wed Oct  3 19:59:20 2018: [crit   ] ECSearchFolders::Search() GetEntryListToObjectList failed: 0x80000015
Wed Oct  3 19:59:20 2018: [crit   ] Starting rebuild of search folders... This may take a while.
Wed Oct  3 19:59:20 2018: [crit   ]   Rebuilding searchfolders of store 3
Wed Oct  3 19:59:20 2018: [error  ] Error while querying search on "file:///var/run/kopano/search.sock", 0x80040115
Wed Oct  3 19:59:21 2018: [crit   ] ECSearchFolders::Search() GetEntryListToObjectList failed: 0x80000015
Wed Oct  3 19:59:24 2018: [crit   ]   Rebuilding searchfolders of store 449
Wed Oct  3 19:59:24 2018: [crit   ]   Rebuilding searchfolders of store 496
Wed Oct  3 19:59:24 2018: [crit   ]   Rebuilding searchfolders of store 555
Wed Oct  3 19:59:24 2018: [crit   ]   Rebuilding searchfolders of store 2815
Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 276725
Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 378212
Wed Oct  3 19:59:25 2018: [crit   ] ECSearchFolders::Search() CreateSessionInternal failed: 0x80000002
Wed Oct  3 19:59:25 2018: [crit   ] Previous message logged 4 times
Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 688235
Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 895341
Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 1028850
Wed Oct  3 19:59:26 2018: [crit   ]   Rebuilding searchfolders of store 1298896
Wed Oct  3 19:59:26 2018: [crit   ]   Rebuilding searchfolders of store 1298922
Wed Oct  3 19:59:26 2018: [crit   ] ECSearchFolders::Search() CreateSessionInternal failed: 0x80000002
Wed Oct  3 19:59:26 2018: [crit   ]   Rebuilding searchfolders of store 1383326
Wed Oct  3 19:59:26 2018: [crit   ]   Rebuilding searchfolders of store 1438396
Wed Oct  3 19:59:27 2018: [crit   ]   Rebuilding searchfolders of store 1617777
Wed Oct  3 19:59:29 2018: [crit   ]   Rebuilding searchfolders of store 1698844
Wed Oct  3 19:59:29 2018: [crit   ]   Rebuilding searchfolders of store 1870814
Wed Oct  3 19:59:30 2018: [crit   ]   Rebuilding searchfolders of store 1939568
Wed Oct  3 19:59:31 2018: [crit   ]   Rebuilding searchfolders of store 2040006
Wed Oct  3 19:59:31 2018: [crit   ]   Rebuilding searchfolders of store 2088383
Wed Oct  3 19:59:31 2018: [crit   ]   Rebuilding searchfolders of store 2156442
Wed Oct  3 19:59:31 2018: [error  ] setSyncStatus(): collision

But Kopano search.log is showing the following message a few times:

2018-10-03 19:58:10,059 - search - ERROR - Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/kopano/log.py", line 89, in log_exc
    try: yield
  File "/usr/lib/python2.7/dist-packages/kopano_search/__init__.py", line 382, in incremental_sync
    new_state = self.server.sync(importer, self.state, log=self.log)
  File "/usr/lib/python2.7/dist-packages/kopano/server.py", line 715, in sync
    return _ics.sync(self, self.mapistore, importer, state, log or self.log, max_changes, window=window, begin=begin, end=end, stats=stats)
  File "/usr/lib/python2.7/dist-packages/kopano/ics.py", line 218, in sync
    exporter.Config(stream, flags, importer, restriction, None, None, 0)
  File "/usr/lib/python2.7/dist-packages/MAPICore.py", line 1902, in Config
    return _MAPICore.IExchangeExportChanges_Config(self, lpStream, ulFlags, lpUnk, lpRestriction, lpIncludeProps, lpExcludeProps, ulBufferSize)
MAPIErrorNetworkError: MAPI error 80040115 (MAPI_E_NETWORK_ERROR)

After restarting the Kopano server, the server.log still shows the setSyncStatus(): collision message:

Wed Oct  3 20:20:49 2018: [=======] Server shutdown complete.
Wed Oct  3 20:21:06 2018: [=======] Starting kopano-server version 8.6.2 (pid 31476)
Wed Oct  3 20:21:06 2018: [error  ] Coredumps will not be generated: kopano-server requires the fs.suid_dumpable sysctl to contain the value 2, not 0. See kopano-coredump(5) for details.
Wed Oct  3 20:21:06 2018: [crit   ] ECSearchFolders::Search() GetEntryListToObjectList failed: 0x80000015
Wed Oct  3 20:21:08 2018: [error  ] setSyncStatus(): collision

And searches are still incomplete.

Anything i can do to resolve this?

Ihon

Same effect here with Ubuntu 18.04, core-8.6.81.475_0+86-Ubuntu_18.04-amd64
Also did a kopano-server --restart-searches

umgfoin

Hi,
there’re already ongoing discussions here:

++umgfoin.

fbartels

@jmx said in Results missing from search:

MAPIErrorNetworkError: MAPI error 80040115 (MAPI_E_NETWORK_ERROR)

MAPI_E_NETWORK_ERROR usually means that kopano-search could not connect to kopano-server.

jmx

@umgfoin
Thanx for your reply. Saw those topics, seemed similar but because of slightly different error messages could not tell if they are the same.

@fbartels
They are both on the same machine. Default KC install on UCS 4.3.1 (no manual config changes except for log output).
Is this most likely cause or side-effect, and if cause: any hints on where to look?

I have the same issue.
Also did a kopano-server --restart-searches

Centos 7 latest kopano packages.

fbartels

I have the feeling that some things are mixed up here. That setSyncStatus(): collision is a logged is a known issue in the master builds, for more info see (as already linked by @umgfoin https://forum.kopano.io/topic/1745/kopano-server-setsyncstatus-collision/11). While restarting searches can cure a specific case of setSyncStatus(): collision this has nothing to do if the kopano-search service will be successful in creating a complete search index or not.

If there are items missing from search, then most of the time the cure is to drop the search index or reindex a single user (if you don’t want to drop the while index). The man page for kopano-search contains instructions how to reindex a single user.

jmx

@fbartels
I already ran:

service kopano-server stop
kopano-server --restart-searches

and for some specific users:

kopano-search --reindex <username>

This will make all the current items searchable, but anything new (after this action) will not turn up in searches. Kopano-search is running though (more or less):

systemctl status kopano-search.service
● kopano-search.service - Kopano Core Search Engine
   Loaded: loaded (/lib/systemd/system/kopano-search.service; enabled; vendor preset: enabled)
   Active: active (running) since Wed 2018-10-03 20:21:52 CEST; 2 weeks 4 days ago
     Docs: man:kopano-search(8)
           man:kopano-search.cfg(5)
 Main PID: 31525 (kopano-search)
    Tasks: 9 (limit: 4915)
   Memory: 308.7M
      CPU: 17h 37min 58.479s
   CGroup: /system.slice/kopano-search.service
           ├─31525 /usr/bin/python2 /usr/sbin/kopano-search -F
           ├─31529 /usr/bin/python2 /usr/sbin/kopano-search -F
           └─31530 /usr/bin/python2 /usr/sbin/kopano-search -F

Oct 20 23:08:21 webmail kopano-search[31525]: [error  ] virtual HRESULT M4LMAPISession::OpenEntry(ULONG, const ENTRYID*, const IID*, ULONG, ULONG*, IUnknown**): OpenEntry(2) failed: not found (8004010f)
Oct 21 00:08:35 webmail kopano-search[31525]: [error  ] Previous message logged 20 times
Oct 21 00:08:35 webmail kopano-search[31525]: [error  ] M4LMAPISession::OpenEntry() invalid parameters
Oct 21 00:08:59 webmail kopano-search[31525]: [error  ] virtual HRESULT M4LMAPISession::OpenEntry(ULONG, const ENTRYID*, const IID*, ULONG, ULONG*, IUnknown**): OpenEntry(2) failed: not found (8004010f)
Oct 21 23:07:53 webmail kopano-search[31525]: [error  ] Previous message logged 18 times
Oct 21 23:07:53 webmail kopano-search[31525]: [error  ] M4LMAPISession::OpenEntry() invalid parameters
Oct 21 23:08:22 webmail kopano-search[31525]: [error  ] virtual HRESULT M4LMAPISession::OpenEntry(ULONG, const ENTRYID*, const IID*, ULONG, ULONG*, IUnknown**): OpenEntry(2) failed: not found (8004010f)
Oct 22 00:08:09 webmail kopano-search[31525]: [error  ] Previous message logged 20 times
Oct 22 00:08:09 webmail kopano-search[31525]: [error  ] M4LMAPISession::OpenEntry() invalid parameters
Oct 22 00:08:34 webmail kopano-search[31525]: [error  ] virtual HRESULT M4LMAPISession::OpenEntry(ULONG, const ENTRYID*, const IID*, ULONG, ULONG*, IUnknown**): OpenEntry(2) failed: not found (8004010f)

Anything else i can test/provide?

fbartels

@jmx it sounds strange that recreating the index always only fills the index to the date that the index has been recreated. I would recommend to get in contact with our support to have a deeper look on the system.

It may be an idea to update to the latest dot release first. https://wiki.z-hub.io/display/K4U/Updating+Kopano+packages+directly+from+the+Kopano+download+server has instrictions on how to do that with Univention.