Results missing from search



  • Hi there,

    I’m running Kopano 8.6.2 on UCS, upgraded from ZCP7.2 some time ago. I’m noticing that there are results missing from searches.

    The Kopano server.log file was showing a lot of lines like:

    Wed Oct  3 16:04:57 2018: [warning] SSL_accept() failed in soap_ssl_accept()
    Wed Oct  3 16:05:00 2018: [error  ] setSyncStatus(): collision
    Wed Oct  3 16:13:20 2018: [error  ] Previous message logged 100 times
    

    So, as suggested in other topics i ran a:

    service kopano-server stop
    kopano-server --restart-searches
    

    After this Kopano server.log is showing the rebuild:

    Wed Oct  3 19:58:08 2018: [=======] Server shutdown complete.
    Wed Oct  3 19:59:19 2018: [=======] Starting kopano-server version 8.6.2 (pid 28190)
    Wed Oct  3 19:59:19 2018: [error  ] Coredumps will not be generated: kopano-server requires the fs.suid_dumpable sysctl to contain the value 2, not 0. See kopano-coredump(5) for details.
    Wed Oct  3 19:59:20 2018: [crit   ] ECSearchFolders::Search() GetEntryListToObjectList failed: 0x80000015
    Wed Oct  3 19:59:20 2018: [crit   ] Starting rebuild of search folders... This may take a while.
    Wed Oct  3 19:59:20 2018: [crit   ]   Rebuilding searchfolders of store 3
    Wed Oct  3 19:59:20 2018: [error  ] Error while querying search on "file:///var/run/kopano/search.sock", 0x80040115
    Wed Oct  3 19:59:21 2018: [crit   ] ECSearchFolders::Search() GetEntryListToObjectList failed: 0x80000015
    Wed Oct  3 19:59:24 2018: [crit   ]   Rebuilding searchfolders of store 449
    Wed Oct  3 19:59:24 2018: [crit   ]   Rebuilding searchfolders of store 496
    Wed Oct  3 19:59:24 2018: [crit   ]   Rebuilding searchfolders of store 555
    Wed Oct  3 19:59:24 2018: [crit   ]   Rebuilding searchfolders of store 2815
    Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 276725
    Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 378212
    Wed Oct  3 19:59:25 2018: [crit   ] ECSearchFolders::Search() CreateSessionInternal failed: 0x80000002
    Wed Oct  3 19:59:25 2018: [crit   ] Previous message logged 4 times
    Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 688235
    Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 895341
    Wed Oct  3 19:59:25 2018: [crit   ]   Rebuilding searchfolders of store 1028850
    Wed Oct  3 19:59:26 2018: [crit   ]   Rebuilding searchfolders of store 1298896
    Wed Oct  3 19:59:26 2018: [crit   ]   Rebuilding searchfolders of store 1298922
    Wed Oct  3 19:59:26 2018: [crit   ] ECSearchFolders::Search() CreateSessionInternal failed: 0x80000002
    Wed Oct  3 19:59:26 2018: [crit   ]   Rebuilding searchfolders of store 1383326
    Wed Oct  3 19:59:26 2018: [crit   ]   Rebuilding searchfolders of store 1438396
    Wed Oct  3 19:59:27 2018: [crit   ]   Rebuilding searchfolders of store 1617777
    Wed Oct  3 19:59:29 2018: [crit   ]   Rebuilding searchfolders of store 1698844
    Wed Oct  3 19:59:29 2018: [crit   ]   Rebuilding searchfolders of store 1870814
    Wed Oct  3 19:59:30 2018: [crit   ]   Rebuilding searchfolders of store 1939568
    Wed Oct  3 19:59:31 2018: [crit   ]   Rebuilding searchfolders of store 2040006
    Wed Oct  3 19:59:31 2018: [crit   ]   Rebuilding searchfolders of store 2088383
    Wed Oct  3 19:59:31 2018: [crit   ]   Rebuilding searchfolders of store 2156442
    Wed Oct  3 19:59:31 2018: [error  ] setSyncStatus(): collision
    

    But Kopano search.log is showing the following message a few times:

    2018-10-03 19:58:10,059 - search - ERROR - Traceback (most recent call last):
      File "/usr/lib/python2.7/dist-packages/kopano/log.py", line 89, in log_exc
        try: yield
      File "/usr/lib/python2.7/dist-packages/kopano_search/__init__.py", line 382, in incremental_sync
        new_state = self.server.sync(importer, self.state, log=self.log)
      File "/usr/lib/python2.7/dist-packages/kopano/server.py", line 715, in sync
        return _ics.sync(self, self.mapistore, importer, state, log or self.log, max_changes, window=window, begin=begin, end=end, stats=stats)
      File "/usr/lib/python2.7/dist-packages/kopano/ics.py", line 218, in sync
        exporter.Config(stream, flags, importer, restriction, None, None, 0)
      File "/usr/lib/python2.7/dist-packages/MAPICore.py", line 1902, in Config
        return _MAPICore.IExchangeExportChanges_Config(self, lpStream, ulFlags, lpUnk, lpRestriction, lpIncludeProps, lpExcludeProps, ulBufferSize)
    MAPIErrorNetworkError: MAPI error 80040115 (MAPI_E_NETWORK_ERROR)
    

    After restarting the Kopano server, the server.log still shows the setSyncStatus(): collision message:

    Wed Oct  3 20:20:49 2018: [=======] Server shutdown complete.
    Wed Oct  3 20:21:06 2018: [=======] Starting kopano-server version 8.6.2 (pid 31476)
    Wed Oct  3 20:21:06 2018: [error  ] Coredumps will not be generated: kopano-server requires the fs.suid_dumpable sysctl to contain the value 2, not 0. See kopano-coredump(5) for details.
    Wed Oct  3 20:21:06 2018: [crit   ] ECSearchFolders::Search() GetEntryListToObjectList failed: 0x80000015
    Wed Oct  3 20:21:08 2018: [error  ] setSyncStatus(): collision
    

    And searches are still incomplete.

    Anything i can do to resolve this?



  • Same effect here with Ubuntu 18.04, core-8.6.81.475_0+86-Ubuntu_18.04-amd64
    Also did a kopano-server --restart-searches




  • Kopano

    @jmx said in Results missing from search:

    MAPIErrorNetworkError: MAPI error 80040115 (MAPI_E_NETWORK_ERROR)

    MAPI_E_NETWORK_ERROR usually means that kopano-search could not connect to kopano-server.



  • @umgfoin
    Thanx for your reply. Saw those topics, seemed similar but because of slightly different error messages could not tell if they are the same.

    @fbartels
    They are both on the same machine. Default KC install on UCS 4.3.1 (no manual config changes except for log output).
    Is this most likely cause or side-effect, and if cause: any hints on where to look?



  • I have the same issue.
    Also did a kopano-server --restart-searches

    Centos 7 latest kopano packages.


  • Kopano

    I have the feeling that some things are mixed up here. That setSyncStatus(): collision is a logged is a known issue in the master builds, for more info see (as already linked by @umgfoin https://forum.kopano.io/topic/1745/kopano-server-setsyncstatus-collision/11). While restarting searches can cure a specific case of setSyncStatus(): collision this has nothing to do if the kopano-search service will be successful in creating a complete search index or not.

    If there are items missing from search, then most of the time the cure is to drop the search index or reindex a single user (if you don’t want to drop the while index). The man page for kopano-search contains instructions how to reindex a single user.



  • @fbartels
    I already ran:

    service kopano-server stop
    kopano-server --restart-searches
    

    and for some specific users:

    kopano-search --reindex <username>
    

    This will make all the current items searchable, but anything new (after this action) will not turn up in searches. Kopano-search is running though (more or less):

    systemctl status kopano-search.service
    ● kopano-search.service - Kopano Core Search Engine
       Loaded: loaded (/lib/systemd/system/kopano-search.service; enabled; vendor preset: enabled)
       Active: active (running) since Wed 2018-10-03 20:21:52 CEST; 2 weeks 4 days ago
         Docs: man:kopano-search(8)
               man:kopano-search.cfg(5)
     Main PID: 31525 (kopano-search)
        Tasks: 9 (limit: 4915)
       Memory: 308.7M
          CPU: 17h 37min 58.479s
       CGroup: /system.slice/kopano-search.service
               ├─31525 /usr/bin/python2 /usr/sbin/kopano-search -F
               ├─31529 /usr/bin/python2 /usr/sbin/kopano-search -F
               └─31530 /usr/bin/python2 /usr/sbin/kopano-search -F
    
    Oct 20 23:08:21 webmail kopano-search[31525]: [error  ] virtual HRESULT M4LMAPISession::OpenEntry(ULONG, const ENTRYID*, const IID*, ULONG, ULONG*, IUnknown**): OpenEntry(2) failed: not found (8004010f)
    Oct 21 00:08:35 webmail kopano-search[31525]: [error  ] Previous message logged 20 times
    Oct 21 00:08:35 webmail kopano-search[31525]: [error  ] M4LMAPISession::OpenEntry() invalid parameters
    Oct 21 00:08:59 webmail kopano-search[31525]: [error  ] virtual HRESULT M4LMAPISession::OpenEntry(ULONG, const ENTRYID*, const IID*, ULONG, ULONG*, IUnknown**): OpenEntry(2) failed: not found (8004010f)
    Oct 21 23:07:53 webmail kopano-search[31525]: [error  ] Previous message logged 18 times
    Oct 21 23:07:53 webmail kopano-search[31525]: [error  ] M4LMAPISession::OpenEntry() invalid parameters
    Oct 21 23:08:22 webmail kopano-search[31525]: [error  ] virtual HRESULT M4LMAPISession::OpenEntry(ULONG, const ENTRYID*, const IID*, ULONG, ULONG*, IUnknown**): OpenEntry(2) failed: not found (8004010f)
    Oct 22 00:08:09 webmail kopano-search[31525]: [error  ] Previous message logged 20 times
    Oct 22 00:08:09 webmail kopano-search[31525]: [error  ] M4LMAPISession::OpenEntry() invalid parameters
    Oct 22 00:08:34 webmail kopano-search[31525]: [error  ] virtual HRESULT M4LMAPISession::OpenEntry(ULONG, const ENTRYID*, const IID*, ULONG, ULONG*, IUnknown**): OpenEntry(2) failed: not found (8004010f)
    

    Anything else i can test/provide?


  • Kopano

    @jmx it sounds strange that recreating the index always only fills the index to the date that the index has been recreated. I would recommend to get in contact with our support to have a deeper look on the system.

    It may be an idea to update to the latest dot release first. https://wiki.z-hub.io/display/K4U/Updating+Kopano+packages+directly+from+the+Kopano+download+server has instrictions on how to do that with Univention.


Log in to reply