Kopano-Gateway crashes during mass import of mails

[Goulasch]

kopano-server 8.6.2.1-0+5.1
kopano-gateway version 8.6.2
kopano-core_20181010132900/amd64
dpkg version 8.4.5.0-0+33.2 500
-> on a UCS DC Master version UCS 4.3-2
-> with Debian 4.9.110-3+deb9u6 (2018-10-08)
-> on an ESXi 6.7 with 1,536 MB RAM + 1 CPU
–> vm maschine created from UCS-VMware-ESX-Image.ova (8.11.2018) with a 2nd disk extention for the mysql-files with a hardlink on a SSD

Process:
Import/copying 120.000 mails from local OSX (Mail) Server (same VM server) via desktop client (here emClient).
In this scenario:
Copy only one mailbox folder with 66 subfolder (to split the amount of mails). Only Webapp running parallel (no concurrent access with other clients)

The folder and all subfolders created as mentioned.
Mails in 1st & 2nd subfolders were completed taken over.
After 96 mails (from in the third folder the crash took place.

Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] ----------------------------------------------------------------------
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] Fatal error detected. Please report all following information.
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] Application kopano-gateway version: 8.6.2
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] OS: Linux, release: 4.9.0-8-amd64, version: #1 SMP Debian 4.9.110-3+deb9u6 (2018-10-08), hardware: x86_64
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] Thread name: ZGateway IMAP
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] Peak RSS: 752972
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] Pid 870 caught SIGABRT (6), out of memory or unhandled exception, traceback:
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] Backtrace:
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #0. /usr/lib/libkcutil.so.0(+0x2962d) [0x7f5f578e162d]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #1. /usr/lib/libkcutil.so.0(+0x22275) [0x7f5f578da275]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #2. /usr/lib/libkcutil.so.0(_ZN2KC23generic_sigsegv_handlerEPNS_8ECLoggerEPKcS3_iPK9siginfo_tPKv+0x1c1) [0x7f5f578da551]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #3. /lib/x86_64-linux-gnu/libpthread.so.0(+0x110c0) [0x7f5f574a30c0]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #4. /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcf) [0x7f5f53b8afff]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #5. /lib/x86_64-linux-gnu/libc.so.6(abort+0x16a) [0x7f5f53b8c42a]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #6. /usr/lib/x86_64-linux-gnu/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x15d) [0x7f5f544a30ad]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #7. /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0x8f066) [0x7f5f544a1066]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #8. /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0x8f0b1) [0x7f5f544a10b1]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #9. /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0x8f2c9) [0x7f5f544a12c9]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #10. /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0x8f7ec) [0x7f5f544a17ec]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #11. /usr/lib/x86_64-linux-gnu/libstdc++.so.6(_ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEE9_M_mutateEmmPKcm+0x59) [0x7f5f5452fae9]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #12. /usr/lib/x86_64-linux-gnu/libstdc++.so.6(_ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEE9_M_appendEPKcm+0x63) [0x7f5f54531073]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #13. /usr/lib/libkcssl.so.0(_ZN2KC9ECChannel11HrWriteLineERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x53) [0x7f5f576b2ce3]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #14. /usr/sbin/kopano-gateway(+0xed03) [0x55bf6dc88d03]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #15. /usr/sbin/kopano-gateway(+0x23042) [0x55bf6dc9d042]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #16. /usr/sbin/kopano-gateway(+0x23914) [0x55bf6dc9d914]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #17. /usr/sbin/kopano-gateway(+0x32309) [0x55bf6dcac309]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #18. /usr/sbin/kopano-gateway(+0xa7ba) [0x55bf6dc847ba]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #19. /lib/x86_64-linux-gnu/libpthread.so.0(+0x7494) [0x7f5f57499494]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] #20. /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f) [0x7f5f53c40acf]
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] Signal errno: Success, signal code: -6
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] Sender pid: 870, sender uid: 998, si_status: 0
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] Signal value: 0, faulting address: 0x3e600000366
Wed Nov 14 07:00:59 2018: [ZGateway IMAP|T13808] [crit   ] When reporting this traceback, please include Linux distribution name (and version), system architecture and Kopano version.
Wed Nov 14 07:07:38 2018: [kopano-gateway|T15001] [=======] Starting kopano-gateway version 8.6.2 (pid 15001)
root@ucs-4423:~# 

May be the amount of ram is too low and I have to increase it (although "top "does not show any noticeable use of the swap range).
Should it really be that, the application should still not crash completely.

Which I noticed anyway for the kopano-gateway:
when many concurrent requests come, the gateway seems to have handling issues with it. This creates many time-outs that are not due to the network.
However, so far I have not been able to find concrete evidence in the logs.

[thctlo]

old bug, upgrade to at least 8.6.6 8.6.7 or 8.6.8