Incident: kopano-search and kopano-presence services not stopping gracefully



  • Date Seen
    Approximately 05.12.2016, this problem occurs since Zarafa 7.2.3.

    Versions
    Ubuntu 16.04.1 LTS
    Kopano 8.3.0-534
    Apache 2.4.18
    MySQL 5.7.16

    Bug Description
    Stopping the kopano-search or the kopano-presence service cannot be done gracefully and will be timed out. The processes will be killed by systemd.

    Severity
    Major

    Steps to Reproduce
    Stop kopano-search or kopano-presence service and review the logs:
    0_1483745130023_upload-ff772b20-7021-4914-bee9-6b366d94c506

    Actual Behavior
    It’s not possible to stop kopano-search and kopano-presence gracefully. Systemd kills the processes after a 30 second timeout wich leads to unexpected reboot times.

    Expected Behavior
    The processes can be terminated gracefully.

    Troubleshooting/Testing Steps Attempted
    Maybe there are some changes needed in the init scripts. I didn’t touch them.

    Workaround
    Just sit back and wait an extra minute.



  • I just upgraded to Kopano Core 8.3.0-585 and this problem is still present.

    Regards
    Richard



  • I just upgraded to Kopano Core 8.3.0-618 and this problem is still present.

    Regards
    Richard



  • I just upgraded to Kopano Core 8.3.0-694 and this problem is still present.

    Regards
    Richard


  • Kopano

    @darootler thanks for reporting. I created https://jira.kopano.io/browse/KC-522 for this.



  • @fbartels

    Thank you!

    Regards
    Richard


  • Kopano

    Hi @darootler ,

    we just closed https://jira.kopano.io/browse/KC-522 since we are not able to reproduce this error any longer. can you confirm?



  • @fbartels

    I am still having this issue. I am using Kopano 8.4.0-125.

    user@host:~$ sudo systemctl stop kopano-presence.service
    user@host:~$ sudo systemctl status kopano-presence.service
    ● kopano-presence.service - Kopano Core Presence Daemon
       Loaded: loaded (/lib/systemd/system/kopano-presence.service; enabled; vendor
       Active: failed (Result: signal) since Tue 2017-03-28 16:54:17 CEST; 6s ago
      Process: 19362 ExecStart=/usr/sbin/kopano-presence -F (code=killed, signal=KIL
     Main PID: 19362 (code=killed, signal=KILL)
    
    Mar 28 16:52:19 host systemd[1]: Started Kopano Core Presence Daemon.
    Mar 28 16:52:19 host kopano-presence[19362]: 2017-03-28 16:52:19,925 - presenc
    Mar 28 16:52:19 host kopano-presence[19362]: 2017-03-28 16:52:19,933 - presenc
    Mar 28 16:52:19 host kopano-presence[19362]:  * Running on http://0.0.0.0:1234
    Mar 28 16:52:47 host systemd[1]: Stopping Kopano Core Presence Daemon...
    Mar 28 16:54:17 host systemd[1]: kopano-presence.service: State 'stop-sigterm'
    Mar 28 16:54:17 host systemd[1]: kopano-presence.service: Main process exited,
    Mar 28 16:54:17 host systemd[1]: Stopped Kopano Core Presence Daemon.
    Mar 28 16:54:17 host systemd[1]: kopano-presence.service: Unit entered failed
    Mar 28 16:54:17 host systemd[1]: kopano-presence.service: Failed with result '
    lines 1-16/16 (END)
    ● kopano-presence.service - Kopano Core Presence Daemon
       Loaded: loaded (/lib/systemd/system/kopano-presence.service; enabled; vendor preset: enabled)
       Active: failed (Result: signal) since Tue 2017-03-28 16:54:17 CEST; 6s ago
      Process: 19362 ExecStart=/usr/sbin/kopano-presence -F (code=killed, signal=KILL)
     Main PID: 19362 (code=killed, signal=KILL)
    
    Mar 28 16:52:19 host systemd[1]: Started Kopano Core Presence Daemon.
    Mar 28 16:52:19 host kopano-presence[19362]: 2017-03-28 16:52:19,925 - presence - INFO - starting presence
    Mar 28 16:52:19 host kopano-presence[19362]: 2017-03-28 16:52:19,933 - presence - INFO - spreed: plugin enabled
    Mar 28 16:52:19 host kopano-presence[19362]:  * Running on http://0.0.0.0:1234/ (Press CTRL+C to quit)
    Mar 28 16:52:47 host systemd[1]: Stopping Kopano Core Presence Daemon...
    Mar 28 16:54:17 host systemd[1]: kopano-presence.service: State 'stop-sigterm' timed out. Killing.
    Mar 28 16:54:17 host systemd[1]: kopano-presence.service: Main process exited, code=killed, status=9/KILL
    Mar 28 16:54:17 host systemd[1]: Stopped Kopano Core Presence Daemon.
    Mar 28 16:54:17 host systemd[1]: kopano-presence.service: Unit entered failed state.
    Mar 28 16:54:17 host systemd[1]: kopano-presence.service: Failed with result 'signal'.
    

    Regards
    Richard


  • Kopano

    @darootler just did an upgrade to latest master, but still no error.

    [...]
    Setting up kopano-presence (8.4.0~131-37.1) ...
    [...]
    root@felixkc522:~# systemctl status kopano-presence.service 
    ● kopano-presence.service - Kopano Core Presence Daemon
       Loaded: loaded (/lib/systemd/system/kopano-presence.service; enabled; vendor preset: enabled)
       Active: active (running) since Tue 2017-03-28 16:39:20 CEST; 16s ago
     Main PID: 3528 (kopano-presence)
       CGroup: /system.slice/kopano-presence.service
               └─3528 /usr/bin/python /usr/sbin/kopano-presence -F
    
    Mar 28 16:39:20 felixkc522 systemd[1]: Stopped Kopano Core Presence Daemon.
    Mar 28 16:39:20 felixkc522 systemd[1]: Started Kopano Core Presence Daemon.
    Mar 28 16:39:20 felixkc522 kopano-presence[3528]:  * Running on http://0.0.0.0:1234/ (Press CTRL+C to quit)
    root@felixkc522:~# systemctl stop kopano-presence.service 
    root@felixkc522:~# systemctl status kopano-presence.service 
    ● kopano-presence.service - Kopano Core Presence Daemon
       Loaded: loaded (/lib/systemd/system/kopano-presence.service; enabled; vendor preset: enabled)
       Active: inactive (dead) since Tue 2017-03-28 16:39:43 CEST; 1s ago
     Main PID: 3528 (code=exited, status=0/SUCCESS)
    
    Mar 28 16:39:20 felixkc522 systemd[1]: Stopped Kopano Core Presence Daemon.
    Mar 28 16:39:20 felixkc522 systemd[1]: Started Kopano Core Presence Daemon.
    Mar 28 16:39:20 felixkc522 kopano-presence[3528]:  * Running on http://0.0.0.0:1234/ (Press CTRL+C to quit)
    Mar 28 16:39:43 felixkc522 systemd[1]: Stopping Kopano Core Presence Daemon...
    Mar 28 16:39:43 felixkc522 systemd[1]: Stopped Kopano Core Presence Daemon.
    root@felixkc522:~#
    

    PS: please use code blocks instead of screenshots



  • @fbartels

    I am still having this issue. Any suggestions? Any ideas?

    This is driving me crazing because sometimes Ubuntu won’t shutdown and just hangs during a reboot…

    Regards
    Richard



  • I am able to pinn down the problem:

    kopano-presence and kopano-search is stopping well if “log_method” is set to “file”. If “log_method” is set to “syslog” both services will not stop properly.

    Can someone confirm this behavior?

    Regards
    Richard



  • I see the same issue with kopano-search. I have not tried to change my log_method from syslog to file, however.

    With log_method set to syslog kopano-search also does not stop gracefully for me.



  • @fbartels

    Could you please reopen the related ticket and update it?

    Thanks
    Richard


  • Kopano

    @darootler I still want to reproduce the error locally so that I have something on hand to give to a developer and verify the fix. Once I had time to do so, I’ll create a new ticket.



  • @fbartels

    Sure, thank you.

    Regards
    Richard


  • Kopano

    ok, with the additional of information that syslog logging has to be enabled for the error to occur I was able to reproduce this isse. https://jira.kopano.io/browse/KC-643 has been created to resolve this issue.



Looks like your connection to Kopano Community Forum was lost, please wait while we try to reconnect.