after upgrade kopano-server 8.7.80.465.4206adbb5 all users gone

umgfoin

Good morning,
Any hints in server.log?
You already converted your database-scheme to utf8mb4? (kopano-dbadm usmp)?
Ref. here: RELNOTES.txt
++umgfoin.

@umgfoin

this was indeed the problem.

After the db conversion all is ok.

Thank you!

john3377

This post is deleted!

john3377

This post is deleted!

fbartels

Hi @ckruijntjens ,

thanks for your report. I have created https://jira.kopano.io/browse/KC-1378 to check this internally. But since there have not been any further reports about this I am wondering if this could actually be an error in the server.

@fbartels

Hi. No please do not report a bug. it was my error. i did not know that we need to run

kopano-dbadm usmp

After i run this the problems where solved.

fbartels

the thing is: you should not be required to run this command

@fbartels

A ok. Perfect then its a bug.

Do you have any news on the spamd error in an other post? i got the sam error as other users.

https://forum.kopano.io/topic/2027/kopano-spamd-error-permissionerror-errno-1-operation-not-permitted/19

umgfoin

Hi Felix,
fyi, my server-log, after upgrading to git-master 8.7.80.466.
All problems gone with 2nd restart following mb4-conversion.

Tue Jan  8 16:52:11 2019: [=======] Starting kopano-server version 8.7.80.466 (pid 27370 uid 0)
Tue Jan  8 16:52:11 2019: [info   ] Using epoll events
Tue Jan  8 16:52:11 2019: [notice ] Listening for TCP connections on port 236
Tue Jan  8 16:52:11 2019: [notice ] Listening for priority pipe connections on /var/run/kopano/prio.sock
Tue Jan  8 16:52:11 2019: [notice ] Listening for pipe connections on /var/run/kopano/server.sock
Tue Jan  8 16:52:11 2019: [info   ] Audit logging not enabled.
Tue Jan  8 16:52:11 2019: [=======] Starting kopano-server version 8.7.80.466 (pid 27370 uid 482)
Tue Jan  8 16:52:11 2019: [info   ] Using epoll events
Tue Jan  8 16:52:11 2019: [notice ] Listening for TCP connections on port 236
Tue Jan  8 16:52:11 2019: [notice ] Listening for priority pipe connections on /var/run/kopano/prio.sock
Tue Jan  8 16:52:11 2019: [notice ] Listening for pipe connections on /var/run/kopano/server.sock
Tue Jan  8 16:52:11 2019: [notice ] Connection to database 'kopano_db' succeeded
Tue Jan  8 16:52:11 2019: [warning] K-1244: Your database does not support storing 4-byte UTF-8! The content of some mails may be truncated. The DB should be upgraded with `kopano-dbadm usmp` and kopano-server be restarted.
Tue Jan  8 16:52:11 2019: [notice ] Querying database for searchfolders. This may take a while.
Tue Jan  8 16:52:11 2019: [notice ] Loading search folders.
Tue Jan  8 16:52:11 2019: [notice ] Done loading search folders.
Tue Jan  8 16:52:11 2019: [notice ] Startup succeeded on pid 27374
Tue Jan  8 16:52:11 2019: [info   ] Auto-creating user from external source
Tue Jan  8 16:52:31 2019: [info   ] Previous message logged 100 times
Tue Jan  8 16:52:31 2019: [info   ] Auto-creating user from external source
Tue Jan  8 16:52:51 2019: [info   ] Previous message logged 100 times

[…]

Tue Jan  8 17:18:24 2019: [info   ] Auto-creating user from external source
Tue Jan  8 17:18:24 2019: [info   ] Previous message logged 5 times
Tue Jan  8 17:18:24 2019: [warning] Shutting down
Tue Jan  8 17:18:24 2019: [info   ] Shutdown all current sessions
Tue Jan  8 17:18:24 2019: [info   ] Shutdown notification manager
Tue Jan  8 17:18:25 2019: [notice ] Waiting for mysql_server_end
Tue Jan  8 17:18:25 2019: [notice ] Waiting for mysql_library_end
Tue Jan  8 17:18:25 2019: [=======] Server shutdown complete.
Tue Jan  8 17:18:26 2019: [info   ] Audit logging not enabled.
Tue Jan  8 17:18:26 2019: [=======] Starting kopano-server version 8.7.80.466 (pid 1350 uid 0)
Tue Jan  8 17:18:26 2019: [info   ] Using epoll events
Tue Jan  8 17:18:26 2019: [notice ] Listening for TCP connections on port 236
Tue Jan  8 17:18:26 2019: [notice ] Listening for priority pipe connections on /var/run/kopano/prio.sock
Tue Jan  8 17:18:26 2019: [notice ] Listening for pipe connections on /var/run/kopano/server.sock
Tue Jan  8 17:18:26 2019: [info   ] Audit logging not enabled.
Tue Jan  8 17:18:26 2019: [=======] Starting kopano-server version 8.7.80.466 (pid 1350 uid 482)
Tue Jan  8 17:18:26 2019: [info   ] Using epoll events
Tue Jan  8 17:18:26 2019: [notice ] Listening for TCP connections on port 236
Tue Jan  8 17:18:26 2019: [notice ] Listening for priority pipe connections on /var/run/kopano/prio.sock
Tue Jan  8 17:18:26 2019: [notice ] Listening for pipe connections on /var/run/kopano/server.sock
Tue Jan  8 17:18:26 2019: [notice ] Connection to database 'kopano_db' succeeded
Tue Jan  8 17:18:26 2019: [warning] K-1244: Your database does not support storing 4-byte UTF-8! The content of some mails may be truncated. The DB should be upgraded with `kopano-dbadm usmp` and kopano-server be restarted.
Tue Jan  8 17:18:26 2019: [notice ] Querying database for searchfolders. This may take a while.
Tue Jan  8 17:18:26 2019: [notice ] Loading search folders.
Tue Jan  8 17:18:26 2019: [notice ] Done loading search folders.
Tue Jan  8 17:18:26 2019: [notice ] Startup succeeded on pid 1354
Tue Jan  8 17:18:32 2019: [info   ] Auto-creating user from external source
Tue Jan  8 17:19:22 2019: [info   ] Previous message logged 100 times
Tue Jan  8 17:19:22 2019: [info   ] Auto-creating user from external source
Tue Jan  8 17:19:49 2019: [info   ] Previous message logged 35 times
Tue Jan  8 17:19:49 2019: [warning] Shutting down
Tue Jan  8 17:19:49 2019: [info   ] Shutdown all current sessions
Tue Jan  8 17:19:49 2019: [crit   ] ----------------------------------------------------------------------
Tue Jan  8 17:20:01 2019: [info   ] Audit logging not enabled.
Tue Jan  8 17:20:01 2019: [=======] Starting kopano-server version 8.7.80.466 (pid 1663 uid 0)
Tue Jan  8 17:20:01 2019: [info   ] Using epoll events
Tue Jan  8 17:20:01 2019: [notice ] Listening for TCP connections on port 236
Tue Jan  8 17:20:01 2019: [notice ] Listening for priority pipe connections on /var/run/kopano/prio.sock
Tue Jan  8 17:20:01 2019: [notice ] Listening for pipe connections on /var/run/kopano/server.sock
Tue Jan  8 17:20:01 2019: [info   ] Audit logging not enabled.
Tue Jan  8 17:20:01 2019: [=======] Starting kopano-server version 8.7.80.466 (pid 1663 uid 482)
Tue Jan  8 17:20:01 2019: [info   ] Using epoll events
Tue Jan  8 17:20:01 2019: [notice ] Listening for TCP connections on port 236
Tue Jan  8 17:20:01 2019: [notice ] Listening for priority pipe connections on /var/run/kopano/prio.sock
Tue Jan  8 17:20:01 2019: [notice ] Listening for pipe connections on /var/run/kopano/server.sock
Tue Jan  8 17:20:01 2019: [notice ] Connection to database 'kopano_db' succeeded
Tue Jan  8 17:20:01 2019: [notice ] Querying database for searchfolders. This may take a while.
Tue Jan  8 17:20:02 2019: [notice ] Loading search folders.
Tue Jan  8 17:20:02 2019: [notice ] Done loading search folders.
Tue Jan  8 17:20:02 2019: [notice ] Startup succeeded on pid 1667
Tue Jan  8 17:20:59 2019: [warning] Shutting down
Tue Jan  8 17:20:59 2019: [info   ] Shutdown all current sessions
Tue Jan  8 17:20:59 2019: [error  ] K-1249: abandoned dfpair/ECDatabase instance
Tue Jan  8 17:20:59 2019: [info   ] Shutdown notification manager
Tue Jan  8 17:20:59 2019: [crit   ] ----------------------------------------------------------------------
Tue Jan  8 17:20:59 2019: [crit   ] Fatal error detected. Please report all following information.
Tue Jan  8 17:20:59 2019: [crit   ] Application kopano-server version: 8.7.80.466
Tue Jan  8 17:20:59 2019: [crit   ] OS: Linux, release: 2.6.32-042stab120.20, version: #1 SMP Fri Mar 10 16:52:50 MSK 2017, hardware: x86_64
Tue Jan  8 17:20:59 2019: [crit   ] Thread name: z-s: idle threa
Tue Jan  8 17:20:59 2019: [crit   ] Peak RSS: 13252
Tue Jan  8 17:20:59 2019: [crit   ] Pid 1667 caught SIGSEGV (11), traceback:
Tue Jan  8 17:20:59 2019: [crit   ] Backtrace:
Tue Jan  8 17:21:00 2019: [info   ] Audit logging not enabled.
Tue Jan  8 17:21:00 2019: [=======] Starting kopano-server version 8.7.80.466 (pid 2037 uid 0)
Tue Jan  8 17:21:00 2019: [info   ] Using epoll events
Tue Jan  8 17:21:00 2019: [notice ] Listening for TCP connections on port 236
Tue Jan  8 17:21:00 2019: [notice ] Listening for priority pipe connections on /var/run/kopano/prio.sock
Tue Jan  8 17:21:00 2019: [notice ] Listening for pipe connections on /var/run/kopano/server.sock
Tue Jan  8 17:21:00 2019: [info   ] Audit logging not enabled.
Tue Jan  8 17:21:00 2019: [=======] Starting kopano-server version 8.7.80.466 (pid 2037 uid 482)
Tue Jan  8 17:21:00 2019: [info   ] Using epoll events
Tue Jan  8 17:21:00 2019: [notice ] Listening for TCP connections on port 236
Tue Jan  8 17:21:00 2019: [notice ] Listening for priority pipe connections on /var/run/kopano/prio.sock
Tue Jan  8 17:21:00 2019: [notice ] Listening for pipe connections on /var/run/kopano/server.sock
Tue Jan  8 17:21:00 2019: [notice ] Connection to database 'kopano_db' succeeded
Tue Jan  8 17:21:00 2019: [notice ] Querying database for searchfolders. This may take a while.
Tue Jan  8 17:21:00 2019: [notice ] Loading search folders.
Tue Jan  8 17:21:00 2019: [notice ] Done loading search folders.
Tue Jan  8 17:21:00 2019: [notice ] Startup succeeded on pid 2041

++umgfoin.

fbartels

@umgfoin are you referring to:

Tue Jan  8 17:20:59 2019: [crit   ] Fatal error detected. Please report all following information.
Tue Jan  8 17:20:59 2019: [crit   ] Application kopano-server version: 8.7.80.466
Tue Jan  8 17:20:59 2019: [crit   ] OS: Linux, release: 2.6.32-042stab120.20, version: #1 SMP Fri Mar 10 16:52:50 MSK 2017, hardware: x86_64
Tue Jan  8 17:20:59 2019: [crit   ] Thread name: z-s: idle threa
Tue Jan  8 17:20:59 2019: [crit   ] Peak RSS: 13252
Tue Jan  8 17:20:59 2019: [crit   ] Pid 1667 caught SIGSEGV (11), traceback:
Tue Jan  8 17:20:59 2019: [crit   ] Backtrace:

?

I don’t see anything else out of the ordinary or without clear instructions to fix.

umgfoin

Basically to:

Tue Jan  8 16:52:11 2019: [notice ] Startup succeeded on pid 27374
Tue Jan  8 16:52:11 2019: [info   ] Auto-creating user from external source
Tue Jan  8 16:52:31 2019: [info   ] Previous message logged 100 times
[...]

Probably as a consequence, login to the server was not possible (user/credentials rejected) until the manual db-conversion was done. (I’m havinguser_plugin = db)

The sigsegv could have been result of a make install while the server process was inadvertently still up, so don’t take to much attention on this ( I tried a src-rebuild as first measurement).

++umgfoin.

fbartels

ah, I have overlooked the “Auto-creating”. I heard this morning that when doing upgrades from 8.6 to 8.7 to master this could be observed only at the last upgrade step. We are currently busy with a customer escalation, will try to get to this some time afterwards.

umgfoin

@fbartels said in after upgrade kopano-server 8.7.80.465.4206adbb5 all users gone:

We are currently busy with a customer escalation, will try to get to this some time afterwards.

No worries. Times are anyway best for skiing, now.

fbartels

There is a pr in review for this

ikue

Is it safe to run the command “kopano-dbadm usmp” twice?

On first run, it seems that it was stopped somewhere in between with a timeout.