After upgrade from zarafa umlauts are shown as ?

Hello,

After upgrading from zarafa using a database backup umlauts are shown as ? in webapp and z-push. I’m using caldav for calendar sync and z-Push for address book sync.

Strangely caldav syncs from one device to the other (OSX, Android) perfectly. But in the Webapp all umlauts are displayed as questionsmarks.

Additionally I’m using Z-Push to sync the contacts. Unfortunately all umlauts in the contacts are questionmarks in the Webapp and after the Z-Push sync on the devices.

Any ideas?

Thanks!

Here are some locale informations from the system (Debian 8.0).

/etc/default/locale

#  File generated by update-locale
LANG=de_DE.UTF-8

/etc/apache2/envvars

# envvars - default environment variables for apache2ctl

# this won't be correct after changing uid
unset HOME

# for supporting multiple apache2 instances
if [ "${APACHE_CONFDIR##/etc/apache2-}" != "${APACHE_CONFDIR}" ] ; then
	SUFFIX="-${APACHE_CONFDIR##/etc/apache2-}"
else
	SUFFIX=
fi

# Since there is no sane way to get the parsed apache2 config in scripts, some
# settings are defined via environment variables and then used in apache2ctl,
# /etc/init.d/apache2, /etc/logrotate.d/apache2, etc.
export APACHE_RUN_USER=www-data
export APACHE_RUN_GROUP=www-data
# temporary state file location. This might be changed to /run in Wheezy+1
export APACHE_PID_FILE=/var/run/apache2/apache2$SUFFIX.pid
export APACHE_RUN_DIR=/var/run/apache2$SUFFIX
export APACHE_LOCK_DIR=/var/lock/apache2$SUFFIX
# Only /var/log/apache2 is handled by /etc/logrotate.d/apache2.
export APACHE_LOG_DIR=/var/log/apache2$SUFFIX

## The locale used by some modules like mod_dav
export LANG=C
## Uncomment the following line to use the system default locale instead:
. /etc/default/locale

export LANG

## The command to get the status for 'apache2ctl status'.
## Some packages providing 'www-browser' need '--dump' instead of '-dump'.
#export APACHE_LYNX='www-browser -dump'

## If you need a higher file descriptor limit, uncomment and adjust the
## following line (default is 8192):
#APACHE_ULIMIT_MAX_FILES='ulimit -n 65536'

## If you would like to pass arguments to the web server, add them below
## to the APACHE_ARGUMENTS environment.
#export APACHE_ARGUMENTS=''

## Enable the debug mode for maintainer scripts.
## This will produce a verbose output on package installations of web server modules and web application
## installations which interact with Apache
#export APACHE2_MAINTSCRIPT_DEBUG=1

Database stuff:

MariaDB [zarafa]> show table status;
+-------------------+--------+---------+------------+--------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+-------------------+----------+-----------------------------------------+---------+
| Name              | Engine | Version | Row_format | Rows   | Avg_row_length | Data_length | Max_data_length | Index_length | Data_free | Auto_increment | Create_time         | Update_time | Check_time | Collation         | Checksum | Create_options                          | Comment |
+-------------------+--------+---------+------------+--------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+-------------------+----------+-----------------------------------------+---------+
| abchanges         | InnoDB |      10 | Compact    |     10 |           1638 |       16384 |               0 |        16384 |         0 |             11 | 2018-03-31 15:16:36 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| acl               | InnoDB |      10 | Compact    |     52 |            315 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:42 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| changes           | InnoDB |      10 | Compact    |  33844 |            139 |     4734976 |               0 |      7372800 |   4194304 |         112450 | 2018-03-31 15:16:36 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| deferredupdate    | InnoDB |      10 | Compact    |    256 |             64 |       16384 |               0 |        16384 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | latin1_swedish_ci |     NULL |                                         |         |
| hierarchy         | InnoDB |      10 | Compact    |  14618 |            108 |     1589248 |               0 |       393216 |   4194304 |          18007 | 2018-03-31 15:16:36 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| indexedproperties | InnoDB |      10 | Compact    |  28814 |            127 |     3686400 |               0 |      1589248 |   4194304 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| lob               | InnoDB |      10 | Compact    |     15 |           9830 |      147456 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL | max_rows=1000000000 avg_row_length=1750 |         |
| mvproperties      | InnoDB |      10 | Compact    |   1333 |             61 |       81920 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| names             | InnoDB |      10 | Compact    |    129 |            127 |       16384 |               0 |        65536 |         0 |            130 | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| object            | InnoDB |      10 | Compact    |      5 |           3276 |       16384 |               0 |        32768 |         0 |              6 | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| objectmvproperty  | InnoDB |      10 | Compact    |      0 |              0 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| objectproperty    | InnoDB |      10 | Compact    |     35 |            468 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| objectrelation    | InnoDB |      10 | Compact    |      0 |              0 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| outgoingqueue     | InnoDB |      10 | Compact    |      0 |              0 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| properties        | InnoDB |      10 | Compact    | 670162 |             57 |    38322176 |               0 |            0 |   4194304 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| receivefolder     | InnoDB |      10 | Compact    |     20 |            819 |       16384 |               0 |        16384 |         0 |             21 | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| searchresults     | InnoDB |      10 | Compact    |   1109 |             59 |       65536 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| settings          | InnoDB |      10 | Compact    |      5 |           3276 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| singleinstances   | InnoDB |      10 | Compact    |     15 |           1092 |       16384 |               0 |        16384 |         0 |            139 | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| stores            | InnoDB |      10 | Compact    |      7 |           2340 |       16384 |               0 |        16384 |         0 |              8 | 2018-03-31 15:16:36 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| syncedmessages    | InnoDB |      10 | Compact    |    668 |            122 |       81920 |               0 |        49152 |         0 |           NULL | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| syncs             | InnoDB |      10 | Compact    |   3794 |             77 |      294912 |               0 |       376832 |         0 |          57279 | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| tproperties       | InnoDB |      10 | Compact    | 766988 |             70 |    54116352 |               0 |     23658496 |   4194304 |           NULL | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| users             | InnoDB |      10 | Compact    |      7 |           2340 |       16384 |               0 |        16384 |         0 |              8 | 2018-03-31 15:16:36 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
| versions          | InnoDB |      10 | Compact    |     12 |           1365 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:16:36 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
+-------------------+--------+---------+------------+--------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+-------------------+----------+-----------------------------------------+---------+
25 rows in set (0.01 sec)
MariaDB [zarafa]> select @@character_set_database;
+--------------------------+
| @@character_set_database |
+--------------------------+
| latin1                   |
+--------------------------+
1 row in set (0.00 sec)

Hello @Sockenfresser,

please check following:

locale -a | grep de_DE

should give you the correct utf8 de_DE locale name.
in my case i had to use “de_DE.utf8” instead of “de_DE.UTF-8” - but since im using centos this might not be the error.

to check if its kopano internal, use the localize script (“https://stash.kopano.io/projects/KSC/repos/core-tools/browse/localize-folders”) to convert a testuser to de_DE - be careful with changing all users - in the past i got some errors while change all at once with the python script (could be fixed in meantime).

in my case it was save to use this instead:

for e in $(kopano-admin -l | tail -n+5 | head -n-1 |awk -F" " '{print $1}'); do
  echo "Change user $e"
  python localize-folders.py --user $e --lang de_DE.UTF-8
done

best regards
coffee_is_life

The locale name did it! Thank you!