After upgrade from zarafa umlauts are shown as ?



  • Hello,

    After upgrading from zarafa using a database backup umlauts are shown as ? in webapp and z-push. I’m using caldav for calendar sync and z-Push for address book sync.

    Strangely caldav syncs from one device to the other (OSX, Android) perfectly. But in the Webapp all umlauts are displayed as questionsmarks.

    Additionally I’m using Z-Push to sync the contacts. Unfortunately all umlauts in the contacts are questionmarks in the Webapp and after the Z-Push sync on the devices.

    Any ideas?

    Thanks!

    Here are some locale informations from the system (Debian 8.0).

    /etc/default/locale

    #  File generated by update-locale
    LANG=de_DE.UTF-8
    

    /etc/apache2/envvars

    # envvars - default environment variables for apache2ctl
    
    # this won't be correct after changing uid
    unset HOME
    
    # for supporting multiple apache2 instances
    if [ "${APACHE_CONFDIR##/etc/apache2-}" != "${APACHE_CONFDIR}" ] ; then
    	SUFFIX="-${APACHE_CONFDIR##/etc/apache2-}"
    else
    	SUFFIX=
    fi
    
    # Since there is no sane way to get the parsed apache2 config in scripts, some
    # settings are defined via environment variables and then used in apache2ctl,
    # /etc/init.d/apache2, /etc/logrotate.d/apache2, etc.
    export APACHE_RUN_USER=www-data
    export APACHE_RUN_GROUP=www-data
    # temporary state file location. This might be changed to /run in Wheezy+1
    export APACHE_PID_FILE=/var/run/apache2/apache2$SUFFIX.pid
    export APACHE_RUN_DIR=/var/run/apache2$SUFFIX
    export APACHE_LOCK_DIR=/var/lock/apache2$SUFFIX
    # Only /var/log/apache2 is handled by /etc/logrotate.d/apache2.
    export APACHE_LOG_DIR=/var/log/apache2$SUFFIX
    
    ## The locale used by some modules like mod_dav
    export LANG=C
    ## Uncomment the following line to use the system default locale instead:
    . /etc/default/locale
    
    export LANG
    
    ## The command to get the status for 'apache2ctl status'.
    ## Some packages providing 'www-browser' need '--dump' instead of '-dump'.
    #export APACHE_LYNX='www-browser -dump'
    
    ## If you need a higher file descriptor limit, uncomment and adjust the
    ## following line (default is 8192):
    #APACHE_ULIMIT_MAX_FILES='ulimit -n 65536'
    
    ## If you would like to pass arguments to the web server, add them below
    ## to the APACHE_ARGUMENTS environment.
    #export APACHE_ARGUMENTS=''
    
    ## Enable the debug mode for maintainer scripts.
    ## This will produce a verbose output on package installations of web server modules and web application
    ## installations which interact with Apache
    #export APACHE2_MAINTSCRIPT_DEBUG=1
    

    Database stuff:

    MariaDB [zarafa]> show table status;
    +-------------------+--------+---------+------------+--------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+-------------------+----------+-----------------------------------------+---------+
    | Name              | Engine | Version | Row_format | Rows   | Avg_row_length | Data_length | Max_data_length | Index_length | Data_free | Auto_increment | Create_time         | Update_time | Check_time | Collation         | Checksum | Create_options                          | Comment |
    +-------------------+--------+---------+------------+--------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+-------------------+----------+-----------------------------------------+---------+
    | abchanges         | InnoDB |      10 | Compact    |     10 |           1638 |       16384 |               0 |        16384 |         0 |             11 | 2018-03-31 15:16:36 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | acl               | InnoDB |      10 | Compact    |     52 |            315 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:42 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | changes           | InnoDB |      10 | Compact    |  33844 |            139 |     4734976 |               0 |      7372800 |   4194304 |         112450 | 2018-03-31 15:16:36 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | deferredupdate    | InnoDB |      10 | Compact    |    256 |             64 |       16384 |               0 |        16384 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | latin1_swedish_ci |     NULL |                                         |         |
    | hierarchy         | InnoDB |      10 | Compact    |  14618 |            108 |     1589248 |               0 |       393216 |   4194304 |          18007 | 2018-03-31 15:16:36 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | indexedproperties | InnoDB |      10 | Compact    |  28814 |            127 |     3686400 |               0 |      1589248 |   4194304 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | lob               | InnoDB |      10 | Compact    |     15 |           9830 |      147456 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL | max_rows=1000000000 avg_row_length=1750 |         |
    | mvproperties      | InnoDB |      10 | Compact    |   1333 |             61 |       81920 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | names             | InnoDB |      10 | Compact    |    129 |            127 |       16384 |               0 |        65536 |         0 |            130 | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | object            | InnoDB |      10 | Compact    |      5 |           3276 |       16384 |               0 |        32768 |         0 |              6 | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | objectmvproperty  | InnoDB |      10 | Compact    |      0 |              0 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | objectproperty    | InnoDB |      10 | Compact    |     35 |            468 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | objectrelation    | InnoDB |      10 | Compact    |      0 |              0 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | outgoingqueue     | InnoDB |      10 | Compact    |      0 |              0 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | properties        | InnoDB |      10 | Compact    | 670162 |             57 |    38322176 |               0 |            0 |   4194304 |           NULL | 2018-03-31 15:13:43 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | receivefolder     | InnoDB |      10 | Compact    |     20 |            819 |       16384 |               0 |        16384 |         0 |             21 | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | searchresults     | InnoDB |      10 | Compact    |   1109 |             59 |       65536 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | settings          | InnoDB |      10 | Compact    |      5 |           3276 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | singleinstances   | InnoDB |      10 | Compact    |     15 |           1092 |       16384 |               0 |        16384 |         0 |            139 | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | stores            | InnoDB |      10 | Compact    |      7 |           2340 |       16384 |               0 |        16384 |         0 |              8 | 2018-03-31 15:16:36 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | syncedmessages    | InnoDB |      10 | Compact    |    668 |            122 |       81920 |               0 |        49152 |         0 |           NULL | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | syncs             | InnoDB |      10 | Compact    |   3794 |             77 |      294912 |               0 |       376832 |         0 |          57279 | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | tproperties       | InnoDB |      10 | Compact    | 766988 |             70 |    54116352 |               0 |     23658496 |   4194304 |           NULL | 2018-03-31 15:13:50 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | users             | InnoDB |      10 | Compact    |      7 |           2340 |       16384 |               0 |        16384 |         0 |              8 | 2018-03-31 15:16:36 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    | versions          | InnoDB |      10 | Compact    |     12 |           1365 |       16384 |               0 |            0 |         0 |           NULL | 2018-03-31 15:16:36 | NULL        | NULL       | utf8_general_ci   |     NULL |                                         |         |
    +-------------------+--------+---------+------------+--------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+-------------------+----------+-----------------------------------------+---------+
    25 rows in set (0.01 sec)
    
    MariaDB [zarafa]> select @@character_set_database;
    +--------------------------+
    | @@character_set_database |
    +--------------------------+
    | latin1                   |
    +--------------------------+
    1 row in set (0.00 sec)
    


  • Hello @Sockenfresser,

    please check following:

    locale -a | grep de_DE
    

    should give you the correct utf8 de_DE locale name.
    in my case i had to use “de_DE.utf8” instead of “de_DE.UTF-8” - but since im using centos this might not be the error.

    to check if its kopano internal, use the localize script (“https://stash.kopano.io/projects/KSC/repos/core-tools/browse/localize-folders”) to convert a testuser to de_DE - be careful with changing all users - in the past i got some errors while change all at once with the python script (could be fixed in meantime).

    in my case it was save to use this instead:

    for e in $(kopano-admin -l | tail -n+5 | head -n-1 |awk -F" " '{print $1}'); do
      echo "Change user $e"
      python localize-folders.py --user $e --lang de_DE.UTF-8
    done
    

    best regards
    coffee_is_life



  • The locale name did it! Thank you!


Log in to reply