Can't create/update contacts in Evolution | kdav (git) with Core 8.7.82

irreleph4nt

Re: Request for Feedback: New CalDAV and CardDAV implementation for Kopano

Hi,

Your forum software suggested I open another topic because the thread referenced above is “quite old”, so here we go.

The gist of my problem is this: When I try to update an existing contact or create a new one in Evolution Email (Linux), the request times out in kdav.
I have had this working back in July and have copied my config across, the only difference is that I am now on Centos 7 instead of Arch Linux.

I am using this:

kdav from git master (on a subdomain)
kopano-core 8.7.82
nginx with php-fpm
mysql

Consider updating an existing contact. What Evolution does is, it opens a window with all current contact details. You change something and hit “save”. Now the window fades a bit in color, indicating the software is working on the request. After roughly a minute however the following error is displayed and request failed, i.e. no update done:

Evolution Error:

Daten konnten nicht gesendet werden: HTTP-Fehlercode 504 (Gateway Time-out): Der Server antwortete mit einer HTML-Seite, was bedeuten kann, dass auf dem Server oder bei der Anfrage des Clients ein Fehler auftrat. Die verwendete Adresse war: https://dav.maerzlab.de/server.php/addressbooks/robert/Contacts/6e9b3adb0425ed3bfc6cd3a8db768f09e4d35631.vcf

At the same time, nginx logs this:

2019/09/12 23:52:37 [error] 26176#26176: *56 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.168.0.1, server: dav.maerzlab.de, request: "PUT /server.php/addressbooks/robert/Contacts/6e9b3adb0425ed3bfc6cd3a8db768f09e4d35631.vcf HTTP/1.1", upstream: "fastcgi://unix:/run/php-fpm/webapp.sock", host: "dav.maerzlab.de"

php-fpm says this:

[12-Sep-2019 23:51:37] WARNING: pid 26805, (null)(), line 0: [pool webapp] child 26815 said into stderr: "NOTICE: sapi_cgi_log_message(), line 624: PHP message: PHP Warning:  "continue" targeting switch is equivalent to "break". Did you mean to use "continue 2"? in /var/www/html/kopano-kdav/vendor/sabre/dav/lib/CalDAV/ICSExportPlugin.php on line 321"
[12-Sep-2019 23:51:37] DEBUG: pid 26805, fpm_event_loop(), line 430: event module triggered 1 events
[12-Sep-2019 23:54:02] WARNING: [pool webapp] child 24078, script '/var/www/html/kopano-kdav//server.php' (request: "PUT /server.php") execution timed out (145.013476 sec), terminating
[12-Sep-2019 23:54:02] WARNING: [pool webapp] child 24078 exited on signal 15 (SIGTERM) after 2444.322209 seconds from start

And finally, kdav itself goes all the way to this, but then never progresses beyond the last line:

The kdav log above is an entire sequence of adding the contact list in Evolution, opening an existing record, trying an update, failing, trying to create a new contact, failing again.
During all this time, Kopano Core simply logs an accepted connection from localhost on the socket and a successfull authentication attempt. What’s killing me is that everything works, from adding the account, using existing contacts and even the kdav web view. I just can’t create or update contacts in a fat client. Z-Push by contrast works without issue, just like the webapp.

Something I noticed is that kdav isn’t writing anything into it’s database, irrespective of whether I use sqlite or mysql.

Any help you can provide is appreciated! If you are interested in debugging this, I can grant you access to the server in case that helps.

Thank you.

Manfred

Hi irreleph4nt,

did I understand you correctly that kdav.log ends like this:

12.09.2019 23:51:37 [24078] [TRACE]  dav KopanoDavBackend->GetStore(): storename robert

?

When you update a contact in Z-Push or Webapp is that contact in Evolution also updated?

Did you also check syslog for errors?

Manfred

irreleph4nt

@Manfred
Hi,

Yes, that is right. Any update or creation I attempt via Evolution stops at that log line in kdav. Nothing happens past that point.
And yes, updates made via Z-Push are available in Evolution as well. Like newly created contacts, changes to details etc.

Thank you for looking at this! :)

EDIT: Now, to add to the head-scratching, I have played around with this more today and found that using the Calendar / CardDAV with Evolution works.
I can view, create, edit and save appointments just fine. I have also tried a very simplistic nginx config that works with plain sabre/dav. The problem and how it presents itself however has not changed.

kopano-kdav.conf

server {

        listen 80;
        server_name     dav.domain.tld;
        root            /var/www/html/kopano-kdav/;

        index server.php;

        # rewrite  ^/(.*)$  /server.php/$1  permanent;
        rewrite (.*) /server.php$uri break;

        location ~ ^(.+\.php)(.*)$ {
             fastcgi_split_path_info ^(.+\.php)(/.+)$;
             fastcgi_pass webapp-handler;
             fastcgi_param SCRIPT_FILENAME $request_filename;
             fastcgi_index server.php;
             include fastcgi_params;
       }
}

irreleph4nt

@Manfred do you have any idea what might be the issue here?

Manfred

Hi irreleph4nt,

are there any errors in syslog? Are there any errors in server or other logs of kopano?

Did you try to create a new user with just a couple of contacts and test it with evolution?

Manfred

irreleph4nt

@Manfred

Hi,

This setup is on a clean dev box, so I have tried an account with 2 contacts set up via webapp and an entirely new one, meaning no pre-existing entries at all. The error messages are the same.

What’s a bit worrying is that kopano-server logs basically nothing as I try to edit or create contacts but then starts when I create a calendar entry instead:

Tue Sep 17 12:18:12 2019: [debug  ] Accepted incoming connection from file:///var/run/kopano/server.sock
Tue Sep 17 12:20:00 2019: [debug  ] Previous message logged 24 times
Tue Sep 17 12:20:00 2019: [warning] SQL [00000393] info: Try to reconnect
Tue Sep 17 12:20:00 2019: [debug  ] Accepted incoming connection from file:///var/run/kopano/server.sock

12.18 is me playing around with contacts, 12:20 is me adding a calendar entry.
For the same actions, this is what the syslog says:

Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xce12b7fb89eded94
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xc6e32a2b627fe885
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x4c0cfce0e0c58541
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xe73021444e207df3
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x218970638bbc840f
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x4dcab1a332f3af44
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xbd034792c9c56b1d
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x25adb6aa25696745
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x940e6ac97b78d77
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x60b03808c940dd06
Sep 17 12:18:28 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x9b42bf7c49c078b6
Sep 17 12:18:28 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x134c79a8ea8044ae
Sep 17 12:19:02 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xfc060854b6d1255b
Sep 17 12:19:02 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xf94ac04fb92d84d6
Sep 17 12:19:33 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xb9f6105a6afb79a
Sep 17 12:19:33 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x796d41dd938e5a6a
Sep 17 12:19:33 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x793cc2172183178b
Sep 17 12:19:33 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xb1a66529e439c8b7
Sep 17 12:19:33 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x27edb311ccb4635
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xa97f676a1e3733c7
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xd7534c6f603c0c8d
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x27cddfa8f337d53f
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x96de09a6eccf1de7
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x622d4171315155e1
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xe70c012bf699c0db
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xff42bf78ab82f044
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: access allowed objectid=9 type=3 ownername="Everyone" username="robert" rights="view"
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: access allowed objectid=9 type=3 ownername="Everyone" username="robert" rights="read"
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: access allowed objectid=101 type=5 ownername="Everyone" username="robert" rights="read"
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: access allowed objectid=101 type=5 ownername="Everyone" username="robert" rights="edit"

kdav uses the same php-fpm socket as webapp, that’s why you see the name of the webapp socket above. For the calendar entry I also get a huge count of rows in the kdav log, which is too long to post here. Even there everything points towards success though with HTTP 200 and all. It’s the contacts bit that doesn’t work.
I have checked all other logs I could think of, includign kopano’s, but non mention anything related to this activity which is not already in my opening post.

ersaxp

Using Gnome Evolution 3.26 on openSUSE Leap 15.1; CalDAV Calendar is working using KDAV, but Contacts is problematic. After creating a contact in Webapp, if I refresh the CardDAV Contacts under Evolution, I get the error:

The address book backend servicing “Contacts” encountered an error. The reported error was "Failed to parse XML data".

If I try to create a contact under Evolution, I get the error:

Failed to put data: HTTP error code 8 (Message Corrupt)

In the kdav.log file, I find this (my name and my server’s name have been replaced with ‘myname’ and ‘myserver.com’):

17.09.2019 22:00:08 [16179] [DEBUG] main ------------------ Start
17.09.2019 22:00:08 [16179] [DEBUG] main PUT /addressbooks/myname/Contacts/fd33c274ea237ff205449190325869e891c50490.vcf
17.09.2019 22:00:08 [16179] [DEBUG] main KDAV version GIT
17.09.2019 22:00:08 [16179] [DEBUG] main SabreDAV version 3.2.2
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoSyncState->__construct(): Using db sqlite:/var/lib/kopano/kdav/syncstate.db
17.09.2019 22:00:08 [16179] [DEBUG] main KLogger->LogIncoming(): INPUT
PUT /addressbooks/myname/Contacts/fd33c274ea237ff205449190325869e891c50490.vcf HTTP/1.1
Host: mail.myserver.com:2080
User-Agent: Evolution/3.26.6
Connection: close
Cache-Control: no-cache
Pragma: no-cache
If-None-Match: *
Content-Type: text/vcard; charset="utf-8"
Accept-Language: en-us, en;q=0.9
Content-Length: 409
Authorization: Basic REDACTED

BEGIN:VCARD
VERSION:3.0
URL:
TITLE:
ROLE:
X-EVOLUTION-MANAGER:
X-EVOLUTION-ASSISTANT:
NICKNAME:
X-EVOLUTION-SPOUSE:
NOTE:
FN:Test 3 User
N:User;Test;3;;
X-EVOLUTION-FILE-AS:User\, Test
X-EVOLUTION-BLOG-URL:
CALURI:
FBURL:
X-EVOLUTION-VIDEO-URL:
X-MOZILLA-HTML:FALSE
EMAIL;TYPE=WORK:ersaxp@gmail.com
TEL;TYPE=WORK,VOICE:(508) 451-8227
UID:fd33c274ea237ff205449190325869e891c50490
END:VCARD
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->Logon(): myname / password
17.09.2019 22:00:08 [16179] [DEBUG]  dav KopanoDavBackend->Logon(): Auth: OK - user myname - session Resource id #10
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetUser(): myname
17.09.2019 22:00:08 [16179] [TRACE] card KopanoCardDavBackend->getAddressBooksForUser(): principalUri: principals/myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetFolders(): principal 'principals/myname', classes 'Array
(
    [0] => IPF.Contact
)
'
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetFolders(): found 2 folders: Array
(
    [0] => Array
        (
            [id] => principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
            [uri] => Contacts
            [principaluri] => principals/myname
            [{http://sabredav.org/ns}sync-token] => 0000000000
            [{DAV:}displayname] => Contacts
            [{http://calendarserver.org/ns/}getctag] => 1568756991
        )

    [1] => Array
        (
            [id] => principals/myname:d3f9201dc6f54eaea960ebc086c23357320000000000
            [uri] => Suggested Contacts
            [principaluri] => principals/myname
            [{http://sabredav.org/ns}sync-token] => 0000000000
            [{DAV:}displayname] => Suggested Contacts
            [{http://calendarserver.org/ns/}getctag] => 0000000000
        )

)

17.09.2019 22:00:08 [16179] [TRACE] card KopanoCardDavBackend->getCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: fd33c274ea237ff205449190325869e891c50490.vcf
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Searching for 'fd33c274ea237ff205449190325869e891c50490' in 'principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000' (Resource id #15)
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try PR_SOURCE_KEY fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try APPTTSREF fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetCustomProperties(): Fetching properties id:principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [DEBUG]  dav KopanoDavBackend->GetMapiMessageForId(): Nothing found for fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [DEBUG] card KopanoCardDavBackend->getCard(): Object NOT FOUND
17.09.2019 22:00:08 [16179] [TRACE] card KopanoCardDavBackend->getCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: fd33c274ea237ff205449190325869e891c50490.vcf
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Searching for 'fd33c274ea237ff205449190325869e891c50490' in 'principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000' (Resource id #17)
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try PR_SOURCE_KEY fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try APPTTSREF fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [DEBUG]  dav KopanoDavBackend->GetMapiMessageForId(): Nothing found for fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [DEBUG] card KopanoCardDavBackend->getCard(): Object NOT FOUND
17.09.2019 22:00:08 [16179] [TRACE] card KopanoCardDavBackend->getCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: fd33c274ea237ff205449190325869e891c50490.vcf
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Searching for 'fd33c274ea237ff205449190325869e891c50490' in 'principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000' (Resource id #19)
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try PR_SOURCE_KEY fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try APPTTSREF fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [DEBUG]  dav KopanoDavBackend->GetMapiMessageForId(): Nothing found for fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [DEBUG] card KopanoCardDavBackend->getCard(): Object NOT FOUND
17.09.2019 22:00:08 [16179] [TRACE] card KopanoCardDavBackend->createCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: fd33c274ea237ff205449190325869e891c50490.vcf - cardData: BEGIN:VCARD
VERSION:3.0
URL:
TITLE:
ROLE:
X-EVOLUTION-MANAGER:
X-EVOLUTION-ASSISTANT:
NICKNAME:
X-EVOLUTION-SPOUSE:
NOTE:
FN:Test 3 User
N:User;Test;3;;
X-EVOLUTION-FILE-AS:User\, Test
X-EVOLUTION-BLOG-URL:
CALURI:
FBURL:
X-EVOLUTION-VIDEO-URL:
X-MOZILLA-HTML:FALSE
EMAIL;TYPE=WORK:ersaxp@gmail.com
TEL;TYPE=WORK,VOICE:(508) 451-8227
UID:fd33c274ea237ff205449190325869e891c50490
END:VCARD
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE] card KopanoCardDavBackend->setData(): mapimessage: Resource id #24 - vcf: BEGIN:VCARD
VERSION:3.0
URL:
TITLE:
ROLE:
X-EVOLUTION-MANAGER:
X-EVOLUTION-ASSISTANT:
NICKNAME:
X-EVOLUTION-SPOUSE:
NOTE:
FN:Test 3 User
N:User;Test;3;;
X-EVOLUTION-FILE-AS:User\, Test
X-EVOLUTION-BLOG-URL:
CALURI:
FBURL:
X-EVOLUTION-VIDEO-URL:
X-MOZILLA-HTML:FALSE
EMAIL;TYPE=WORK:ersaxp@gmail.com
TEL;TYPE=WORK,VOICE:(508) 451-8227
UID:fd33c274ea237ff205449190325869e891c50490
END:VCARD
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname

So, looking at the log above, it seems like the vcf is making through KDAV, and KDAV actually finds my contact list and my suggested contact list, and finds that the new contact doesn’t exist yet. But why it’s not writing it into the contact list is a mystery.

Now, I tried another experiment where I tried to import my entire VCF list, which, from Evolution’s perspective completes without error. I watch the progress bar go all the way across, and then go away like nothing even happened. Looking at the KDAV log, I see similar output to that above, where KDAV receives the vcard, displays it in the log, does a lookup, finds my two contact lists, does the search, can’t find it, tries again, then stops, basically in the same spot as mentioned in the previous example, except that I have a section like this for every contact I tried to import (about 75 of them). In performing the import, I made sure to select the CardDAV contact list “Contacts”, which Evolution knows to exist when doing a lookup check:

16.09.2019 02:13:21 [24182] [DEBUG] main ------------------ Start
16.09.2019 02:13:21 [24182] [DEBUG] main PUT /addressbooks/myname/Contacts/2b44948f-5a05-4ac8-ab33-b4acc00c3463.vcf
16.09.2019 02:13:21 [24182] [DEBUG] main KDAV version GIT
16.09.2019 02:13:21 [24182] [DEBUG] main SabreDAV version 3.2.2
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoSyncState->__construct(): Using db sqlite:/var/lib/kopano/kdav/syncstate.db
16.09.2019 02:13:21 [24182] [DEBUG] main KLogger->LogIncoming(): INPUT
PUT /addressbooks/myname/Contacts/2b44948f-5a05-4ac8-ab33-b4acc00c3463.vcf HTTP/1.1
Host: mail.myserver.com:2080
User-Agent: Evolution/3.26.6
Connection: close
Cache-Control: no-cache
Pragma: no-cache
If-None-Match: *
Content-Type: text/vcard; charset="utf-8"
Accept-Language: en-us, en;q=0.9
Content-Length: 150
Authorization: Basic REDACTED

BEGIN:VCARD
VERSION:3.0
UID:2b44948f-5a05-4ac8-ab33-b4acc00c3463
FN:Drew Madison
TEL;TYPE=CELL,VOICE:+1 303-520-1016
N:Madison;Drew;;;
END:VCARD
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->Logon(): myname / password
16.09.2019 02:13:21 [24182] [DEBUG]  dav KopanoDavBackend->Logon(): Auth: OK - user myname - session Resource id #10
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetUser(): myname
16.09.2019 02:13:21 [24182] [TRACE] card KopanoCardDavBackend->getAddressBooksForUser(): principalUri: principals/myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetFolders(): principal 'principals/myname', classes 'Array
(
    [0] => IPF.Contact
)
'
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetFolders(): found 2 folders: Array
(
    [0] => Array
        (
            [id] => principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
            [uri] => Contacts
            [principaluri] => principals/myname
            [{http://sabredav.org/ns}sync-token] => 0000000000
            [{DAV:}displayname] => Contacts
            [{http://calendarserver.org/ns/}getctag] => 0000000000
        )

    [1] => Array
        (
            [id] => principals/myname:d3f9201dc6f54eaea960ebc086c23357320000000000
            [uri] => Suggested Contacts
            [principaluri] => principals/myname
            [{http://sabredav.org/ns}sync-token] => 0000000000
            [{DAV:}displayname] => Suggested Contacts
            [{http://calendarserver.org/ns/}getctag] => 0000000000
        )

)

16.09.2019 02:13:21 [24182] [TRACE] card KopanoCardDavBackend->getCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: 2b44948f-5a05-4ac8-ab33-b4acc00c3463.vcf
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Searching for '2b44948f-5a05-4ac8-ab33-b4acc00c3463' in 'principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000' (Resource id #15)
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try APPTTSREF 2b44948f-5a05-4ac8-ab33-b4acc00c3463
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetCustomProperties(): Fetching properties id:principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [DEBUG]  dav KopanoDavBackend->GetMapiMessageForId(): Nothing found for 2b44948f-5a05-4ac8-ab33-b4acc00c3463
16.09.2019 02:13:21 [24182] [DEBUG] card KopanoCardDavBackend->getCard(): Object NOT FOUND
16.09.2019 02:13:21 [24182] [TRACE] card KopanoCardDavBackend->getCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: 2b44948f-5a05-4ac8-ab33-b4acc00c3463.vcf
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Searching for '2b44948f-5a05-4ac8-ab33-b4acc00c3463' in 'principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000' (Resource id #17)
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try APPTTSREF 2b44948f-5a05-4ac8-ab33-b4acc00c3463
16.09.2019 02:13:21 [24182] [DEBUG]  dav KopanoDavBackend->GetMapiMessageForId(): Nothing found for 2b44948f-5a05-4ac8-ab33-b4acc00c3463
16.09.2019 02:13:21 [24182] [DEBUG] card KopanoCardDavBackend->getCard(): Object NOT FOUND
16.09.2019 02:13:21 [24182] [TRACE] card KopanoCardDavBackend->getCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: 2b44948f-5a05-4ac8-ab33-b4acc00c3463.vcf
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Searching for '2b44948f-5a05-4ac8-ab33-b4acc00c3463' in 'principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000' (Resource id #19)
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try APPTTSREF 2b44948f-5a05-4ac8-ab33-b4acc00c3463
16.09.2019 02:13:21 [24182] [DEBUG]  dav KopanoDavBackend->GetMapiMessageForId(): Nothing found for 2b44948f-5a05-4ac8-ab33-b4acc00c3463
16.09.2019 02:13:21 [24182] [DEBUG] card KopanoCardDavBackend->getCard(): Object NOT FOUND
16.09.2019 02:13:21 [24182] [TRACE] card KopanoCardDavBackend->createCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: 2b44948f-5a05-4ac8-ab33-b4acc00c3463.vcf - cardData: BEGIN:VCARD
VERSION:3.0
UID:2b44948f-5a05-4ac8-ab33-b4acc00c3463
FN:Drew Madison
TEL;TYPE=CELL,VOICE:+1 303-520-1016
N:Madison;Drew;;;
END:VCARD
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE] card KopanoCardDavBackend->setData(): mapimessage: Resource id #24 - vcf: BEGIN:VCARD
VERSION:3.0
UID:2b44948f-5a05-4ac8-ab33-b4acc00c3463
FN:Drew Madison
TEL;TYPE=CELL,VOICE:+1 303-520-1016
N:Madison;Drew;;;
END:VCARD
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname

If there’s additional data I can collect to help out, please let me know.

irreleph4nt

@ersaxp
I can’t help you with that but I am glad to see I am not the only person reporting this problem. In case you figure this out please let me know. Struggling with exactly the same issue.

EDIT: For reference, this is the thread where I am describing the same issue as ersaxp: Can’t create or update contacts in Evolution with kdav (git)

ersaxp

@irreleph4nt yes, I read through your post and was quite hopeful, but alas, nothing yet. I also looked at a post that talked about VCard 3 support vs. VCard 4 support, and commented out VC4 for now as a test; same results.

ersaxp

I should also mention that I’m running the official release version for openSUSE Leap 15.1: Kopano packages 8.6.0.0-lp151.2.5; I’m trying to stay pure to the release, but if you advise I move to the latest release, I’m happy to try that. KDAV is the latest available from git.

Manfred

Hi @ersaxp,

I moved your posts to this topic as it seems to be the same issue.

I didn’t have time yet to debug this more intensively, but it’s on my task list. I’ll post here if I have more questions or in case I’ll find something.

Manfred

ersaxp

@Manfred Thank you!

irreleph4nt

@Manfred
Have you had the chance yet to look at this?

Manfred

Hi,

I was not able to reproduce it on the systems I’ve tested. Those were debian-based systems though. It worked fine using apache as well as nginx with php-fpm. I’ve tested with KC 8.7.0 and 8.7.5.

Manfred

irreleph4nt

@Manfred
So I’ll have to re-test with 8.7 then? Hm … okay.

Edit:
if it helps at all, I can upload my configs somewhere or even get you access to the machine. It’s just a Dev box so nothing sensitive stored on it. I am happy to support debugging this in whichever way is helpful to you.

Manfred

Hi @irreleph4nt,

did you to configure another carddav client except evolution? Maybe configure a carddav account on your mobile device? So that we have a better idea if editing contacts fails in kdav or if it’s related to evolution only.

Manfred

irreleph4nt

@Manfred

Hi,
the blow is the kdav log for when I am trying to set up CardDav-Sync Free on Android, connect it to Kdav and try creating a user. My phone reports a ~~success~~ failure but the new contact does not show up in Kopano (tested in Webapp and Evolution) and the end of the log clearly shows the same stop behavior as the previous attempts with Evolution.

Phone log:

java.lang.Exception: could not upload new resource
org.dmfs.j.a.a(Unknown Source:280)
org.dmfs.j.b.a(Unknown Source:27)
org.dmfs.g.g.a(Unknown Source:9)
org.dmfs.carddav.syncadapter.a.a(Unknown Source:1594)
org.dmfs.h.a.onPerformSync(Unknown Source:989)
android.content.AbstractThreadedSyncAdapter$SyncThread.run(AbstractThreadedSyncAdapter.java:334)
caused by:
java.io.IOException: Error 504 during upload of 
BEGIN:VCARD
VERSION:3.0
N:Georgi;Hans Peter;;;
FN:Hans Peter Georgi
PRODID:-//dmfs.org//mimedir.vcard//EN
REV:20190925T002254Z
UID:290d8a4b-922c-43c5-8192-1bd65b51c90e
END:VCARD

org.dmfs.dav.b.a(Unknown Source:180)
org.dmfs.dav.b.a(Unknown Source:2)
org.dmfs.j.a.a(Unknown Source:147)
org.dmfs.j.b.a(Unknown Source:27)
org.dmfs.g.g.a(Unknown Source:9)
org.dmfs.carddav.syncadapter.a.a(Unknown Source:1594)
org.dmfs.h.a.onPerformSync(Unknown Source:989)
android.content.AbstractThreadedSyncAdapter$SyncThread.run(AbstractThreadedSyncAdapter.java:334)

App: org.dmfs.carddav.sync
App version: 0.4.21
OS version: 28
OS Info: google/walleye/walleye:9/PQ3A.190801.002/5670241:user/release-keys
Manufacturer: Google
Date: Wed Sep 25 02:23:54 GMT+02:00 2019

Manfred

Hi @irreleph4nt,

could please test the following: download the files attached to the issue https://jira.kopano.io/projects/KDAV/issues/KDAV-20. Edit $user and $pass of kdav-20.php to match a user on your system (also check if $server and $path are correct for your system).

Then run:

php kdav-20.php -f kdav20fail
php kdav-20 php -f kdav20ok

and post the output.

Manfred

irreleph4nt

@Manfred

Hi. I made the changes and ran the commands as instructed. kdav20fail comes back with an error message right away, kdav20ok however hangs infinitely:

[root@mx2 kopano-kdav]# su nginx -s /bin/bash
bash-4.2$ php kdav
kdav20fail   kdav20ok     kdav-20.php  
bash-4.2$ php kdav-20.php -f kdav20fail 
mapi_vcftomapi failed with code: 0xFFFFFFFF8004011B
bash-4.2$ php kdav-20.php -f kdav20ok

Last line is where I am not even getting a cursor back unless I ctrl+c.

Interestingly I see this in the journal throughout the period of time I left the kdav20ok command running as the nginx user:

Sep 25 23:50:47 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php" sid=0x7cb3b803b8f7e0d9
Sep 25 23:50:47 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php" sid=0xa75fe1fcc49d8abd
Sep 25 23:50:55 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php" sid=0xd61a953a3477a7b2
Sep 25 23:50:55 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php" sid=0xa8306aece582626

vs output when running as root:

Sep 25 23:55:06 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="Pipe socket" program="php" sid=0xdd18f36cd65a9b0d
Sep 25 23:55:06 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="Pipe socket" program="php" sid=0x27afd5701a189b31
Sep 25 23:55:11 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="Pipe socket" program="php" sid=0xd25bbea952b2965a
Sep 25 23:55:11 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="Pipe socket" program="php" sid=0x26ca7c927b1badfb

I am not getting any output in the kdav logs when running these two tests.

irreleph4nt

@Manfred
Have you had any luck tracing down the source for this issue?