Can't create/update contacts in Evolution | kdav (git) with Core 8.7.82

irreleph4nt

Hi,

This setup is on a clean dev box, so I have tried an account with 2 contacts set up via webapp and an entirely new one, meaning no pre-existing entries at all. The error messages are the same.

What’s a bit worrying is that kopano-server logs basically nothing as I try to edit or create contacts but then starts when I create a calendar entry instead:

Tue Sep 17 12:18:12 2019: [debug  ] Accepted incoming connection from file:///var/run/kopano/server.sock
Tue Sep 17 12:20:00 2019: [debug  ] Previous message logged 24 times
Tue Sep 17 12:20:00 2019: [warning] SQL [00000393] info: Try to reconnect
Tue Sep 17 12:20:00 2019: [debug  ] Accepted incoming connection from file:///var/run/kopano/server.sock

12.18 is me playing around with contacts, 12:20 is me adding a calendar entry.
For the same actions, this is what the syslog says:

Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xce12b7fb89eded94
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xc6e32a2b627fe885
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x4c0cfce0e0c58541
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xe73021444e207df3
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x218970638bbc840f
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x4dcab1a332f3af44
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xbd034792c9c56b1d
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x25adb6aa25696745
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x940e6ac97b78d77
Sep 17 12:18:12 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x60b03808c940dd06
Sep 17 12:18:28 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x9b42bf7c49c078b6
Sep 17 12:18:28 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x134c79a8ea8044ae
Sep 17 12:19:02 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xfc060854b6d1255b
Sep 17 12:19:02 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xf94ac04fb92d84d6
Sep 17 12:19:33 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xb9f6105a6afb79a
Sep 17 12:19:33 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x796d41dd938e5a6a
Sep 17 12:19:33 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x793cc2172183178b
Sep 17 12:19:33 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xb1a66529e439c8b7
Sep 17 12:19:33 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x27edb311ccb4635
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xa97f676a1e3733c7
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xd7534c6f603c0c8d
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x27cddfa8f337d53f
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x96de09a6eccf1de7
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0x622d4171315155e1
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xe70c012bf699c0db
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php-fpm: pool webapp" sid=0xff42bf78ab82f044
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: access allowed objectid=9 type=3 ownername="Everyone" username="robert" rights="view"
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: access allowed objectid=9 type=3 ownername="Everyone" username="robert" rights="read"
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: access allowed objectid=101 type=5 ownername="Everyone" username="robert" rights="read"
Sep 17 12:20:00 mx2.maerzlab.de kopano-server[20172]: access allowed objectid=101 type=5 ownername="Everyone" username="robert" rights="edit"

kdav uses the same php-fpm socket as webapp, that’s why you see the name of the webapp socket above. For the calendar entry I also get a huge count of rows in the kdav log, which is too long to post here. Even there everything points towards success though with HTTP 200 and all. It’s the contacts bit that doesn’t work.
I have checked all other logs I could think of, includign kopano’s, but non mention anything related to this activity which is not already in my opening post.

ersaxp

Using Gnome Evolution 3.26 on openSUSE Leap 15.1; CalDAV Calendar is working using KDAV, but Contacts is problematic. After creating a contact in Webapp, if I refresh the CardDAV Contacts under Evolution, I get the error:

The address book backend servicing “Contacts” encountered an error. The reported error was "Failed to parse XML data".

If I try to create a contact under Evolution, I get the error:

Failed to put data: HTTP error code 8 (Message Corrupt)

In the kdav.log file, I find this (my name and my server’s name have been replaced with ‘myname’ and ‘myserver.com’):

17.09.2019 22:00:08 [16179] [DEBUG] main ------------------ Start
17.09.2019 22:00:08 [16179] [DEBUG] main PUT /addressbooks/myname/Contacts/fd33c274ea237ff205449190325869e891c50490.vcf
17.09.2019 22:00:08 [16179] [DEBUG] main KDAV version GIT
17.09.2019 22:00:08 [16179] [DEBUG] main SabreDAV version 3.2.2
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoSyncState->__construct(): Using db sqlite:/var/lib/kopano/kdav/syncstate.db
17.09.2019 22:00:08 [16179] [DEBUG] main KLogger->LogIncoming(): INPUT
PUT /addressbooks/myname/Contacts/fd33c274ea237ff205449190325869e891c50490.vcf HTTP/1.1
Host: mail.myserver.com:2080
User-Agent: Evolution/3.26.6
Connection: close
Cache-Control: no-cache
Pragma: no-cache
If-None-Match: *
Content-Type: text/vcard; charset="utf-8"
Accept-Language: en-us, en;q=0.9
Content-Length: 409
Authorization: Basic REDACTED

BEGIN:VCARD
VERSION:3.0
URL:
TITLE:
ROLE:
X-EVOLUTION-MANAGER:
X-EVOLUTION-ASSISTANT:
NICKNAME:
X-EVOLUTION-SPOUSE:
NOTE:
FN:Test 3 User
N:User;Test;3;;
X-EVOLUTION-FILE-AS:User\, Test
X-EVOLUTION-BLOG-URL:
CALURI:
FBURL:
X-EVOLUTION-VIDEO-URL:
X-MOZILLA-HTML:FALSE
EMAIL;TYPE=WORK:ersaxp@gmail.com
TEL;TYPE=WORK,VOICE:(508) 451-8227
UID:fd33c274ea237ff205449190325869e891c50490
END:VCARD
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->Logon(): myname / password
17.09.2019 22:00:08 [16179] [DEBUG]  dav KopanoDavBackend->Logon(): Auth: OK - user myname - session Resource id #10
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetUser(): myname
17.09.2019 22:00:08 [16179] [TRACE] card KopanoCardDavBackend->getAddressBooksForUser(): principalUri: principals/myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetFolders(): principal 'principals/myname', classes 'Array
(
    [0] => IPF.Contact
)
'
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetFolders(): found 2 folders: Array
(
    [0] => Array
        (
            [id] => principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
            [uri] => Contacts
            [principaluri] => principals/myname
            [{http://sabredav.org/ns}sync-token] => 0000000000
            [{DAV:}displayname] => Contacts
            [{http://calendarserver.org/ns/}getctag] => 1568756991
        )

    [1] => Array
        (
            [id] => principals/myname:d3f9201dc6f54eaea960ebc086c23357320000000000
            [uri] => Suggested Contacts
            [principaluri] => principals/myname
            [{http://sabredav.org/ns}sync-token] => 0000000000
            [{DAV:}displayname] => Suggested Contacts
            [{http://calendarserver.org/ns/}getctag] => 0000000000
        )

)

17.09.2019 22:00:08 [16179] [TRACE] card KopanoCardDavBackend->getCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: fd33c274ea237ff205449190325869e891c50490.vcf
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Searching for 'fd33c274ea237ff205449190325869e891c50490' in 'principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000' (Resource id #15)
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try PR_SOURCE_KEY fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try APPTTSREF fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetCustomProperties(): Fetching properties id:principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [DEBUG]  dav KopanoDavBackend->GetMapiMessageForId(): Nothing found for fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [DEBUG] card KopanoCardDavBackend->getCard(): Object NOT FOUND
17.09.2019 22:00:08 [16179] [TRACE] card KopanoCardDavBackend->getCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: fd33c274ea237ff205449190325869e891c50490.vcf
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Searching for 'fd33c274ea237ff205449190325869e891c50490' in 'principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000' (Resource id #17)
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try PR_SOURCE_KEY fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try APPTTSREF fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [DEBUG]  dav KopanoDavBackend->GetMapiMessageForId(): Nothing found for fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [DEBUG] card KopanoCardDavBackend->getCard(): Object NOT FOUND
17.09.2019 22:00:08 [16179] [TRACE] card KopanoCardDavBackend->getCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: fd33c274ea237ff205449190325869e891c50490.vcf
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Searching for 'fd33c274ea237ff205449190325869e891c50490' in 'principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000' (Resource id #19)
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try PR_SOURCE_KEY fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try APPTTSREF fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [DEBUG]  dav KopanoDavBackend->GetMapiMessageForId(): Nothing found for fd33c274ea237ff205449190325869e891c50490
17.09.2019 22:00:08 [16179] [DEBUG] card KopanoCardDavBackend->getCard(): Object NOT FOUND
17.09.2019 22:00:08 [16179] [TRACE] card KopanoCardDavBackend->createCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: fd33c274ea237ff205449190325869e891c50490.vcf - cardData: BEGIN:VCARD
VERSION:3.0
URL:
TITLE:
ROLE:
X-EVOLUTION-MANAGER:
X-EVOLUTION-ASSISTANT:
NICKNAME:
X-EVOLUTION-SPOUSE:
NOTE:
FN:Test 3 User
N:User;Test;3;;
X-EVOLUTION-FILE-AS:User\, Test
X-EVOLUTION-BLOG-URL:
CALURI:
FBURL:
X-EVOLUTION-VIDEO-URL:
X-MOZILLA-HTML:FALSE
EMAIL;TYPE=WORK:ersaxp@gmail.com
TEL;TYPE=WORK,VOICE:(508) 451-8227
UID:fd33c274ea237ff205449190325869e891c50490
END:VCARD
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
17.09.2019 22:00:08 [16179] [TRACE] card KopanoCardDavBackend->setData(): mapimessage: Resource id #24 - vcf: BEGIN:VCARD
VERSION:3.0
URL:
TITLE:
ROLE:
X-EVOLUTION-MANAGER:
X-EVOLUTION-ASSISTANT:
NICKNAME:
X-EVOLUTION-SPOUSE:
NOTE:
FN:Test 3 User
N:User;Test;3;;
X-EVOLUTION-FILE-AS:User\, Test
X-EVOLUTION-BLOG-URL:
CALURI:
FBURL:
X-EVOLUTION-VIDEO-URL:
X-MOZILLA-HTML:FALSE
EMAIL;TYPE=WORK:ersaxp@gmail.com
TEL;TYPE=WORK,VOICE:(508) 451-8227
UID:fd33c274ea237ff205449190325869e891c50490
END:VCARD
17.09.2019 22:00:08 [16179] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname

So, looking at the log above, it seems like the vcf is making through KDAV, and KDAV actually finds my contact list and my suggested contact list, and finds that the new contact doesn’t exist yet. But why it’s not writing it into the contact list is a mystery.

Now, I tried another experiment where I tried to import my entire VCF list, which, from Evolution’s perspective completes without error. I watch the progress bar go all the way across, and then go away like nothing even happened. Looking at the KDAV log, I see similar output to that above, where KDAV receives the vcard, displays it in the log, does a lookup, finds my two contact lists, does the search, can’t find it, tries again, then stops, basically in the same spot as mentioned in the previous example, except that I have a section like this for every contact I tried to import (about 75 of them). In performing the import, I made sure to select the CardDAV contact list “Contacts”, which Evolution knows to exist when doing a lookup check:

16.09.2019 02:13:21 [24182] [DEBUG] main ------------------ Start
16.09.2019 02:13:21 [24182] [DEBUG] main PUT /addressbooks/myname/Contacts/2b44948f-5a05-4ac8-ab33-b4acc00c3463.vcf
16.09.2019 02:13:21 [24182] [DEBUG] main KDAV version GIT
16.09.2019 02:13:21 [24182] [DEBUG] main SabreDAV version 3.2.2
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoSyncState->__construct(): Using db sqlite:/var/lib/kopano/kdav/syncstate.db
16.09.2019 02:13:21 [24182] [DEBUG] main KLogger->LogIncoming(): INPUT
PUT /addressbooks/myname/Contacts/2b44948f-5a05-4ac8-ab33-b4acc00c3463.vcf HTTP/1.1
Host: mail.myserver.com:2080
User-Agent: Evolution/3.26.6
Connection: close
Cache-Control: no-cache
Pragma: no-cache
If-None-Match: *
Content-Type: text/vcard; charset="utf-8"
Accept-Language: en-us, en;q=0.9
Content-Length: 150
Authorization: Basic REDACTED

BEGIN:VCARD
VERSION:3.0
UID:2b44948f-5a05-4ac8-ab33-b4acc00c3463
FN:Drew Madison
TEL;TYPE=CELL,VOICE:+1 303-520-1016
N:Madison;Drew;;;
END:VCARD
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->Logon(): myname / password
16.09.2019 02:13:21 [24182] [DEBUG]  dav KopanoDavBackend->Logon(): Auth: OK - user myname - session Resource id #10
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetUser(): myname
16.09.2019 02:13:21 [24182] [TRACE] card KopanoCardDavBackend->getAddressBooksForUser(): principalUri: principals/myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetFolders(): principal 'principals/myname', classes 'Array
(
    [0] => IPF.Contact
)
'
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetFolders(): found 2 folders: Array
(
    [0] => Array
        (
            [id] => principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
            [uri] => Contacts
            [principaluri] => principals/myname
            [{http://sabredav.org/ns}sync-token] => 0000000000
            [{DAV:}displayname] => Contacts
            [{http://calendarserver.org/ns/}getctag] => 0000000000
        )

    [1] => Array
        (
            [id] => principals/myname:d3f9201dc6f54eaea960ebc086c23357320000000000
            [uri] => Suggested Contacts
            [principaluri] => principals/myname
            [{http://sabredav.org/ns}sync-token] => 0000000000
            [{DAV:}displayname] => Suggested Contacts
            [{http://calendarserver.org/ns/}getctag] => 0000000000
        )

)

16.09.2019 02:13:21 [24182] [TRACE] card KopanoCardDavBackend->getCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: 2b44948f-5a05-4ac8-ab33-b4acc00c3463.vcf
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Searching for '2b44948f-5a05-4ac8-ab33-b4acc00c3463' in 'principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000' (Resource id #15)
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try APPTTSREF 2b44948f-5a05-4ac8-ab33-b4acc00c3463
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetCustomProperties(): Fetching properties id:principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [DEBUG]  dav KopanoDavBackend->GetMapiMessageForId(): Nothing found for 2b44948f-5a05-4ac8-ab33-b4acc00c3463
16.09.2019 02:13:21 [24182] [DEBUG] card KopanoCardDavBackend->getCard(): Object NOT FOUND
16.09.2019 02:13:21 [24182] [TRACE] card KopanoCardDavBackend->getCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: 2b44948f-5a05-4ac8-ab33-b4acc00c3463.vcf
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Searching for '2b44948f-5a05-4ac8-ab33-b4acc00c3463' in 'principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000' (Resource id #17)
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try APPTTSREF 2b44948f-5a05-4ac8-ab33-b4acc00c3463
16.09.2019 02:13:21 [24182] [DEBUG]  dav KopanoDavBackend->GetMapiMessageForId(): Nothing found for 2b44948f-5a05-4ac8-ab33-b4acc00c3463
16.09.2019 02:13:21 [24182] [DEBUG] card KopanoCardDavBackend->getCard(): Object NOT FOUND
16.09.2019 02:13:21 [24182] [TRACE] card KopanoCardDavBackend->getCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: 2b44948f-5a05-4ac8-ab33-b4acc00c3463.vcf
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Searching for '2b44948f-5a05-4ac8-ab33-b4acc00c3463' in 'principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000' (Resource id #19)
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiMessageForId(): Try APPTTSREF 2b44948f-5a05-4ac8-ab33-b4acc00c3463
16.09.2019 02:13:21 [24182] [DEBUG]  dav KopanoDavBackend->GetMapiMessageForId(): Nothing found for 2b44948f-5a05-4ac8-ab33-b4acc00c3463
16.09.2019 02:13:21 [24182] [DEBUG] card KopanoCardDavBackend->getCard(): Object NOT FOUND
16.09.2019 02:13:21 [24182] [TRACE] card KopanoCardDavBackend->createCard(): addressBookId: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000 - cardUri: 2b44948f-5a05-4ac8-ab33-b4acc00c3463.vcf - cardData: BEGIN:VCARD
VERSION:3.0
UID:2b44948f-5a05-4ac8-ab33-b4acc00c3463
FN:Drew Madison
TEL;TYPE=CELL,VOICE:+1 303-520-1016
N:Madison;Drew;;;
END:VCARD
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetMapiFolder(): Id: principals/myname:d3f9201dc6f54eaea960ebc086c23357250000000000
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname
16.09.2019 02:13:21 [24182] [TRACE] card KopanoCardDavBackend->setData(): mapimessage: Resource id #24 - vcf: BEGIN:VCARD
VERSION:3.0
UID:2b44948f-5a05-4ac8-ab33-b4acc00c3463
FN:Drew Madison
TEL;TYPE=CELL,VOICE:+1 303-520-1016
N:Madison;Drew;;;
END:VCARD
16.09.2019 02:13:21 [24182] [TRACE]  dav KopanoDavBackend->GetStore(): storename myname

If there’s additional data I can collect to help out, please let me know.

irreleph4nt

@ersaxp
I can’t help you with that but I am glad to see I am not the only person reporting this problem. In case you figure this out please let me know. Struggling with exactly the same issue.

EDIT: For reference, this is the thread where I am describing the same issue as ersaxp: Can’t create or update contacts in Evolution with kdav (git)

ersaxp

@irreleph4nt yes, I read through your post and was quite hopeful, but alas, nothing yet. I also looked at a post that talked about VCard 3 support vs. VCard 4 support, and commented out VC4 for now as a test; same results.

ersaxp

I should also mention that I’m running the official release version for openSUSE Leap 15.1: Kopano packages 8.6.0.0-lp151.2.5; I’m trying to stay pure to the release, but if you advise I move to the latest release, I’m happy to try that. KDAV is the latest available from git.

Manfred

Hi @ersaxp,

I moved your posts to this topic as it seems to be the same issue.

I didn’t have time yet to debug this more intensively, but it’s on my task list. I’ll post here if I have more questions or in case I’ll find something.

Manfred

ersaxp

@Manfred Thank you!

irreleph4nt

@Manfred
Have you had the chance yet to look at this?

Manfred

Hi,

I was not able to reproduce it on the systems I’ve tested. Those were debian-based systems though. It worked fine using apache as well as nginx with php-fpm. I’ve tested with KC 8.7.0 and 8.7.5.

Manfred

irreleph4nt

@Manfred
So I’ll have to re-test with 8.7 then? Hm … okay.

Edit:
if it helps at all, I can upload my configs somewhere or even get you access to the machine. It’s just a Dev box so nothing sensitive stored on it. I am happy to support debugging this in whichever way is helpful to you.

Manfred

Hi @irreleph4nt,

did you to configure another carddav client except evolution? Maybe configure a carddav account on your mobile device? So that we have a better idea if editing contacts fails in kdav or if it’s related to evolution only.

Manfred

irreleph4nt

@Manfred

Hi,
the blow is the kdav log for when I am trying to set up CardDav-Sync Free on Android, connect it to Kdav and try creating a user. My phone reports a ~~success~~ failure but the new contact does not show up in Kopano (tested in Webapp and Evolution) and the end of the log clearly shows the same stop behavior as the previous attempts with Evolution.

Phone log:

java.lang.Exception: could not upload new resource
org.dmfs.j.a.a(Unknown Source:280)
org.dmfs.j.b.a(Unknown Source:27)
org.dmfs.g.g.a(Unknown Source:9)
org.dmfs.carddav.syncadapter.a.a(Unknown Source:1594)
org.dmfs.h.a.onPerformSync(Unknown Source:989)
android.content.AbstractThreadedSyncAdapter$SyncThread.run(AbstractThreadedSyncAdapter.java:334)
caused by:
java.io.IOException: Error 504 during upload of 
BEGIN:VCARD
VERSION:3.0
N:Georgi;Hans Peter;;;
FN:Hans Peter Georgi
PRODID:-//dmfs.org//mimedir.vcard//EN
REV:20190925T002254Z
UID:290d8a4b-922c-43c5-8192-1bd65b51c90e
END:VCARD

org.dmfs.dav.b.a(Unknown Source:180)
org.dmfs.dav.b.a(Unknown Source:2)
org.dmfs.j.a.a(Unknown Source:147)
org.dmfs.j.b.a(Unknown Source:27)
org.dmfs.g.g.a(Unknown Source:9)
org.dmfs.carddav.syncadapter.a.a(Unknown Source:1594)
org.dmfs.h.a.onPerformSync(Unknown Source:989)
android.content.AbstractThreadedSyncAdapter$SyncThread.run(AbstractThreadedSyncAdapter.java:334)

App: org.dmfs.carddav.sync
App version: 0.4.21
OS version: 28
OS Info: google/walleye/walleye:9/PQ3A.190801.002/5670241:user/release-keys
Manufacturer: Google
Date: Wed Sep 25 02:23:54 GMT+02:00 2019

Manfred

Hi @irreleph4nt,

could please test the following: download the files attached to the issue https://jira.kopano.io/projects/KDAV/issues/KDAV-20. Edit $user and $pass of kdav-20.php to match a user on your system (also check if $server and $path are correct for your system).

Then run:

php kdav-20.php -f kdav20fail
php kdav-20 php -f kdav20ok

and post the output.

Manfred

irreleph4nt

@Manfred

Hi. I made the changes and ran the commands as instructed. kdav20fail comes back with an error message right away, kdav20ok however hangs infinitely:

[root@mx2 kopano-kdav]# su nginx -s /bin/bash
bash-4.2$ php kdav
kdav20fail   kdav20ok     kdav-20.php  
bash-4.2$ php kdav-20.php -f kdav20fail 
mapi_vcftomapi failed with code: 0xFFFFFFFF8004011B
bash-4.2$ php kdav-20.php -f kdav20ok

Last line is where I am not even getting a cursor back unless I ctrl+c.

Interestingly I see this in the journal throughout the period of time I left the kdav20ok command running as the nginx user:

Sep 25 23:50:47 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php" sid=0x7cb3b803b8f7e0d9
Sep 25 23:50:47 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php" sid=0xa75fe1fcc49d8abd
Sep 25 23:50:55 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php" sid=0xd61a953a3477a7b2
Sep 25 23:50:55 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="User supplied password" program="php" sid=0xa8306aece582626

vs output when running as root:

Sep 25 23:55:06 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="Pipe socket" program="php" sid=0xdd18f36cd65a9b0d
Sep 25 23:55:06 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="Pipe socket" program="php" sid=0x27afd5701a189b31
Sep 25 23:55:11 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="Pipe socket" program="php" sid=0xd25bbea952b2965a
Sep 25 23:55:11 mx2.domain.tld kopano-server[20172]: authenticate ok: from="file:///var/run/kopano/server.sock" user="robert" method="Pipe socket" program="php" sid=0x26ca7c927b1badfb

I am not getting any output in the kdav logs when running these two tests.

irreleph4nt

@Manfred
Have you had any luck tracing down the source for this issue?

Manfred

Hi @irreleph4nt,

I suspect that there’s something wrong with mapi_vcftomapi on your system because php kdav-20.php -f kdav20ok doesn’t output anything. That would be something for someone from Kopano core team to look at, I’m not able to help you with that.

Manfred

irreleph4nt

@Manfred
Hi. Thank you for all you have done so far! Is there any way you could let the relevant people know that this issue exists? Maybe raise a JIRA ticket or something? I’d be happy to provide any kind of data or access that you guys require. :)

Manfred

Hi @irreleph4nt,

there already is https://jira.kopano.io/browse/KC-1529 which is related to creating contacts in with mapi_vcftomapi via kdav. It’s possible that your issue and the one described there are related.

Manfred

irreleph4nt

@Manfred
Just commenting to let you know this error still exists in 8.7.84 on CentOS 8. The same behaviour as previously observed.