Navigation

    Kopano
    • Register
    • Login
    • Search
    • Categories
    • Get Official Kopano Support
    • Recent
    Statement regarding the closure of the Kopano community forum and the end of the community edition

    z-push 2.4.5 sync issue - 0xFFFFFFFF8004010F

    Kopano Groupware Core
    28
    85
    22101
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Das-Korn
      Das-Korn last edited by

      Hi,

      I’m not sure whether this is the right place to put this thread. If not feel free to move the thread to the right location.

      How ever, I’m facing the following issue.

      Kopano and zpush is working quite nice as long no synchronization period is set. E.g. only download the mails from the last month/week/what ever period.

      As soon this is set (tested with Android/iOS default mail apps) i see the following zpush error in the logs:

       ExportChangesICS->InitializeExporter(): Error, mapi_exportchanges_config() failed: 0xFFFFFFFF8004010F - code: 12 - file: /usr/share/z-push/backend/kopano/exporter.php:230

      Is there a way to fix that? Or do I have to wait for an update.

      Kind regards
      Das-Korn

      1 Reply Last reply Reply Quote 0
      • Manfred
        Manfred Kopano last edited by

        HI @Das-Korn ,

        which Kopano version are you running? Do you by any chance have folders on your mobile device which are not on the server anymore?

        Please post the complete WBXML log of the request.

        Manfred

        1 Reply Last reply Reply Quote 0
        • mhoffmann75
          mhoffmann75 last edited by

          Same problem here.
          Could it be that latest kopano core with z-push has some issues with mariadb - not appearing with mysql?

          The whole picture:

          • MariaDB 10.3.13
          • or MySQL 8.0.15 (read on)
          • z-push 2.4.5-0
          • kopano core: latest (8.7.80.804)

          I have a large mailbox (imported from exchange server via kopano-import-pst) with a calendar with ~3000 elements that refuses to sync via z-push (iphone - same with Outlook).
          I repeatedly get the error in zpush and the sync is in endless loop (tried pairing again, forcing full sync, whatever - no chance):

          25/03/2019 12:43:17 [2740] [WARN] [mhoffmann] StatusException: ExportChangesICS->InitializeExporter(): Error, mapi_exportchanges_config() failed: 0xFFFFFFFF8004010F - code: 12 - file: /usr/share/z-push/backend/kopano/exporter.php:230

          From my understanding zpush connects to kopano server and this error could mean/means some problem with the store?

          So i started ICSLog for server to get some more insight.
          It turns out that nearly everytime i get the exporter error from above server returns this warning:

          Mon Mar 25 12:43:16 2019: [ 200000] MatchRestrictions: matching 1000 rows

          And this only happens for folders with many (too much) objects. If i delete many of them and leave only e.g. 200 it works.
          Interestingly it does not matter if i sync all, only 1 month, 1 week or 1 day. All the same. As soon as there are (my guess) more than 1000 objects in one folder it gets stuck.

          Side note: Kopano WebApp / DeskApp / ical have no problem at all - only for z-push.

          Yesterday i did dump my kopano database and reimported it into MySQL.
          All the problems seem to be gone: i can finally sync my large mailbox!

          But (my guess) exactly where the above execption occured i now get a warning:

          26/03/2019 20:52:15 [   21] [WARN] [mhoffmann] ImportChangesICS->lazyLoadConflicts(): conflict detection abandoned as there are too many (2124) changes to be exported.

          So, my question is - could it be that there is a certain workaround in Core or Z-Push that only works with mySQL but fails with mariaDB?
          Anyone facing the same is welcome to add some more details here.

          Of course i need to cleanup my calendar - thats not the point. But i guess that this is a bug that should be fixed as it seem to be the same situation for folders like inbox or sent items. And 1000 mails is nothing special in there.

          1 Reply Last reply Reply Quote 0
          • embexx
            embexx last edited by

            I found a solution for the sync issues with z-push:
            change in kopano’s server.cfg
            enable_enhanced_ics = yes
            to
            enable_enhanced_ics = no

            and restart kopano server
            service kopano-server restart.

            NOw it works with out any error as before with mysql.

            1 Reply Last reply Reply Quote 0
            • Fux
              Fux last edited by

              I got the same problem, but changing “enable_enhanced_ics = yes” to “no” does not work for me.

              I already upgraded to z-push 2.5 with no success. Afterwards I upgraded to kopano 8.7.81 with no success either.

              Z-Push works but one big calendar (our corporate cal) does produce the above mentioned errors. All I did before the errors were starting was to reboot the server yesterday.

              Any other tips how this could be solved?

              1 Reply Last reply Reply Quote 0
              • Fux
                Fux last edited by

                Installing MySQL 5.7 (via Docker) and migrating the kopano-db to it solved the problem for now. Z-Push now works normal.

                Does anyone know what the problem with MariaDB and Kopano is that z-push doesn’t work - at least with folders with many entries?

                1 Reply Last reply Reply Quote 0
                • happenpappen
                  happenpappen last edited by happenpappen

                  @embexx said in z-push 2.4.5 sync issue - 0xFFFFFFFF8004010F:

                  enable_enhanced_ics = yes

                  I encountered the same problem with two mailboxes on my server (CentOS 7, Kopano 8.7.3.0, MariaDB 10.3.16 and Z-Push 2.5.0). Changing “enable_enhanced_ics = yes” to “enable_enhanced_ics = no” and restarting kopano-server did not help. But after setting up kopano-archiver with “fully remove” strategy, both mailboxes are able to sync their devices again. I’ve used the setting described in “5.3. Archive-only setup” on this page:

                  https://documentation.kopano.io/kopano_archiver_manual/archive_configuration.html

                  I guess, the z-push error is somehow related to the number of objects in the affected mailboxes, so this is more kind of a workaround and not a real solution for the problem.

                  1 Reply Last reply Reply Quote 0
                  • bcoms
                    bcoms last edited by

                    I unfortunately haven’t found a solution for the problem but wanted to confirm, that I encountered the same behaviour as described in the original post (sync issue 0xFFFFFFFF8004010F).

                    I updated my Debian server to the recently released version 10 (Buster). I know I should have hold my horses, but in the past I never encountered any big showstoppers with Zarafa and later Kopano when updating my servers.

                    Debian 10 uses MariaDB 10.3.15 (Stretch used 10.1.38) and I tried different configurations such as all combinations of:

                    Z-Push 2.5
                    Z-Push 2.4.5 (part of the Distribution)
                    Kopano 8.7.3 (in place during the upgrade)
                    Kopano 8.7.0 (part of the Distribution)
                    Kopano 8.7.82 (Nightly build 20190706 and 20190707)

                    No dice - always the same sync issue. I haven’t tried switching over to MySQL. While I cannot offer a solution I hope my post underlines the importance of this issue to be investigated by the Kopano team. Reports about this issue can be traced back to late 2018 when some individuals switched to newer MariaDB versions - even the guys over at the Synology forums have had the same problem.

                    1 Reply Last reply Reply Quote 0
                    • weini
                      weini last edited by

                      Same problem for me: Debian Buster upgrade killed my working z-push.
                      I also tried the Debian provided Kopano & z-push packages (they seem to cause even more problems) and went back to the “regular” Kopano and z-push packages.

                      But no chance to work around this nasty sync issue 0xFFFFFFFF8004010F. I´d also say that the problem is volume related. My largest folders do no longer sync while smaller ones still work.

                      rolek 1 Reply Last reply Reply Quote 0
                      • rolek
                        rolek @weini last edited by

                        @weini said in z-push 2.4.5 sync issue - 0xFFFFFFFF8004010F:

                        Same problem for me: Debian Buster upgrade killed my working z-push.
                        I also tried the Debian provided Kopano & z-push packages (they seem to cause even more problems) and went back to the “regular” Kopano and z-push packages.

                        If I may ask, which problems did you have with the Debian provided Z-push packages?

                        1 Reply Last reply Reply Quote 0
                        • weini
                          weini last edited by

                          No big difference for z-push, but kopano packages were worse:

                          • kopano-spamd failed with errors on checking most of the new emails, mostly needed a restart
                          • kopano-server dumped with backtrace sporadically approx. once a day

                          Lucky outcome for me is now, that the “orig” packages seem to work again. I´m now on:

                          • kopano-server nightly build 8.7.82.12.6297bf8c5-0+294.1
                          • z-push 2.5 from kopano repository (Debian_9.0)
                          • Debian 10
                          • MariaDB from Debian 10 repo

                          Did a complete resync dropping all state files. Error messages did occur while syncing, but sync completed and I´m now able to access all my folders.

                          1 Reply Last reply Reply Quote 0
                          • nib
                            nib last edited by

                            Very same problem here. (including an unsatisfactory workaround)

                            I run a combination of relatively new (but release versions) of

                            • Kopano Core (8.7.x)
                            • z-push (2.5.0-0) and
                            • MariaDB10 (10.3.11).

                            While IMAP (via gateway) and z-push of Calendar & Contacts worked fine, Email Sync (via z-push) stopped working for an iOS device apparently due to the first folder (INBOX) growing to more than ~3000 objects.
                            Reason: When reducing number of emails in INBOX, sync immediately started working again.

                            All other (web-search-induced) hotfixes failed to show the desired effect.
                            Some of the attempted (and failed) fixes:

                            • z-push-admin -a resync -t hierarchy -u …
                            • complete removal of device in question, removal of account, recreate account
                            • Reducing the email sync interval (from 1 month to 1 week to 3 days)
                            • Changing in server.cfg enable_enhanced_ics = yes to no

                            The symptom(s) did not exactly coincide with a package upgrade, however, at the time of package upgrade (together with a certificate renewal), the lack of the most recent emails was noticed. Other email clients accessing the same Kopano-mailbox didn’t stop syncing/downloading all email.
                            Also, during all time, the sync of Calendar & Contacts through the same z-push connection were completely ok, both directions. A second account (for a second calendar only) also synced fine.

                            During the search for solutions, I also encountered posts, where only calendar sync was broken, so there is reason to believe that a more generic part of the sync code causes this issue as soon as too many objects (somewhere between 1000 - 3000) are bunched into one sync operation.
                            Other posts (I haven’t tried this solution) have been reporting that change of MariaDB10 to MySQL 8.x has (at least temporarily) resolved the issue.
                            First such posts (using the exact error code started appearing in 2018.

                            tl;dr:
                            Syncing of iOS devices (calendar, email, possibly contacts as well) through z-push/active sync with a MariaDB10 supported KopanoCore (>=8.6.?) fails to transfer/sync new objects to an activeSync Client (definitely iOS, maybe others) as soon as some threshold of objects to be synced is surpassed.

                            Solution:
                            Email: Moving emails away from a folder that has grown too big seems to work.
                            Calendar: Changing in server.cfg enable_enhanced_ics = yes to no may provide a temporary workaround.

                            Nib.

                            1 Reply Last reply Reply Quote 0
                            • fbartels
                              fbartels Kopano last edited by

                              Hi @nib,

                              @nib said in z-push 2.4.5 sync issue - 0xFFFFFFFF8004010F:

                              growing to more than ~3000 objects.

                              ah, this could finally be the missing piece to also reproduce this. Will try to have a look next week.

                              If you want to speed this up @nib, from your posted versions it seems you have a valid subscription? If so then opening a support ticket and have our support reproduce this could be a bit faster.

                              Regards Felix

                              Resources:
                              https://kopano.com/blog/how-to-get-kopano/
                              https://documentation.kopano.io/
                              https://kb.kopano.io/

                              Support overview:
                              https://kopano.com/support/

                              1 Reply Last reply Reply Quote 0
                              • weini
                                weini last edited by

                                Brief update from my side: The “fix” was unfortunately not a permanent one. Sync breaks again after some time and the content of larger folders (email and also calendar) simply disapperas on the mobile. The error message is still present in the logs.

                                1 Reply Last reply Reply Quote 0
                                • weini
                                  weini last edited by

                                  @nib: Did you get any update via the support? Is there a fix on the way?

                                  JPW_Kopano 1 Reply Last reply Reply Quote 0
                                  • JPW_Kopano
                                    JPW_Kopano @weini last edited by

                                    Same problem for me.
                                    Configuration:
                                    Kopano & MariaDB from Debian 10 Repo
                                    z-Push 2.3.7

                                    Small mailboxes are synced. Big mailboxes are not.

                                    1 Reply Last reply Reply Quote 0
                                    • nib
                                      nib last edited by

                                      Apologies for the late reply, but sadly I don’t have a subscription. This is all based on the community version. I only run this server for my family privately on a VM on my NAS. I do have the luxury of access to several client systems which happened to be available for small tests.
                                      I also didn’t try the change from MariaDB to MySQL as such a change on my “production” system would take quite some time for backups, which I didn’t want to invest after finding a “good-enough-for-the-moment” fix.

                                      Nib

                                      1 Reply Last reply Reply Quote 0
                                      • Beleggrodion
                                        Beleggrodion last edited by

                                        I have the same issue on one of our setups.

                                        • Kopano Core (8.7.5)
                                        • z-push (2.5.0+0-0)
                                        • MariaDB (10.4.6)

                                        Currently their is only one user affected with this issue:

                                        Folder: Calendar             Sync: Initialized   Status:  0% (0/10236)

                                        The following setting had no effect:

                                        enable_enhanced_ics = no

                                        I also enabled the debugging for this device.

                                        13/08/2019 13:36:12 [ 9528] [DEBUG] -------- Start
13/08/2019 13:36:12 [ 9528] [DEBUG] cmd='Sync' devType='Android' devId='android1263512214918' getUser='max.mustermann' from='123.123.123.123' version='2.5.0+0-0' method='POST'
13/08/2019 13:36:12 [ 9528] [DEBUG] Used timezone 'Europe/Zurich'
13/08/2019 13:36:12 [ 9528] [DEBUG] ZPush::GetBackend(): trying autoload backend 'BackendKopano'
13/08/2019 13:36:12 [ 9528] [DEBUG] BackendKopano using PHP-MAPI version: 8.7.5 - PHP version: 7.2.19-0ubuntu0.18.04.1
13/08/2019 13:36:12 [ 9528] [DEBUG] Request::ProcessHeaders() ASVersion: 14.1
13/08/2019 13:36:12 [ 9528] [DEBUG] ZPush::CommandNeedsProvisioning(0): true
13/08/2019 13:36:12 [ 9528] [DEBUG] FileStateMachine->GetState() read '4411' bytes from file: '/var/lib/z-push/9/3/android1263512214918-devicedata'
13/08/2019 13:36:12 [ 9528] [DEBUG] ASDevice data loaded for user: 'max.mustermann'
13/08/2019 13:36:12 [ 9528] [DEBUG] TopCollector(): Initialized mutexid Resource id #9 and memid Resource id #10.
13/08/2019 13:36:12 [ 9528] [DEBUG] TopCollector initialised with IPC provider 'IpcSharedMemoryProvider' with type '20'
13/08/2019 13:36:12 [ 9528] [DEBUG] LoopDetection(): Initialized mutexid Resource id #11 and memid Resource id #12.
13/08/2019 13:36:12 [ 9528] [DEBUG] LoopDetection initialised with IPC provider 'IpcSharedMemoryProvider' with type '1337'
13/08/2019 13:36:12 [ 9528] [DEBUG] ZPush::HierarchyCommand(0): false
13/08/2019 13:36:12 [ 9528] [DEBUG] DeviceManager->ProvisioningRequired('538798535') saved device key '538798535': false
13/08/2019 13:36:12 [ 9528] [DEBUG] DeviceManager->getPolicyName(): determined policy name: 'default'
13/08/2019 13:36:12 [ 9528] [DEBUG] DeviceManager->getProvisioningPolicies(): loaded 'default' policy.
13/08/2019 13:36:12 [ 9528] [DEBUG] ZPush::CommandNeedsAuthentication(0): true
13/08/2019 13:36:12 [ 9528] [DEBUG] KopanoBackend->Logon(): Trying to authenticate user 'max.mustermann'..
13/08/2019 13:36:12 [ 9528] [DEBUG] KopanoBackend->openMessageStore('max.mustermann'): Found 'DEFAULT' store: 'Resource id #15'
13/08/2019 13:36:12 [ 9528] [DEBUG] KopanoBackend->Logon(): User 'max.mustermann' is authenticated
13/08/2019 13:36:12 [ 9528] [DEBUG] Store supports properties containing Unicode characters.
13/08/2019 13:36:12 [ 9528] [DEBUG] ZPush::CommandNeedsPlainInput(0): false
13/08/2019 13:36:12 [ 9528] [WBXML] I  <Synchronize>
13/08/2019 13:36:12 [ 9528] [WBXML] I   <Folders>
13/08/2019 13:36:12 [ 9528] [WBXML] I    <Folder>
13/08/2019 13:36:12 [ 9528] [WBXML] I     <SyncKey>
13/08/2019 13:36:12 [ 9528] [WBXML] I      0
13/08/2019 13:36:12 [ 9528] [WBXML] I     </SyncKey>
13/08/2019 13:36:12 [ 9528] [WBXML] I     <FolderId>
13/08/2019 13:36:12 [ 9528] [WBXML] I      U5e894
13/08/2019 13:36:12 [ 9528] [WBXML] I     </FolderId>
13/08/2019 13:36:12 [ 9528] [DEBUG] SyncParameters->RemoveSyncKey(): saved sync key removed
13/08/2019 13:36:12 [ 9528] [DEBUG] DeviceManager->GetBackendIdForFolderId(): folderid U5e894 => 0879775ab9d94a42901de37ae24a9a9ca40100000000
13/08/2019 13:36:12 [ 9528] [DEBUG] ZPush::GetFolderClassFromFolderType('8'): Calendar
13/08/2019 13:36:12 [ 9528] [DEBUG] GetFolderClassFromCacheByID from Device Manager: 'Calendar' for id:'U5e894'
13/08/2019 13:36:12 [ 9528] [DEBUG] SyncCollections->AddCollection(): Folder id 'U5e894' : ref. PolicyKey '1', ref. Lifetime '10', last sync at ''
13/08/2019 13:36:12 [ 9528] [WBXML] I    </Folder>
13/08/2019 13:36:12 [ 9528] [DEBUG] HandleSync(): FilterType applied globally or specifically, using value: 7
13/08/2019 13:36:12 [ 9528] [DEBUG] HandleSync(): FilterType has changed (old: '', new: '7'), removing folderstat to force Exporter setup
13/08/2019 13:36:12 [ 9528] [WBXML] I   </Folders>
13/08/2019 13:36:12 [ 9528] [WBXML] I  </Synchronize>
13/08/2019 13:36:12 [ 9528] [DEBUG] HandleSync(): Start Output
13/08/2019 13:36:12 [ 9528] [DEBUG] ZPush::GetAdditionalSyncFolderStore('0879775ab9d94a42901de37ae24a9a9ca40100000000'): 'false'
13/08/2019 13:36:12 [ 9528] [DEBUG] KopanoBackend->GetFolderStat() fetched status information of 28 folders for store 'max.mustermann'
13/08/2019 13:36:12 [ 9528] [DEBUG] SyncParameters->IsExporterRunRequired(): true - current: 1565693864/10236/0/13 - saved: false - expiring: not set
13/08/2019 13:36:12 [ 9528] [DEBUG] Sync->loadStates(): loading states for folder 'U5e894'
13/08/2019 13:36:12 [ 9528] [DEBUG] ZPush::GetAdditionalSyncFolderStore('0879775ab9d94a42901de37ae24a9a9ca40100000000'): 'false'
13/08/2019 13:36:12 [ 9528] [DEBUG] ZPush::GetAdditionalSyncFolderStore('0879775ab9d94a42901de37ae24a9a9ca40100000000'): 'false'
13/08/2019 13:36:12 [ 9528] [DEBUG] ExportChangesICS->Config(): synching inital data
13/08/2019 13:36:12 [ 9528] [DEBUG] ExportChangesICS->Config() initialized with state: 0x0000000000000000
13/08/2019 13:36:12 [ 9528] [WARN] StatusException: ExportChangesICS->InitializeExporter(): Error, mapi_exportchanges_config() failed: 0xFFFFFFFF8004010F - code: 12 - file: /usr/share/z-push/backend/kopano/exporter.php:230
13/08/2019 13:36:12 [ 9528] [DEBUG] LoopDetection->ProcessLoopDetectionAddStatus: 'U5e894' with status 12
13/08/2019 13:36:12 [ 9528] [DEBUG] WBXMLEncoder->startWBXML() type: vnd.ms-sync.wbxml
13/08/2019 13:36:12 [ 9528] [WBXML] O  <Synchronize>
13/08/2019 13:36:12 [ 9528] [WBXML] O   <Status>
13/08/2019 13:36:12 [ 9528] [WBXML] O   12
13/08/2019 13:36:12 [ 9528] [WBXML] O   </Status>
13/08/2019 13:36:12 [ 9528] [WBXML] O  </Synchronize>
13/08/2019 13:36:12 [ 9528] [DEBUG] WBXMLEncoder->endTag() WBXML output completed
13/08/2019 13:36:12 [ 9528] [WBXML] WBXML-OUT: AwFqAEVOAzEyAAEB
13/08/2019 13:36:12 [ 9528] [WBXML] WBXML-IN : AwFqAEVcT0sDMAABUgNVNWU4OTQAAQEBAQ==
13/08/2019 13:36:12 [ 9528] [DEBUG] LoopDetection->ProcessLoopDetectionTerminate()
13/08/2019 13:36:12 [ 9528] [ INFO] cmd='Sync' memory='2.87 MiB/2.00 MiB' time='0.11s' devType='Android' devId='android1263512214918' getUser='max.mustermann' from='123.123.123.123' idle='0s' version='2.5.0+0-0' method='POST' httpcode='200'
13/08/2019 13:36:12 [ 9528] [DEBUG] -------- End

                                        Their is not much information visible, only the same error as in the normal logfile.

                                        Perhaps the problem could also be another source and not depends on the amount of entries? because the calendar affected user was some long time ago migrated from scalix to zarafa (via ical) and later migrated from an old zarafa to a kopano (also ical) some months ago. And now two week’s i updated the kopano to the version above.

                                        The problem is not much prio at them moment, because it’s only one user which is affected.

                                        I also cannot migrated at the moment back from MariaDB to mySQL, because all users together had a big database which needs some time to backup and restore.

                                        1 Reply Last reply Reply Quote 0
                                        • badewaschl
                                          badewaschl last edited by

                                          Hi all,

                                          I am also having this issue with one user. I tried to set enable_enhanced_ics = no but that did not help.

                                          Next thing I ran z-push-admin -a remove and clearing all data on android, but to no avail.

                                          Then I tried to clean up using kopano-fsck, but that reported the same 14 issues every time I ran it, claiming the issues were fixed. I ended up manually deleting the affected calendar entries. But the z-push issue still remained.

                                          I even tried to use kopano-archiver as suggested above, but could not get it to work (see separate post).

                                          My last desperate attempt was to copy all data to a new user using kopano-backup. About 1% of all emails, contacts and calendar entries got lost in the process (for example the tool seems to skip all contacts with a picture) - but also with the new user, the calendar disappeared from android after a few hours.

                                          Now I am at my wit’s end. Does anybody have an idea what else I can do? Everything worked fine for years using zarafa, but ever since I upgraded to kopano the problems keep piling up. Was it maybe a bad idea to reuse the zarafa database?

                                          I am using the latest kopano/z-push/apache packages from Debian 10.
                                          On Android I connect using the Nine groupware client.

                                          Regards

                                          badewaschl

                                          Beleggrodion 1 Reply Last reply Reply Quote 0
                                          • thctlo
                                            thctlo last edited by thctlo

                                            Try this :

                                            wget -qO - http://repo.z-hub.io/z-push:/final/Debian_10/Release.key | sudo apt-key add -
echo "deb http://repo.z-hub.io/z-push:/final/Debian_10 /" > /etc/apt/sources.list.d/z-push.list
apt update
apt dist-upgrade 
apt-get install z-push-common

                                            Note: package z-push in debian = z-push-common on the z-push repo.
                                            optional also install : z-push-config-apache z-push-config-apache-autodiscover

                                            compsos 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post