Hi @elan,

@elan said in Timeout message when fetching mails - empty inbox:

Hi @Manfred ,
Thanks for the reply. The newer version of Android (on a Samsung) seems to have removed the option of removed the option “Microsoft Exchange ActiveSync” under Settings->Account. Instead, the Gmail App offers to add an Exchange account. I used this one. The other options was to download the Outlook App from the Play store.

That’s strange. I have a Samsung device with Android 10 and there’s “Microsoft Exchange ActiveSync” type if I select “Add account”.

For test, I found an older device, Samsung Galaxy Note 4 now. Made a fresh install of z-push 2.5.2 on my server and configured as before and added a “Microsoft Exchange ActiveSync” account via Settings->Accounts.
When I open the default Email App, there are no Emails. The client seems to be synchronizing the INBOX. On the menu, I could click on “Show all folders” and the folder listing is right.
Here is the log when I open the App and the App tries to sync.

08/04/2020 00:26:09 [19530] [DEBUG] [mail_test] -------- Start 08/04/2020 00:26:09 [19530] [DEBUG] [mail_test] cmd='FolderSync' devType='SAMSUNGSMNF' devId='sec1c00ccb91b75f' getUser='mail_test' from='192.168.213.3' version='GIT' method='POST'

That’s a FolderSync request, not Sync and though not helpful.

Manfred

I’m going to add to this for people who have a similar problem.

It seems that this is an iOS issue, and if you try and set up the mail account again (as in let it do the auto discover again from the start) it will sometimes work, sometimes not. It seems to be quite random as when it decides to pass the full email vs the just the part before the @ sign.

So I have removed the ZPUSH_HOST configuration parameter from autodiscover, this way it passes the current servername (autodiscover.domain.com) as the one to use for active sync.

Then in request.php I added a short check to see if the username was missing the @, and if it was added the domain. The correct domain.

This all seems to work as a quick hack to fix the iOS bug.

Regards

Ben

Hi @orlovnv,

Which backend are you using? Caldav?

Please provide the complete WBXML log of the request.

Where are you trying to remove an item? On a mobile? Or via the browser in nextcloud?

Manfred

Hi @denisdal,

@denisdal said in Randomly password request:

Hi Manfred, my backend doesn’t have ResolveRecipients function.
In this case, is ok take the function as example in caldav backend ? (Simply return an empty array)

Yeah, you could try that.

Or, as I can see in kopano backend, return a SyncResolveRecipients object with a protocol error status ?

Kopano backend only returns protocol error in a certain error case. It does a proper resolving.

If you don’t have you own ResolveRecipients it will fall back to the default Backend class function which returns protocol error which is the case you have now.

ResolveRecipients was just a guess because it was in the log excerpt you posted. In the initial post you mentioned that the password requests happened after Search command, however you haven’t posted any logs which contain Search request.

Manfred

I replied in my other post, but this solution helped me as well, big thank you! :)

BD

Here‘s my solution and it works stable as far as my testing went:

Problem
This is for syncing appointments (calendar) and addresses (contacts) with Android. The first time I was syncing everything looked good, appointments showed up, addresses showed up, I even could open them and read the details. Seconds to minutes later, everything vanished again. Anything I edited was lost. It also disappeared, when I hit sync again. Thunderbird and iOS never had this problem (knock on wood).

Solution
In my self-written backend there‘s a function getFolderList() that returns all the folders for syncing. At first it only returned root, tasks, appointments and adresses – there was no Emailfolder, since I do not want to sync that.

After adding

email-inbox (SYNC_FOLDER_TYPE_INBOX), email-deleted (SYNC_FOLDER_TYPE_WASTEBASKET), email-outbox (SYNC_FOLDER_TYPE_OUTBOX) and email-sent (SYNC_FOLDER_TYPE_SENTMAIL)

it worked. I now reduced that through some more testing to only the email-inbox and it‘s still syncing my appointments and addresses without a problem and without them disappearing again. EDIT: No, some more testing and it’s not stable with only the inbox. Just keep all the folders.

My theory is that Android somehow relies on having at least the inbox folder and assumes there‘s an error if it is missing. With this idea, my logs read differently:

Step 1: foldersync with key, gets “0 changes” - Android assumes it is out of sync, since it is missing the email-folder
Step 2: foldersync without a key, gets the whole list and a new sync key
Step 3: sync without key, gets a new key for appointments
Step 4: sync with key, gets the whole data of appointments
Step 5: foldersync with the new sync key, gets “0 changes” - Android assumes it is out of sync, since it is missing the email-folder and breaks off

So the problem is not the last sync, which I assumed to be a rogue sync that had a problem, but already the first, since it was missing the emailfolder(s).

Additional Info
In my first post is a pastebin, where you can see the “before” in lines 117-198. Here’s part of the log from a successful foldersync (reverse chronological order, start reading at the bottom):

28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:FolderSync> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Changes> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Add> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Type> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O 2 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Type> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:DisplayName> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O onOffice Email-Inbox 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:DisplayName> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:ParentId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O ooroot 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:ParentId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:ServerEntryId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O ooemailinbox 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:ServerEntryId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Add> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Add> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Type> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O 9 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Type> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:DisplayName> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O onOffice Adressen 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:DisplayName> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:ParentId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O ooroot 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:ParentId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:ServerEntryId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O ooaddress 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:ServerEntryId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Add> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Add> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Type> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O 8 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Type> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:DisplayName> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O onOffice Termine 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:DisplayName> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:ParentId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O ooroot 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:ParentId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:ServerEntryId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O ooappointments 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:ServerEntryId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Add> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Add> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Type> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O 7 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Type> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:DisplayName> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O onOffice Aufgaben 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:DisplayName> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:ParentId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O ooroot 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:ParentId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:ServerEntryId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O ootasks 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:ServerEntryId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Add> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Add> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Type> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O 1 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Type> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:DisplayName> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O onOffice root 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:DisplayName> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:ParentId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O 0 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:ParentId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:ServerEntryId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O ooroot 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:ServerEntryId> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Add> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Count> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O 5 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Count> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Changes> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:SyncKey> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O {81ba4da1-5c9a-48b5-b1ca-edfc8cab050d}1 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:SyncKey> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O </FolderHierarchy:Status> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O 1 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:Status> 28/02/2020 11:01:56 [ 3704] [WBXML] [zpushy@doen] [androidc1323317619] O <FolderHierarchy:FolderSync> 28/02/2020 11:01:56 [ 3704] [DEBUG] [zpushy@doen] [androidc1323317619] HierarchyCache: AddFolder() serverid: ooemailinbox displayname: onOffice Email-Inbox 28/02/2020 11:01:56 [ 3704] [ INFO] [zpushy@doen] [androidc1323317619] BackendOnOfficeSync::StatFolder: id=ooemailinbox 28/02/2020 11:01:56 [ 3704] [ INFO] [zpushy@doen] [androidc1323317619] BackendOnOfficeSync::GetFolder: id=ooemailinbox 28/02/2020 11:01:56 [ 3704] [DEBUG] [zpushy@doen] [androidc1323317619] HierarchyCache: AddFolder() serverid: ooaddress displayname: onOffice Adressen 28/02/2020 11:01:56 [ 3704] [ INFO] [zpushy@doen] [androidc1323317619] BackendOnOfficeSync::StatFolder: id=ooaddress 28/02/2020 11:01:56 [ 3704] [ INFO] [zpushy@doen] [androidc1323317619] BackendOnOfficeSync::GetFolder: id=ooaddress 28/02/2020 11:01:56 [ 3704] [DEBUG] [zpushy@doen] [androidc1323317619] HierarchyCache: AddFolder() serverid: ooappointments displayname: onOffice Termine 28/02/2020 11:01:56 [ 3704] [ INFO] [zpushy@doen] [androidc1323317619] BackendOnOfficeSync::StatFolder: id=ooappointments 28/02/2020 11:01:56 [ 3704] [ INFO] [zpushy@doen] [androidc1323317619] BackendOnOfficeSync::GetFolder: id=ooappointments 28/02/2020 11:01:56 [ 3704] [DEBUG] [zpushy@doen] [androidc1323317619] HierarchyCache: AddFolder() serverid: ootasks displayname: onOffice Aufgaben 28/02/2020 11:01:56 [ 3704] [ INFO] [zpushy@doen] [androidc1323317619] BackendOnOfficeSync::StatFolder: id=ootasks 28/02/2020 11:01:56 [ 3704] [ INFO] [zpushy@doen] [androidc1323317619] BackendOnOfficeSync::GetFolder: id=ootasks 28/02/2020 11:01:56 [ 3704] [DEBUG] [zpushy@doen] [androidc1323317619] HierarchyCache: AddFolder() serverid: ooroot displayname: onOffice root 28/02/2020 11:01:56 [ 3704] [ INFO] [zpushy@doen] [androidc1323317619] BackendOnOfficeSync::StatFolder: id=ooroot 28/02/2020 11:01:56 [ 3704] [ INFO] [zpushy@doen] [androidc1323317619] BackendOnOfficeSync::GetFolder: id=ooroot 28/02/2020 11:01:56 [ 3704] [ INFO] [zpushy@doen] [androidc1323317619] ExportChangesDiff->InitializeExporter(): Found '5' changes for 'hierarchy' 28/02/2020 11:01:56 [ 3704] [ INFO] [zpushy@doen] [androidc1323317619] BackendOnOfficeSync::GetFolderList

Big thank you for everyone who pitched in, here and in the other thread! :)

Bye,
BD

I have been wondering about the issue that the password for caldav/carddav and imap have to be the same. This will give you problems when you are using two factor on Nextcloud. When you enable nextcloud two factor you can no longer login to carddav/caldav with your default ldap/sql whatever password.

I have a few ideas how to work around this:

Allow to configure a imap master password (dovecot has this feature) in the z-push configuration so the authentication has to be done with the app password against the carddav/caldav nextcloud backend. -> Requires some changes to z-push Somehow make you imap backend (like dovecot) authenticate to the app password you generate in nextcloud. I am trying to figure out if there is a way to do this. -> Need some help from a nextcloud dev. Disable two factor for the z-push server towards the nextcloud server. At this moment Nextcloud does not support this so it is not an option at this moment.

any other ideas? :)

It seems to work much better, it’s much faster in syncing. Yesterday I had problems of duplicated calendar events on mobile. I hope it was just a spot issue :)

Hi @fbartels

Thanks for your feedback. That’s unfortunate. I will have to figure out if I can make outlook run with dovecot sieve. Thanks though. That helps to understand the architecture a little better.

regards
realshadow

i have the same problem with sansung a50, before it i use xiaomi and didnt have any problems with calendar syncing, but now i have. i use latest z-push combined backend

Which version of the zimbra backend are you using?

Hi @ckruijntjens,

yes, there’s still no eta for this issue.

Manfred

At the moment it’s fine to know it’s honoured, thanks :)

Great news

Hi @Realshadow,

was there also some description?

IMO you’re more likely to receive better answers in an Outlook/MS forum, I’m not an Outlook expert.

Manfred

@orlovnv Hey orlovnv, I set up nextcloud and tested everything extensively. If you want to know more just send me a message. I have a document I can share that explains step by step what I did. Works pretty good. Actually since last night I have a problem with outlook but as soon as I get that fixed it is really awesome.
Where do you run into issues? let me know I am sure I can help out.

Hi @orlovnv,

@orlovnv said in Z-Push with CalDAV backend - timezone issues:

@Manfred i have the same problem debian10 z-push from debian repo 2.4.5-2. +1 hour to my timezone((((

You can follow the progress of the issue here: https://jira.z-hub.io/browse/ZP-1435.

Manfred

Seems like a broken z-push install.

I note you have installed it in /opt/zimbra …

Did you follow a tutorial that had you download and install z-push from somewhere other than the z-push repositories as this is clearly a non standard location?
Did you download the zimbra backend from somewhere other than the sourceforge site?