Z-Push 2.3.x beta/pre-final updates

Hi all,

since the availability of the repositories we are going to change our release procedure in relation to alpha and beta releases, very much like we already did during the beta phase of Z-Push 2.3.0.

You can continue using the pre-final repository, you will automatically get fixes fast and install beta versions.

  • When a final is released, in the release/2.3 branch/pre-final repo this version also gets a tag, like version+1-beta0. So, 2.3.0 final in master is called 2.3.1beta0 in release/2.3.
  • Changes are going to be continuously merged into the release/2.3 branch.
  • By using the pre-final repository you will get these changes when update/upgrade from the repository.
  • These changes will be part of the next released beta, but you will have them before the beta is officially released (a released beta is just a bundle of changes).

Example:

  • 2.3.0 was released (final, in the GIT master branch)
  • in release/2.3 2.3.0 is called 2.3.1beta0+0 (same thing, just a different name)
  • as changes are merged, the last number will increase, 2.3.1beta0+6 are changes that are going to become 2.3.1beta1. Same as 2.3.1beta1+X are changes that are going to become 2.3.1beta2 (or perhaps final if we consider these changes trivial enough that we don’t release another beta).

This thread is to keep you updated about the changes that are merged into the release/2.3 branch.

Alternatively you could get the same via a GIT checkout of the release/2.3 branch.

This topic is analog to https://forums.zarafa.com/showthread.php?12739-Z-Push-2-3-x-beta-pre-final-updates

If you have any feedback about the version, please open a new thread mentioning the exact version number logged in your z-push log.

Cheers,
Sebastian

The last 2 messages from the Zarafa forum thread will be added here to be complete.

First round of changes for 2.3.5:
https://jira.z-hub.io/browse/ZP-869 [IMAP] utf-7 charset conversion: some folders are not shown - Japanese encoding (Thanks YANO for contributing!)
https://jira.z-hub.io/browse/ZP-907 KOE: Secondary Contact folder support
https://jira.z-hub.io/browse/ZP-998 Implement script that synchronizes the GAB into a contact folder as contacts
https://jira.z-hub.io/browse/ZP-1112 Get timezone from Z-Push or system if it’s empty for getMSTZnameFromTZName
https://jira.z-hub.io/browse/ZP-1119 z-push-admin should show info about shared folders in details
https://jira.z-hub.io/browse/ZP-1128 Do not sync undesired folders (like “Suggested contacts”)
https://jira.z-hub.io/browse/ZP-1130 Improve default AutoDiscover config (Thanks Roel for contributing!)
https://jira.z-hub.io/browse/ZP-1131 Add lighttpd config for AutoDiscover (Thanks Roel for contributing!)
https://jira.z-hub.io/browse/ZP-1132 KOE: Store client capabilities
https://jira.z-hub.io/browse/ZP-1136 Task request doesn’t appear in the inbox
https://jira.z-hub.io/browse/ZP-1137 z-push-gabsync symlink is not set in RPMs
https://jira.z-hub.io/browse/ZP-1141 WebserviceDevice->AdditionalFolderList() fails on PHP7
https://jira.z-hub.io/browse/ZP-1142 Add readme and contributors file
https://jira.z-hub.io/browse/ZP-1143 Strict Standards message when sending an email using IMAP backend
https://jira.z-hub.io/browse/ZP-1147 Typo in DeviceInformation tag name
https://jira.z-hub.io/browse/ZP-1148 Username and deviceid not logged if the device sends base64 query string
https://jira.z-hub.io/browse/ZP-1149 Add missing dependencies for the IMAP backend
https://jira.z-hub.io/browse/ZP-1151 Ping fails with Provisioning required after policy key update

Two new features for Kopano:

  • a script that synchronizes your GAB into a contacts folder (e.g. in the public folder). The script is able to update data efficiently. Check the z-push-kopano-gab2contacts package. More information here: https://wiki.z-hub.io/display/ZP/Installation#Installation-OtherPackages
  • KOE feature: other contact folders (your own or from shared stores). At least KOE v 1.3.112 is required for this to work (will be available as beta soon).

Changes in configuration files:

  • Autodiscover: The SERVERURL parameter was replaced by ZPUSH_HOST which expects only a domain name. If ZPUSH_HOST is not set the AutoDiscover host will be used. The new parameter needs to be adjusted, see ZP-1130 for details.
  • Z-Push config: Added a configuration option for KOE secondary contact folder support (not functional without KOE 1.3)

Current version of the release/2.3 branch and pre-final repository is 2.3.5beta0+96.

Some more changes for for 2.3.5 (beta1 scheduled for 15.02.2017):
https://jira.z-hub.io/browse/ZP-1065 KOE: inject signatures from WebApp (not yet enabled)
https://jira.z-hub.io/browse/ZP-1129 Z-Push does not install on RHEL_7_PHP_56 (and likely RHEL_6_PHP_56)
https://jira.z-hub.io/browse/ZP-1154 Android Blackberry unable to display signed emails
https://jira.z-hub.io/browse/ZP-1155 (IMAP) iOS mail with z-push preview show raw html (Thanks YANO for contributing)
https://jira.z-hub.io/browse/ZP-1156 Calling z-push-admin/z-push-top from the kopano backend dir results in php traceback
https://jira.z-hub.io/browse/ZP-1157 Reload state and initialize StateMachine again when synching a partial requested folder
https://jira.z-hub.io/browse/ZP-1158 Outlook over AS sync doesn’t work if native body type is 0

Current version of the release/2.3 branch and pre-final repository is 2.3.5beta0+121.

Final round of updates for 2.3.5 beta1:
https://jira.z-hub.io/browse/ZP-1110 Add config option KOE_CAPABILITY_SIGNATURES
https://jira.z-hub.io/browse/ZP-1159 SendMail with attachments uses too much memory
https://jira.z-hub.io/browse/ZP-1160 Warnings in MR sync when user not found

There is (again) an update to the main configuration file to enable the sending WebApp signatures to OL+KOE. This feature is enabled by default but current KOE versions don’t support it yet. This won’t result in any error/issue.
A KOE beta with signature support (and other fixes/features) will be released soon.

An update to this version is highly recommended, as it fixes memory usage issues when sending emails with (big) attachments. The php process can run out of memory with a 20 MB attachment and a memory limit of 256 MB. This becomes an issue especially if you use KOE with the send-as functionality.

Z-Push 2.3.5 beta1 is announced in:

Current version of the release/2.3 branch is 2.3.5beta1+0.

Small fix for gab2contacts:
https://jira.z-hub.io/browse/ZP-1166 - Gab2Contacts shows one empty contact on multi-tenant systems

Current version of the pre-final repository is 2.3.5beta1+3.

Final changes for Z-Push 2.3.5:
https://jira.z-hub.io/browse/ZP-1173 Parentid missing in WebserviceDevice->AdditionalFolderList()
https://jira.z-hub.io/browse/ZP-1174 Add new shared folder flag & match flag names for KOE 1.3
https://jira.z-hub.io/browse/ZP-1175 Kopano listfolders script can not be executed with KC 8.2.0 final

This marks version 2.3.5 announced here:

Current version of the pre-final repository is 2.3.6beta0+0 (same as 2.3.5+0).

Hotfix update on release/2.3 and also merged into 2.3.5 final:
https://jira.z-hub.io/browse/ZP-1179 - Deleting folders in Kopano WebApp is not synchronized to the client

Current version of pre-final is 2.3.6beta0+3
Current version of final is 2.3.5+4

First round of updates for 2.3.6 beta1:
https://jira.z-hub.io/browse/ZP-1152 Update license in Net/SMTP.php
https://jira.z-hub.io/browse/ZP-1167 Some new messages are outdated and lost when sync
https://jira.z-hub.io/browse/ZP-1168 Log wait time in INFO level
https://jira.z-hub.io/browse/ZP-1169 Kopano MAPI_E_UNCONFIGURED (0x8004011C) causes a folder resync
https://jira.z-hub.io/browse/ZP-1172 [IMAP] Some mails bodies or headers in Japanese may be decoded in wrong encoding
https://jira.z-hub.io/browse/ZP-1178 Use PR_SEARCH_KEY in cases the GAB entry of a recipient is not available
https://jira.z-hub.io/browse/ZP-1180 Implement plain streams for CalDav and CardDav backends
https://jira.z-hub.io/browse/ZP-1182 WARN messages doesn’t log into z-push-error.log
https://jira.z-hub.io/browse/ZP-1185 Messages in error log are duplicated
https://jira.z-hub.io/browse/ZP-1186 Folder created under root in Outlook is not synced
https://jira.z-hub.io/browse/ZP-1188 Check if OOF expired and disabled it if needed

Current version of the release/2.3 branch is 2.3.6beta0+42

For 2.3.5 we have two IMAP backend related fixes that were hotfixed but also merged through the release/2.3 / pre-final branch:

https://jira.z-hub.io/browse/ZP-1155 REVERT: [IMAP] iOS mail with z-push preview show raw html
https://jira.z-hub.io/browse/ZP-1191 Z-Push 2.3.5 breaks CentOS updates / libawl invalid dependency

Current version of the release/2.3 branch is 2.3.6beta0+47

Last round of changes for 2.3.6 beta1:
https://jira.z-hub.io/browse/ZP-1135 Update licensesof forked PEAR classes to be compatible with Debian (includes ZP-1152, ZP-1187, ZP-1189, ZP-1193) (thanks to Roel for achieving this!)
https://jira.z-hub.io/browse/ZP-1163 Warning when install z-push-common on a new system
https://jira.z-hub.io/browse/ZP-1168 Log wait time in INFO level (also in OPTIONS request)
https://jira.z-hub.io/browse/ZP-1190 Missing manpages for installed binaries (thanks to Roel for contributing)
https://jira.z-hub.io/browse/ZP-1195 Expose WebserviceDevice->GetDeviceDetails() for a single device

This marks version 2.3.6 beta1 announced here:
https://forum.kopano.io/topic/169/z-push-2-3-6-beta1-released

Current version of the pre-final repository is 2.3.6beta1+0.

Z-Push 2.3.6 final was released, which is the same as 2.3.6beta1(+0).
Atm there is no update in the pre-final repository as it’s not necessary (it’s exactly same code).

New tickets for 2.3.7 are in preparation and be made available very soon.

Merged first tickets for 2.3.7:
https://jira.z-hub.io/browse/ZP-1177 KOE: private appointments in shared folders are not visible after making them public
https://jira.z-hub.io/browse/ZP-1197 Add a flag to WebserviceDevice->GetDeviceDetails() to (not) include hierarchy cache
https://jira.z-hub.io/browse/ZP-1198 WebserviceDevice->GetDeviceDetails() should not return hierarchy cache

Current version of the pre-final repository is 2.3.7beta0+11

Next tickets for 2.3.7:
https://jira.z-hub.io/browse/ZP-1196 Warning in gab-sync with hidden groups
https://jira.z-hub.io/browse/ZP-1199 Truncating emails can result in invalid strings
https://jira.z-hub.io/browse/ZP-1201 Settings command triggered by KOE always overwrites device data
https://jira.z-hub.io/browse/ZP-1204 Process delivery request from KOE
https://jira.z-hub.io/browse/ZP-1208 Meeting shows up twice in Outlook calendar
https://jira.z-hub.io/browse/ZP-1210 Not possible to install z-push-kopano-gabsync on CentOS/RHEL/Fedora
https://jira.z-hub.io/browse/ZP-1212 Folder stat data expiration time should be randomized
https://jira.z-hub.io/browse/ZP-1215 Error on generating first sync state if GlobalWindowSize is full
https://jira.z-hub.io/browse/ZP-1219 Introduce hidden debugging flag for WBXML decoder
https://jira.z-hub.io/browse/ZP-1220 Outlook is “disconnected” after adding a Contact folder
https://jira.z-hub.io/browse/ZP-1221 Unable to create OL2013 profile when password contains special chars

This update will ask you to update your configuration file to include another new KOE feature option to request delivery receipts part of KOE 1.4. You should include this configuration option already now so it will work in the future.

Current version of the pre-final repository is 2.3.7beta0+43.

Last round of tickets for 2.3.7 beta1:
https://jira.z-hub.io/browse/ZP-1200 IPv6 address not logged correctly (Contributed by Chris Pitchford - Thanks!)
https://jira.z-hub.io/browse/ZP-1227 Prioritize KOE GAB sync
https://jira.z-hub.io/browse/ZP-1228 Accept folders with type “OTHER” as shared folders
https://jira.z-hub.io/browse/ZP-1229 Strict type checking in SyncObject.equals() may break other backends (Contributed by Vincent Sherwood aka. liverpoolfcfan - Thanks!)

This marks version 2.3.7 beta1 announced here:
https://forum.kopano.io/topic/333/z-push-2-3-7-beta1-released

Current version of the pre-final repository is 2.3.7beta1+0.

One hotfix for 2.3.7 final:
https://jira.z-hub.io/browse/ZP-1243 Always send X-Push-Capabilities header in Settings responses, always log special headers in DEBUG.

This marks version 2.3.7 final announced here:
https://forum.kopano.io/topic/377/z-push-2-3-7-final-released

New tickets for 2.3.8 are in preparation and be made available very soon (mainly Window Phone 8.1 fixes).

openSuse repositories: due to a malfunction of our build service we are tempoarly not able to provide packages for openSuse 13.2 and 42.2. We will fix this and update the repositories asap.

Current version of the pre-final repository is 2.3.8beta0+0.

First changes for the upcoming 2.3.8:
Changelog:
https://jira.z-hub.io/browse/ZP-1164 Upgrading z-push-common could take a very long time
https://jira.z-hub.io/browse/ZP-1223 running z-push-top as root destroy /dev/null (thanks Nicolas Vanheuverzwijn for contributing)
https://jira.z-hub.io/browse/ZP-1224 [caldav] Pass PHP supported timezone to DateTimeZone
https://jira.z-hub.io/browse/ZP-1230 Windows Phone 8.1 - Data can not be retrieved via ItemOperations (thanks Andreas Brodowski for contributing)
https://jira.z-hub.io/browse/ZP-1239 WP 8.1 sends client changes and fetch in one request
https://jira.z-hub.io/browse/ZP-1241 Don’t perform heartbeat in empty sync requests
https://jira.z-hub.io/browse/ZP-1244 Caldav never matches personal/main calendars/tasks if defined CALDAV_PERSONAL has uppercase characters (thanks Chris Pitchford for contributing)

openSuse repositories: due to a malfunction of our build service we are tempoarly not able to provide packages for openSuse 13.2 and 42.2. We will fix this and update the repositories asap.

Most fixes are related to Windows Phone 8.1. If you have these devices an update is encouraged. Please provide feedback.

Current version of the pre-final repository is 2.3.8beta0+22.

Some more changes for 2.3.8:
https://jira.z-hub.io/browse/ZP-1238 Resources booked in Outlook are saved as “required” attendees
https://jira.z-hub.io/browse/ZP-1247 Unexpected synckey (StateInvalidException) for backends without FolderStats support
https://jira.z-hub.io/browse/ZP-1248 Include WindowsMail in the list of long timeout clients
https://jira.z-hub.io/browse/ZP-1249 WP 8.1: Empty sync + empty response trigger loop

These tickets are mostly important for the WindowsMail client and for Windows Mobile. ZP-1249 fixes an issue introduced with ZP-1241 (included in 2.3.8beta0+22), so an update is highly encouraged when using Windows Phone clients.

openSuse repositories: due to a malfunction of our build service we are temporarily not able to provide packages for openSuse 13.2 and 42.2. We will fix this and update the repositories asap.

Current version of the pre-final repository is 2.3.8beta0+31.

Last batch of changes for 2.3.8beta1:
Changelog:
https://jira.z-hub.io/browse/ZP-1240 HTML safe truncate streams containing HTML data.
https://jira.z-hub.io/browse/ZP-1250 Search for X-Push-Sender only in the headers.
https://jira.z-hub.io/browse/ZP-1251 Aggregate Ping announcements about changes.
https://jira.z-hub.io/browse/ZP-1254 Wastebasket not available when removing an item in public folder.
https://jira.z-hub.io/browse/ZP-1255 Directly use sharedUser if it’s an email address. Enables sending in multi-company environments.
https://jira.z-hub.io/browse/ZP-1256 Set backend2folderidCache of ASDevice to false, so it can be rebuilt.
https://jira.z-hub.io/browse/ZP-1257 Remove statically configured shared folders from the list sent to ASDevice->SetAdditionalFolderList().
https://jira.z-hub.io/browse/ZP-1259 Check if sm->data is empty for SendMail.
https://jira.z-hub.io/browse/ZP-1268 Undefined variable: name in z-push-admin.

openSuse repositories: due to a malfunction of our build service we are temporarily not able to provide packages for openSuse 13.2 and 42.2. We will fix this and update the repositories when the underlying cause will be resolved.

Current version of the pre-final repository is 2.3.8beta1+0.

A few more fixes for 2.3.8 - resulting in the beta2 to be released:
https://jira.z-hub.io/browse/ZP-1211 php-memcached not available on CentOS
https://jira.z-hub.io/browse/ZP-1262 Synchronization progress of z-push-admin shows Folder: unknown
https://jira.z-hub.io/browse/ZP-1269 Carddav backend, newlines result in an invalid vcard
https://jira.z-hub.io/browse/ZP-1273 Missing warnings for autodiscover
https://jira.z-hub.io/browse/ZP-1274 Carddav backend, wrong url in debug logging
https://jira.z-hub.io/browse/ZP-1275 GAL does not work with DAViCal backend
https://jira.z-hub.io/browse/ZP-1277 Fatal error in Ping
https://jira.z-hub.io/browse/ZP-1278 Caldav Backend does not pick up user and domain; results in non-editable events on Exchange device (E.g. phones)
https://jira.z-hub.io/browse/ZP-1279 Imap backend delete
https://jira.z-hub.io/browse/ZP-1280 Email from a deleted user doesn’t show from
https://jira.z-hub.io/browse/ZP-1281 : not escaped when creating icalendar
https://jira.z-hub.io/browse/ZP-1282 Store deleted occurrences as EXDATE in caldav

Due to the amount of changes (and enable contributors to see their changes released fast) we decided to release another beta version of 2.3.8.

Current version of the pre-final repository is 2.3.8beta2+0.

Another 2 fixes merged for the final version:
https://jira.z-hub.io/browse/ZP-1285 Caldav time zone incorrectly converted - Thanks Karl Denninger for contributing!
https://jira.z-hub.io/browse/ZP-1286 Unable to delete an appointment on mobile phone - introduced with ZP-1177 (2.3.7) - Thanks to Christian aka externa1 for reporting!

These will still be released as 2.3.8 final in addition to 2.3.8beta2.

Current version of the pre-final repository is 2.3.8beta2+6.

Locked