IMAP messages without UID

hobleyd

Kopano Core: 8.7.0-7ubuntu1

Per https://github.com/nextcloud/mail/issues/3330, Nextcloud can’t access the Kopano emails via IMAP because:

Phew. This is a tricky one. It basically means there is an IMAP message without a UID.

Is this a known issue in the old(er) version of Kopano?

Cheers,
David

fbartels

no as far as I know this is not a known issue, but the version you are using is already quite old as we are already at 8.7.14 for our customers (and 10.0.6 for the nightlies).

What is logged in the gateway logging for such an email?

LicoMonch

@fbartels
I have the same issue with the same version on Debian 10. (Debain-provided packages)

So far on log level 3 is no output. On level 6 was a bit harder to get something useful, but I found two junk mails - one of them showing the Problem.

Here is some debug output from grep’ing the subjects:
(I replaced my domain with ‘RCPT-DOMAIN’ and I don’t care for the spam-from ;) )

Mail without problems (I omit the body, which was printed to the log):

Tue Jul  7 21:58:19 2020: [ZGateway IMAP|T2035] [debug  ] > * 1 FETCH (ENVELOPE ("Tue, 7 Jul 2020 20:36:20 +0700" "***SPAM*** kannst du mich heute treffen" (("Shelby" NIL "GeorgeJenkinsbn" "liss.it")) (("Shelby" NIL "GeorgeJenkinsbn" "liss.it")) (("Shelby" NIL "GeorgeJenkinsbn" "liss.it")) (("Shelby" NIL "nexusforums" "RCPT-DOMAIN")) NIL NIL NIL "<3aad01d6549e$45ce6b10$b20c5e65@GeorgeJenkinsbn>") INTERNALDATE "07-Jul-2020 14:40:15 +0000" UID 1301984 FLAGS (\Seen))

Tue Jul  7 21:58:20 2020: [ZGateway IMAP|T2035] [debug  ] > * 1 FETCH (ENVELOPE ("Tue, 7 Jul 2020 20:36:20 +0700" "***SPAM*** kannst du mich heute treffen" (("Shelby" NIL "GeorgeJenkinsbn" "liss.it")) (("Shelby" NIL "GeorgeJenkinsbn" "liss.it")) (("Shelby" NIL "GeorgeJenkinsbn" "liss.it")) (("Shelby" NIL "nexusforums" "RCPT-DOMAIN")) NIL NIL NIL "<3aad01d6549e$45ce6b10$b20c5e65@GeorgeJenkinsbn>") BODYSTRUCTURE (("text" "plain" ("charset" "us-ascii") NIL NIL "quoted-printable" 2079 147 NIL NIL NIL NIL)("text" "html" ("charset" "iso-8859-1") NIL NIL "base64" 10712 138 NIL NIL NIL NIL) "alternative" ("boundary" "----=_NextPart_C62_A6EC_85678322.C13993D1") NIL NIL NIL) RFC822.SIZE 15805 INTERNALDATE "07-Jul-2020 14:40:15 +0000" UID 1301984 FLAGS (\Seen))

Tue Jul  7 21:58:20 2020: [ZGateway IMAP|T2035] [debug  ] > * 1 FETCH (ENVELOPE ("Tue, 7 Jul 2020 20:36:20 +0700" "***SPAM*** kannst du mich heute treffen" (("Shelby" NIL "GeorgeJenkinsbn" "liss.it")) (("Shelby" NIL "GeorgeJenkinsbn" "liss.it")) (("Shelby" NIL "GeorgeJenkinsbn" "liss.it")) (("Shelby" NIL "nexusforums" "RCPT-DOMAIN")) NIL NIL NIL "<3aad01d6549e$45ce6b10$b20c5e65@GeorgeJenkinsbn>") BODYSTRUCTURE (("text" "plain" ("charset" "us-ascii") NIL NIL "quoted-printable" 2079 147 NIL NIL NIL NIL)("text" "html" ("charset" "iso-8859-1") NIL NIL "base64" 10712 138 NIL NIL NIL NIL) "alternative" ("boundary" "----=_NextPart_C62_A6EC_85678322.C13993D1") NIL NIL NIL) UID 1301984)

The erroneous mail (the body wasn’t printed to log):

Tue Jul  7 21:40:34 2020: [ZGateway IMAP|T805] [debug  ] > * 1 FETCH (ENVELOPE ("Tue, 7 Jul 2020 23:24:08 +0900" "***SPAM*** Gott, wie viele Fantasien erwachst du in meinem Kopf!" (("Addisyn" NIL "ThomasHuntybuse" "avianetwork.ru")) (("Addisyn" NIL "ThomasHuntybuse" "avianetwork.ru")) ("Addisyn" NIL "ThomasHuntybuse" "avianetwork.ru") (("Alia" NIL "nexusforums" "RCPT-DOMAIN")) NIL NIL NIL "<ffe201d654b5$b66b7e00$134b7fed@ThomasHuntybuse>") INTERNALDATE "07-Jul-2020 15:53:43 +0000" UID 1301968 FLAGS (\Seen))

*(here was the test with the mail without problems)*

Tue Jul  7 22:06:19 2020: [ZGateway IMAP|T2133] [debug  ] > * 2 FETCH (ENVELOPE ("Tue, 7 Jul 2020 23:24:08 +0900" "***SPAM*** Gott, wie viele Fantasien erwachst du in meinem Kopf!" (("Addisyn" NIL "ThomasHuntybuse" "avianetwork.ru")) (("Addisyn" NIL "ThomasHuntybuse" "avianetwork.ru")) ("Addisyn" NIL "ThomasHuntybuse" "avianetwork.ru") (("Alia" NIL "nexusforums" "RCPT-DOMAIN")) NIL NIL NIL "<ffe201d654b5$b66b7e00$134b7fed@ThomasHuntybuse>") INTERNALDATE "07-Jul-2020 15:53:43 +0000" UID 1301991 FLAGS (\Seen \Recent))

Does that tell you anything?

LicoMonch

I can see a small diff in the output:

The number opening/closing parenthesis is at one place off by one … or at least for me unexpected ;)
I surrounded it by two bolds in the following code blocks

****diff****

non-working mail:

Tue Jul  7 21:40:34 2020: [ZGateway IMAP|T805] [debug  ] > * 1 FETCH (ENVELOPE ("Tue, 7 Jul 2020 23:24:08 +0900" "***SPAM*** Gott, wie viele Fantasien erwachst du in meinem Kopf!" (("Addisyn" NIL "ThomasHuntybuse" "avianetwork.ru")) (("Addisyn" NIL "ThomasHuntybuse" "avianetwork.ru")) ****("Addisyn" NIL "ThomasHuntybuse" "avianetwork.ru")**** (("Alia" NIL "nexusforums" "RCPT-DOMAIN")) NIL NIL NIL "<ffe201d654b5$b66b7e00$134b7fed@ThomasHuntybuse>") INTERNALDATE "07-Jul-2020 15:53:43 +0000" UID 1301968 FLAGS (\Seen))

working mail:

Tue Jul  7 21:58:19 2020: [ZGateway IMAP|T2035] [debug  ] > * 1 FETCH (ENVELOPE ("Tue, 7 Jul 2020 20:36:20 +0700" "***SPAM*** kannst du mich heute treffen" (("Shelby" NIL "GeorgeJenkinsbn" "liss.it")) (("Shelby" NIL "GeorgeJenkinsbn" "liss.it")) ****(("Shelby" NIL "GeorgeJenkinsbn" "liss.it"))**** (("Shelby" NIL "nexusforums" "RCPT-DOMAIN")) NIL NIL NIL "<3aad01d6549e$45ce6b10$b20c5e65@GeorgeJenkinsbn>") INTERNALDATE "07-Jul-2020 14:40:15 +0000" UID 1301984 FLAGS (\Seen))

jengelh

Parentheses? Sounds like https://github.com/kisli/vmime/pull/203
The PR is included in our libvmime-kopano, but still not in kisli’s.

LicoMonch

@jengelh
Thanks for the pointer. But that didn’t help.
I took your patch and applied it to the debian-source-package, rebuilt it and installed it. Even the debug output stayed the same ;)

I also see that thunderbird seems to have no problems.

In the mentiioned Github issue is stated that the Horde webclient gets ‘null’ instead of an UID.
But in the debug output I clearly see an UID … and as far as it belongs to the log file it is the correct ID (checked against a successful call of thunderbird to the mail)
Also - aside the paranthesis number - there seems to be no difference in the debug log and as an outsider it is kinda hard to believe, that a paranthesis less means returning ‘null’ ;)

Can I somehow get the UID via CLI (bash, etc) … maybe via a telnet session?
I’ll see what I can find on google … any other ideas are of course welcome ;)