<story><title>Protonmail can delete the wrong email and nobody cares</title><url>https://github.com/ProtonMail/proton-bridge/issues/220</url></story><parent_chain><item><author>bartbutler</author><text>This is Bart, Proton CTO here. For clarity, the issue mentioned here only impacts Proton Mail Bridge, our desktop IMAP&amp;#x2F;SMTP gateway to Proton Mail encrypted email.&lt;p&gt;The fact that Bridge and its client can become desynchronized sporadically for some users is a high priority issue we have been working on. Bridge is open source, and as a result relies upon open-source components, and the root cause is an architectural issue in a library that Bridge uses to implement IMAP. When there are network issues, this library returns errors to email clients.&lt;p&gt;Unfortunately, there are hundreds of email clients, and some email clients don’t handle errors properly, and this leads to desynchronization.&lt;p&gt;Our error tracking shows this does not happen often (1-2% of Bridge users) and the symptom is usually incorrect display of messages or read&amp;#x2F;unread status which is fixed with an inbox resynchronization. There are cases where a combination of a desynchronized mailbox and a specific series of user actions can lead to accidental email deletion, but this is far rarer than desynchronization. Our implementation tries as hard as possible to avoid this. If you find you are missing an email, our implementation works around the issue by placing it in a users’ All Mail folder.&lt;p&gt;As Bridge is open source, updates on this issue have always been publicly posted on GitHub. Addressing this issue at the source requires replacing the core IMAP library. Unfortunately, there are no FOSS IMAP libraries that are sufficiently well maintained. Therefore, the solution is to build our own IMAP library called Gluon, which we have been focusing on since this issue was reported to us. You can follow the progress of this open-source project here: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;ProtonMail&amp;#x2F;gluon&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;ProtonMail&amp;#x2F;gluon&lt;/a&gt;&lt;p&gt;We are not refusing to fix the problem. The only possible solution is writing a new open-source IMAP library which we can maintain ourselves to ensure this class of errors cannot occur again. We have doubled the size of the team working on this this year so it is a priority for us.&lt;p&gt;We’re confident that this addresses the main sources of desynchronization and will be available in the beta version of Bridge by the end of the year.</text></item></parent_chain><comment><author>cryptonector</author><text>The fundamental problem is that `UID`s in IMAP kinda suck because assigning persistent, unique IDs to emails in a store is a hard problem because doing that for mbox- or maildir-like stores is hard because those predated any notion of remote email access protocols.&lt;p&gt;Thus in practice IMAP servers generally assign `UID`s ephemerally per-session, which means that clients can&amp;#x27;t rely on the stability of `UID`s, which means that clients have to re-obtain `UID`s before operating on emails via IMAP even if they have cached those emails locally.  `UIDVALIDITY` exists to help clients cache and invalidate `UID`s.  The RFC has text about this.&lt;p&gt;A bridge from IMAP to something else (which is basically what every IMAP server ever is) needs to deal with this.  To make `UID`s stable requires keeping state.&lt;p&gt;Clients should really not assume stable `UID`s.  Instead clients should `SEARCH` or list to get [temporarily] valid `UID`s then use those to delete etc.</text></comment>
<story><title>Protonmail can delete the wrong email and nobody cares</title><url>https://github.com/ProtonMail/proton-bridge/issues/220</url></story><parent_chain><item><author>bartbutler</author><text>This is Bart, Proton CTO here. For clarity, the issue mentioned here only impacts Proton Mail Bridge, our desktop IMAP&amp;#x2F;SMTP gateway to Proton Mail encrypted email.&lt;p&gt;The fact that Bridge and its client can become desynchronized sporadically for some users is a high priority issue we have been working on. Bridge is open source, and as a result relies upon open-source components, and the root cause is an architectural issue in a library that Bridge uses to implement IMAP. When there are network issues, this library returns errors to email clients.&lt;p&gt;Unfortunately, there are hundreds of email clients, and some email clients don’t handle errors properly, and this leads to desynchronization.&lt;p&gt;Our error tracking shows this does not happen often (1-2% of Bridge users) and the symptom is usually incorrect display of messages or read&amp;#x2F;unread status which is fixed with an inbox resynchronization. There are cases where a combination of a desynchronized mailbox and a specific series of user actions can lead to accidental email deletion, but this is far rarer than desynchronization. Our implementation tries as hard as possible to avoid this. If you find you are missing an email, our implementation works around the issue by placing it in a users’ All Mail folder.&lt;p&gt;As Bridge is open source, updates on this issue have always been publicly posted on GitHub. Addressing this issue at the source requires replacing the core IMAP library. Unfortunately, there are no FOSS IMAP libraries that are sufficiently well maintained. Therefore, the solution is to build our own IMAP library called Gluon, which we have been focusing on since this issue was reported to us. You can follow the progress of this open-source project here: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;ProtonMail&amp;#x2F;gluon&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;ProtonMail&amp;#x2F;gluon&lt;/a&gt;&lt;p&gt;We are not refusing to fix the problem. The only possible solution is writing a new open-source IMAP library which we can maintain ourselves to ensure this class of errors cannot occur again. We have doubled the size of the team working on this this year so it is a priority for us.&lt;p&gt;We’re confident that this addresses the main sources of desynchronization and will be available in the beta version of Bridge by the end of the year.</text></item></parent_chain><comment><author>twleo</author><text>&amp;gt; Bridge is open source, and as a result relies upon open-source components&lt;p&gt;I don&amp;#x27;t get it. Bridge is open source does not imply it should relies upon open-source components.&lt;p&gt;&amp;gt; Addressing this issue at the source requires replacing the core IMAP library.&lt;p&gt;Why building an IMAP library from scratch instead of fixing&amp;#x2F;forking go-imap? 
Even a temporary fix to go-imap when you are developing gluon?
Another repetitive work which does not guarantee the mentioned issues will be resolved completely.</text></comment>