[Kolab-devel] Kolab Z-Push 0.2 causes some duplicate contacts

[Rene Mayrhofer]

Dear Alain,

As mentioned in my last email, I can't successfully use Z-Push 1.3 with the 
Kolab backend 0.4 with either the Nokia N900 or any of the Android phones (HTC 
Hero and Desire and Motorola Milestone) I use for testing. Z-Push 1.2.3 with 
Kolab backend 0.2 works - mostly.

The problem is that some of my contacts (starting from 325, which took quite 
some time to clean up after a major triple-all-contacts-and-mess-up-some-fields 
fun) get modified by the Kolab backend on every sync and some of these get 
duplicated while other contacts seem to be deleted from the server. Note that 
this happens on two subsequent syncs triggered manually on e.g. the HTC Desire 
without any changes being made to the contacts on either the client or the 
server. 

The z-push access.log shows the following:

05/14/10 09:02:46 [26421] :  : IMAP connection opened sucessfully user : 
r at doc.to Mobile ID:
05/14/10 09:02:46 [26421] : r at doc.to : Setup : r at doc.to Mobile ID 
:HTCAnd901168d0 Proto Version : 2.5
05/14/10 09:02:46 [26421] : r at doc.to : PDA Folder : INBOX.Contacts  object uid 
:
05/14/10 09:02:46 [26421] : r at doc.to : PDA Folder : INBOX.Contacts  object uid 
:
05/14/10 09:02:46 [26421] : r at doc.to : Change delete imap message : 
INBOX.Contacts 10935
05/14/10 09:02:47 [26421] : r at doc.to : create message : INBOX.Contacts 10937
05/14/10 09:02:47 [26421] : r at doc.to : PDA Folder : INBOX.Contacts  object uid 
:
05/14/10 09:02:47 [26421] : r at doc.to : PDA Folder : INBOX.Contacts  object uid 
:
05/14/10 09:02:47 [26421] : r at doc.to : Change delete imap message : 
INBOX.Contacts 10936
05/14/10 09:02:47 [26421] : r at doc.to : create message : INBOX.Contacts 10938
05/14/10 09:02:47 [26421] : r at doc.to : IMAP connection closed
05/14/10 09:02:48 [26421] :  : IMAP connection opened sucessfully user : 
r at doc.to Mobile ID:
05/14/10 09:02:48 [26421] : r at doc.to : Setup : r at doc.to Mobile ID 
:HTCAnd901168d0 Proto Version : 2.5
05/14/10 09:02:48 [26421] : r at doc.to : Key : 00080A000A duplicated folder 
:INBOX.ContactsImap id : 10901
05/14/10 09:02:48 [26421] : r at doc.to : Key : 000800D000 duplicated folder 
:INBOX.ContactsImap id : 10789
05/14/10 09:02:48 [26421] : r at doc.to : Key : 00050C0E0C duplicated folder 
:INBOX.ContactsImap id : 10610
05/14/10 09:02:48 [26421] : r at doc.to : Key : 0003C90D00 duplicated folder 
:INBOX.ContactsImap id : 10771
05/14/10 09:02:48 [26421] : r at doc.to : Key : 000300040C duplicated folder 
:INBOX.ContactsImap id : 10772
05/14/10 09:02:48 [26421] : r at doc.to : Changed on Server : INBOX.Contacts 
/0E06009735imap id : 10885
05/14/10 09:02:48 [26421] : r at doc.to :                   :
05/14/10 09:02:48 [26421] : r at doc.to : Changed on Server : INBOX.Contacts 
/0E00070100imap id : 10893
05/14/10 09:02:48 [26421] : r at doc.to :                   :
05/14/10 09:02:48 [26421] : r at doc.to : Changed on Server : INBOX.Contacts 
/090E000000imap id : 10697
05/14/10 09:02:48 [26421] : r at doc.to :                   :
05/14/10 09:02:48 [26421] : r at doc.to : Changed on Server : INBOX.Contacts 
/090D000002imap id : 10937
05/14/10 09:02:48 [26421] : r at doc.to :                   :
05/14/10 09:02:49 [26421] : r at doc.to : Changed on Server : INBOX.Contacts 
/090C00BBDFimap id : 10938
05/14/10 09:02:49 [26421] : r at doc.to :                   :
05/14/10 09:02:49 [26421] : r at doc.to : Changed on Server : INBOX.Contacts 
/0305000003imap id : 10911
05/14/10 09:02:49 [26421] : r at doc.to :                   :
05/14/10 09:02:49 [26421] : r at doc.to : Changed on Server : INBOX.Contacts 
/000E000907imap id : 10894
05/14/10 09:02:49 [26421] : r at doc.to :                   :
05/14/10 09:02:49 [26421] : r at doc.to : Changed on Server : INBOX.Contacts 
/0000000000imap id : 10891
05/14/10 09:02:49 [26421] : r at doc.to :                   :
05/14/10 09:02:49 [26421] : r at doc.to : IMAP connection closed
05/14/10 09:02:56 [24986] :  : IMAP connection opened sucessfully user : 
r at doc.to Mobile ID:
05/14/10 09:02:56 [24986] : r at doc.to : Setup : r at doc.to Mobile ID 
:HTCAnd901168d0 Proto Version : 2.5
05/14/10 09:02:58 [24986] : r at doc.to : IMAP connection closed

I have spent roughly two hours trying to grep for the mentioned "duplicate" X-
Uid fields in the Contacts mails as synced by my local Kmail (disconnected 
IMAP) folder. When starting the whole debugging session, there were indeed a 
few duplicates, but these were real duplicate entries (with name, phone number 
etc. being duplicated). After cleaning up, I can only find the IDs mentioned by 
the Kolab backend once in my Contacts folder. Note that after each cleanup, I 
emptied the state/ and kolabindex/ dirs on the server and completely re-
initialized the Exchange sync account on the HTC Desire, forcing a full re-
sync.
The Kolab backend then seems to delete these emails and create new ones with a 
new Uid. However, the newly created objects are duplicated and some 
(seemingly) uncorrellated other contacts go missing instead.

A debug.txt with only the sync represented by the above access log is 
attached, but I wasn't able to read anything from it that would help me debug 
the issue. Can you see what's going wrong here? With this last problem fixed, I 
might finally have a stable Kolab-based Activesync server that I can get other 
people to use.

best regards,
Rene
-------------- next part --------------
A non-text attachment was scrubbed...
Name: debug.txt.gz
Type: application/x-gzip
Size: 20114 bytes
Desc: not available
URL: <http://lists.kolab.org/pipermail/devel/attachments/20100514/e36cdc3f/attachment.gz>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 198 bytes
Desc: This is a digitally signed message part.
URL: <http://lists.kolab.org/pipermail/devel/attachments/20100514/e36cdc3f/attachment.sig>