[Kolab-devel] Kolab Z-Push 0.2 causes some duplicate contacts

Alain Abbas alain.abbas at libertech.fr
Fri May 14 12:12:23 CEST 2010


Rene Mayrhofer a écrit :
> Dear Alain,
>
> Thanks for the quick response!
>
> On Freitag, 14. Mai 2010 10:20:18 you wrote:
>   
>>> :HTCAnd901168d0 Proto Version : 2.5
>>>
>>> 05/14/10 09:02:48 [26421] : r at doc.to : Key : 00080A000A duplicated folder
>>>
>>> :INBOX.ContactsImap id : 10901
>>>
>>> 05/14/10 09:02:48 [26421] : r at doc.to : Key : 000800D000 duplicated folder
>>>
>>> :INBOX.ContactsImap id : 10789
>>>
>>> 05/14/10 09:02:48 [26421] : r at doc.to : Key : 00050C0E0C duplicated folder
>>>
>>> :INBOX.ContactsImap id : 10610
>>>
>>> 05/14/10 09:02:48 [26421] : r at doc.to : Key : 0003C90D00 duplicated folder
>>>
>>> :INBOX.ContactsImap id : 10771
>>>
>>> 05/14/10 09:02:48 [26421] : r at doc.to : Key : 000300040C duplicated folder
>>>
>>> :INBOX.ContactsImap id : 10772
>>>       
>> There are some contacts with the same UID in the folder Key is the Key
>> and id : is the imap uid ( the name on the file in cyrus folder)
>> try to clean these uids , the backend keep the uid Inside the Xml file
>> and doesn t  care of any header tags.
>>     
>
> I didn't understand what the "Key" is exactly - is this the name/subject of 
> the IMAP mail or some header? I already found the "id" stored as X-Uid in the 
> email header.
>   
key is the attribute <UID> OF THE Xml file who is in attachment in the 
mail message
this key normaly is also in the subject.
the ID is the unique sequence number of the mail message (Imap) you 
could find it when you watch
in the cyrus directory 
/kolab/var/imap/spool/domain/d/doc.to/r/user/r/Contacts
each name of the file is the imap id

Normaly each client work with only the XML uid tag because some client 
doesn t put the uid in the subject.
the principle is :
the backend maintain a table UID ->imapid
if the message is modified on the server the imapid will change because 
in the imap storage the mail is removed and a new one
is created with the contact inside ( same UID)
if you have 2 same UID on the folder you see that each time that the 
sync will be run the imapid will change
this thing is corrected with the backend 0.4 , and the cache system is 
entierly rewritten ( now one file by user_deviceID)

Regards
Alain
> Maybe this is the problem: that the Kolab backend uses only the Uid inside the 
> kolab.xml file, while Kontact/Kmail uses the header? Which part would set the 
> header?
>
> It seems to me that there is some problem with matching the Uid properly 
> between IMAP/Kontact and the Kolab backend for Z-Push.
>
> Update: With Z-Push 1.2.3 and Kolab backend 0.4, I now get the following zu-
> push/access.log entries (contact names removed for privacy reasons):
>
> 05/14/10 11:36:15 [26595] :  : KolabBackend Version : 0.4
> 05/14/10 11:36:15 [26595] :  : IMAP connection opened sucessfully user : 
> r at doc.to
> 05/14/10 11:36:15 [26595] : r at doc.to : Setup : r at doc.to Mobile ID 
> :HTCAnd901168d0 Proto Version : 2.5 DeviceType : htcbravo DeviceAgent : 
> Android-EAS/0.1                                                                                       
> 05/14/10 11:36:15 [26595] : r at doc.to : NOTICE : findMode Flatmode                                                       
> 05/14/10 11:36:15 [26595] : r at doc.to : NOTICE StatMessage Flmode: 90 - >                                                
> 05/14/10 11:36:15 [26595] : r at doc.to : NOTICE DeleteMessage Flmode: 90 - >                                              
> 05/14/10 11:36:15 [26595] : r at doc.to : NOTICE StatMessage Flmode: 
> F061CC73B3C56ECBC10419BDF3CF919D - > INBOX/Contacts   
> 05/14/10 11:36:15 [26595] : r at doc.to : PDA Folder : VIRTUAL/contacts  object 
> uid :                                      
> 05/14/10 11:36:15 [26595] : r at doc.to : NOTICE ChangeMessage Flmode: 
> F061CC73B3C56ECBC10419BDF3CF919D - > INBOX/Contacts 
> 05/14/10 11:36:15 [26595] : r at doc.to : Change delete imap message : 
> INBOX/Contacts 11092                                
> 05/14/10 11:36:15 [26595] : r at doc.to : create message : INBOX/Contacts 11271                                            
> 05/14/10 11:36:15 [26595] : r at doc.to : NOTICE StatMessage Flmode: 
> AE18DB5C81C0DBD0E9945E0B81A91AA1 - > INBOX/Contacts   
> 05/14/10 11:36:15 [26595] : r at doc.to : PDA Folder : VIRTUAL/contacts  object 
> uid :                                      
> 05/14/10 11:36:15 [26595] : r at doc.to : NOTICE ChangeMessage Flmode: 
> AE18DB5C81C0DBD0E9945E0B81A91AA1 - > INBOX/Contacts 
> 05/14/10 11:36:15 [26595] : r at doc.to : Change delete imap message : 
> INBOX/Contacts 11053                                
> 05/14/10 11:36:15 [26595] : r at doc.to : create message : INBOX/Contacts 11272                                            
> 05/14/10 11:36:15 [26595] : r at doc.to : IMAP connection closed                                                           
> 05/14/10 11:36:16 [26595] :  : KolabBackend Version : 0.4                                                               
> 05/14/10 11:36:16 [26595] :  : IMAP connection opened sucessfully user : 
> r at doc.to                                       
> 05/14/10 11:36:16 [26595] : r at doc.to : Setup : r at doc.to Mobile ID 
> :HTCAnd901168d0 Proto Version : 2.5 DeviceType : htcbravo DeviceAgent : 
> Android-EAS/0.1                                                                                       
> 05/14/10 11:36:16 [26595] : r at doc.to : NOTICE : findMode Flatmode                                                       
> 05/14/10 11:36:16 [26595] : r at doc.to : GetAnnotation INBOX/Trash : 0                                                    
> 05/14/10 11:36:17 [26595] : r at doc.to : GetAnnotation INBOX : 0
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE StatMessage Flmode: 0E06009735 - 
>   
>> INBOX/Contacts
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE StatMessage Flmode: 0E06009735 - 
>   
>> INBOX/Contacts
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE GetMessage Flmode: 0E06009735 - 
>   
>> INBOX/Contacts 
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : Changed on Server C: INBOX/Contacts 
> /0E06009735imap id : 11231
> 05/14/10 11:36:17 [26595] : r at doc.to :                   : XXXXXXXXXXXXXXXXx
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE StatMessage Flmode: 0E00070100 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE StatMessage Flmode: 0E00070100 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE GetMessage Flmode: 0E00070100 - 
>   
>> INBOX/Contacts       
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : Changed on Server C: INBOX/Contacts 
> /0E00070100imap id : 11239
> 05/14/10 11:36:17 [26595] : r at doc.to :                   : XXXXXXXXXXXXXXXXx                               
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE StatMessage Flmode: 090E000000 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE StatMessage Flmode: 090E000000 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE GetMessage Flmode: 090E000000 - 
>   
>> INBOX/Contacts       
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : Changed on Server C: INBOX/Contacts 
> /090E000000imap id : 11043
> 05/14/10 11:36:17 [26595] : r at doc.to :                   : XXXXXXXXXXXXXXXXx                            
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE StatMessage Flmode: 090D000002 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE StatMessage Flmode: 090D000002 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE GetMessage Flmode: 090D000002 - 
>   
>> INBOX/Contacts       
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : Changed on Server C: INBOX/Contacts 
> /090D000002imap id : 10951
> 05/14/10 11:36:17 [26595] : r at doc.to :                   : XXXXXXXXXXXXXXXXx
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE StatMessage Flmode: 090C00BBDF - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE StatMessage Flmode: 090C00BBDF - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE GetMessage Flmode: 090C00BBDF - 
>   
>> INBOX/Contacts       
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : Changed on Server C: INBOX/Contacts 
> /090C00BBDFimap id : 10950
> 05/14/10 11:36:17 [26595] : r at doc.to :                   : XXXXXXXXXXXXXXXXx
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE StatMessage Flmode: 000E000907 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE StatMessage Flmode: 000E000907 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : NOTICE GetMessage Flmode: 000E000907 - 
>   
>> INBOX/Contacts       
>>     
> 05/14/10 11:36:17 [26595] : r at doc.to : Changed on Server C: INBOX/Contacts 
> /000E000907imap id : 11240
> 05/14/10 11:36:17 [26595] : r at doc.to :                   : XXXXXXXXXXXXXXXXx
> 05/14/10 11:36:17 [26595] : r at doc.to : IMAP connection closed                                        
>
> And on the next try (again with no changes on either client or server):
>
> 05/14/10 11:39:53 [16158] : r at doc.to : NOTICE StatMessage Flmode: 090C00BBDF - 
>   
>> INBOX/Contacts
>>     
> 05/14/10 11:39:53 [16158] : r at doc.to : NOTICE DeleteMessage Flmode: 090C00BBDF 
> - > INBOX/Contacts
> 05/14/10 11:39:53 [16158] : r at doc.to : IMAP connection closed                                    
> 05/14/10 11:39:54 [16158] :  : KolabBackend Version : 0.4                                        
> 05/14/10 11:39:54 [16158] :  : IMAP connection opened sucessfully user : 
> r at doc.to                
> 05/14/10 11:39:54 [16158] : r at doc.to : Setup : r at doc.to Mobile ID 
> :HTCAnd901168d0 Proto Version : 2.5 DeviceType : htcbravo DeviceAgent : 
> Android-EAS/0.1                                                                                       
> 05/14/10 11:39:54 [16158] : r at doc.to : NOTICE : findMode Flatmode                                                       
> 05/14/10 11:39:54 [16158] : r at doc.to : NOTICE StatMessage Flmode: 090D000002 - 
>   
>> INBOX/Contacts                         
>>     
> 05/14/10 11:39:54 [16158] : r at doc.to : PDA Folder : VIRTUAL/contacts  object 
> uid :                                      
> 05/14/10 11:39:54 [16158] : r at doc.to : NOTICE ChangeMessage Flmode: 090D000002 
> - > INBOX/Contacts                       
> 05/14/10 11:39:54 [16158] : r at doc.to : Change delete imap message : 
> INBOX/Contacts 10951                                
> 05/14/10 11:39:54 [16158] : r at doc.to : create message : INBOX/Contacts 11273                                            
> 05/14/10 11:39:54 [16158] : r at doc.to : NOTICE StatMessage Flmode: 090C00BBDF - 
>   
>> INBOX/Contacts                         
>>     
> 05/14/10 11:39:54 [16158] : r at doc.to : PDA Folder : VIRTUAL/contacts  object 
> uid :                                      
> 05/14/10 11:39:54 [16158] : r at doc.to : NOTICE ChangeMessage Flmode: 090C00BBDF 
> - > INBOX/Contacts                       
> 05/14/10 11:39:54 [16158] : r at doc.to : Change delete imap message : 
> INBOX/Contacts 10950                                
> 05/14/10 11:39:54 [16158] : r at doc.to : create message : INBOX/Contacts 11274                                            
> 05/14/10 11:39:54 [16158] : r at doc.to : IMAP connection closed                                                           
> 05/14/10 11:39:55 [16158] :  : KolabBackend Version : 0.4                                                               
> 05/14/10 11:39:55 [16158] :  : IMAP connection opened sucessfully user : 
> r at doc.to                                       
> 05/14/10 11:39:55 [16158] : r at doc.to : Setup : r at doc.to Mobile ID 
> :HTCAnd901168d0 Proto Version : 2.5 DeviceType : htcbravo DeviceAgent : 
> Android-EAS/0.1                                                                                       
> 05/14/10 11:39:55 [16158] : r at doc.to : NOTICE : findMode Flatmode                                                       
> 05/14/10 11:39:55 [16158] : r at doc.to : GetAnnotation INBOX/Trash : 0
> 05/14/10 11:39:56 [16158] : r at doc.to : GetAnnotation INBOX : 0
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE StatMessage Flmode: 47820E0003 - 
>   
>> INBOX/Contacts
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE StatMessage Flmode: 47820E0003 - 
>   
>> INBOX/Contacts
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE GetMessage Flmode: 47820E0003 - 
>   
>> INBOX/Contacts 
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : Changed on Server C: INBOX/Contacts 
> /47820E0003imap id : 10989
> 05/14/10 11:39:56 [16158] : r at doc.to :                   : XXXXXXXXXXXXXXXXx                      
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE StatMessage Flmode: 0E06009735 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE StatMessage Flmode: 0E06009735 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE GetMessage Flmode: 0E06009735 - 
>   
>> INBOX/Contacts       
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : Changed on Server C: INBOX/Contacts 
> /0E06009735imap id : 11231
> 05/14/10 11:39:56 [16158] : r at doc.to :                   : XXXXXXXXXXXXXXXXx                           
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE StatMessage Flmode: 0E00070100 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE StatMessage Flmode: 0E00070100 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE GetMessage Flmode: 0E00070100 - 
>   
>> INBOX/Contacts       
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : Changed on Server C: INBOX/Contacts 
> /0E00070100imap id : 11239
> 05/14/10 11:39:56 [16158] : r at doc.to :                   : XXXXXXXXXXXXXXXXx
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE StatMessage Flmode: 090E000000 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE StatMessage Flmode: 090E000000 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE GetMessage Flmode: 090E000000 - 
>   
>> INBOX/Contacts       
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : Changed on Server C: INBOX/Contacts 
> /090E000000imap id : 11043
> 05/14/10 11:39:56 [16158] : r at doc.to :                   : XXXXXXXXXXXXXXXXx                            
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE StatMessage Flmode: 000E000907 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE StatMessage Flmode: 000E000907 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE GetMessage Flmode: 000E000907 - 
>   
>> INBOX/Contacts       
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : Changed on Server C: INBOX/Contacts 
> /000E000907imap id : 11240
> 05/14/10 11:39:56 [16158] : r at doc.to :                   : XXXXXXXXXXXXXXXXx
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE StatMessage Flmode: 0000000000 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE StatMessage Flmode: 0000000000 - 
>   
>> INBOX/Contacts      
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : NOTICE GetMessage Flmode: 0000000000 - 
>   
>> INBOX/Contacts       
>>     
> 05/14/10 11:39:56 [16158] : r at doc.to : Changed on Server C: INBOX/Contacts 
> /0000000000imap id : 11237
> 05/14/10 11:39:56 [16158] : r at doc.to :                   : XXXXXXXXXXXXXXXXx
> 05/14/10 11:39:56 [16158] : r at doc.to : IMAP connection closed
>
> The second try lists most of the contacts that were changed on the first one, 
> but adds two other contacts to the "changed" list which are not correllated to 
> any of the others (e.g. names or phone numbers are distinct).
>
> Do you need the debug.txt or some of the contacts that get duplicated via 
> private mail?
>
> best regards,
> Rene
>   




More information about the devel mailing list