[Kolab-devel] [issue1194] Kolabd serious performance problem on high number of users: creating one user mean checking all the users mailboxes (take hours)

[Fabio Pietrosanti / Khamsa SA]

New submission from Fabio Pietrosanti / Khamsa SA <kolab at khamsa.ch>:

We noticed that kolabd was not creating mailboxes when a new user are created on the web interface.
Sometimes it worked and sometimes not.

After an indepth analisys of the LDAP.pm and Kolab.pm i noticed that the following things appens when 
a new user creation is notificated to kolabd on port 127.0.0.1:9999 :
- syncBasic is called
   - syncBasic attempt to syncronize the whoole LDAP directory with the Cyrus mailbox DB instead of 
just creating the "one" mailbox what was the reason for the syncBasic() activation.
     It attempt to do GETQUOTA and SETQUOTA within the deleteObject() and createObject() function 
taking hours to complete this task.


On a userbase with about 80k users this means that the kolabd will take several hours to create one 
single user.
This is a very bad issue because this seriously limit the scalability of the platform with very bad 
performance and user management usability impact.

Imho kolabd should do the "ldap -> cyrus" syncronization only on startup and, on user creation, only 
create the mailboxes for the specified users.

If the process work as i noticed the interaction between ldap-kolabd-cyrus should introduce some 
performance tuning.

----------
messages: 6961
nosy: khamsa
priority: critical
status: unread
title: Kolabd serious performance problem on high number of users: creating one user mean checking all the users mailboxes (take hours)
________________________________________________
Kolab issue tracker <kolab-issues at intevation.de>
<https://intevation.de/roundup/kolab/issue1194>
________________________________________________