[Kolab-devel] Call for testing and proposal for kolab-test-toolbox

[Mathieu Parent]

Hello,

I just have commited kolab-test-toolbox.pl to CVS.

This tools aims to easily test kolab:
- bootstrap a VM
- boot it
- install kolab on it
- test

Currently three "platforms" have been created (in kolab-test-toolbox.ini):
- OpenPKG on lenny
- native on lenny
- native on sid (fail to build, see [ftbfs])

Currently, only VirtualBox and Xen are supported.

Ideas/to be done:
- add other distributions (suse, gentoo, ubuntu, mandriva, ...)
- add other native methods (those in dist_conf, mainly gentoo and suse)
- add other VM types (kvm, ...)
- implement Installation from CVS
(http://wiki.kolab.org/index.php/Kolab2_Beta_testing)
- enhance the testsuite

The testsuite, very small as of now, already helped me to report:
https://issues.kolab.org/issue3983
https://issues.kolab.org/issue3949

Comments, improvements, ideas, .. welcome!

NB: kolab-test-toolbox requires:
- Sys::Virt  http://search.cpan.org/dist/Sys-Virt/
- Expect http://search.cpan.org/dist/Expect/
- libvirt
- xen-create-image from xen-tools (will probably drop this requirement
in the future)

Mathieu Parent

[ftbfs]: one cause is described here:
<http://wiki.kolab.org/index.php/Kolab2_Server_Troubleshooting_-_Compiling#Fail_to_build_from_source_with_error:_conflicting_types_for_.27getline.27>.
There is at least another problem caused by the use of newer gcc.
===============
Output of kolab-test-toolbox.pl --test:
---------------
Usage:
    kolab-test-toolbox [options] command [[options] command] ...

Arguments:
    *bootstrap*
            Step 1: Bootstrap the domain

    *preboot_install*
            Step 2: Install from chroot.

    *boot*  Step 3: Power on the domain

    *install*
            Step 4: Install

    *test*  Step 5: Test

    *chroot*
            Extra step: Chroot to the mounted root partition

    *login* Extra step: Log in via ssh

    *list-platforms*
            Extra step: List available platforms

Options:
    --help  Print a brief help message and exits.

    --man   Prints the manual page and exits.

    --platform=*NAME*
            Set platform. See also command *list-platforms*.