This installation will be done using Composer, modern php dependency manager.
1. Install Composer:
curl -sS https://getcomposer.org/installer | php;
2. Move composer to executable place:
mv composer.phar /usr/local/bin/composer;
3. Install PHPUnit and required packages:
composer global require "phpunit/phpunit=3.7.*";
composer global require "phpunit/phpunit-selenium": ">=1.2";
composer global require "phpunit/phpunit-story": ">=1.0";
composer global require "phpunit/dbunit": ">=1.2";
composer global require "phpunit/php-invoker": ">=1.1";
Thats it!