Minion, which achieves an approach to maximize utilization of broadband traffic like BT, implemented by python and based on HTTP protocol
Minion can be easily used to dispatch data, similar to curl/wget. It also provides python API libs.
minion cli need python 2.7, requests
minion tracker need python 2.7, django mysql
git clone git://github.com/alibaba/minion cd minion pip install -r requirements.txt python setup.py install
deploy your tracker server
tracker need django mysql
python tracker/manage.py syncdb python tracker/manage.py runserver # or use wsgi/nginx
try your minion cli
minion get http://foo.bar/testfile \ --tracker some.tracker.server \ --dest-path=/tmp/tops1 \ --upload-rate 10M \ --download-rate 100M \ --callback delete \ --upload-time 5 \ --fallback
Minion work as picture below
PEER: The host ready to download SOURCE TRACKER: The host manage PEERs and SOURCEs SOURCE: URL of some data
Minion as a whole is released under the GNU General Public License version 2.