MooseFS is a Petabyte Open Source Network Distributed File System. It is easy to deploy and maintain, highly reliable, fault tolerant, highly performing, easily scalable and POSIX compliant.
MooseFS spreads data over a number of commodity servers, which are visible to the user as one resource. For standard file operations MooseFS acts like ordinary Unix-like file system:
Distinctive MooseFS features:
MooseFS can be installed on any POSIX compliant operating system including various Linux distributions, FreeBSD and macOS:
There is a separate MooseFS Client for Microsoft Windows available, built on top of Dokany.
You can install MooseFS using your favourite package manager on one of the following platforms using officially supported repositories:
Packages for Ubuntu 14 and CentOS 6 are also available, but no longer supported.
Minimal set of packages, which are needed to run MooseFS:
moosefs-masterMooseFS Master Server for metadata servers,
moosefs-chunkserverMooseFS Chunkserver for data storage servers,
moosefs-clientMooseFS Client – client side package to mount the filesystem.
Feel free to download the source code from our GitHub code repository!
Install the following dependencies before building MooseFS from sources:
sudo apt install build-essential libpcap-dev zlib1g-dev libfuse3-dev pkg-config(if you don't have FUSE v. 3 in your system, use
sudo apt install build-essential libpcap-dev zlib1g-dev libfuse-dev pkg-config)
sudo yum install gcc make libpcap-devel zlib-devel fuse3-devel pkgconfig(if you don't have FUSE v. 3 in your system, use
sudo yum install gcc make libpcap-devel zlib-devel fuse-devel pkgconfig)
sudo apt install fuse3(if you don't have FUSE v. 3 in your system, use
sudo apt install fuse)
sudo yum install fuse3(if you don't have FUSE v. 3 in your system, use
sudo yum install fuse)
Building MooseFS on Linux can be easily done by running
./linux_build.sh. Similarly, use
./freebsd_build.sh in order to build MooseFS on FreeBSD and respectively
./macosx_build.sh on macOS. Remember that these scripts do not install binaries (i.e. do not run
make install) at the end. Run this command manually.
Just three steps to have MooseFS up and running:
cd /etc/mfs cp mfsmaster.cfg.sample mfsmaster.cfg cp mfsexports.cfg.sample mfsexports.cfg
cd /var/lib/mfs cp metadata.mfs.empty metadata.mfs chown mfs:mfs metadata.mfs rm metadata.mfs.empty
mfsmastername, e.g. by adding a DNS entry (recommended) or by adding it in
/etc/hostson all servers that run any of MooseFS components.
cd /etc/mfs cp mfschunkserver.cfg.sample mfschunkserver.cfg cp mfshdd.cfg.sample mfshdd.cfg
mfshdd.cfgfile make one or more entries containing paths to HDDs / partitions designated for storing chunks, e.g.:
/mnt/chunks1 /mnt/chunks2 /mnt/chunks3
It is recommended to use XFS as an underlying filesystem for disks designated to store chunks. More than two Chunkservers are strongly recommended.
mfs:mfsto above mentioned locations:
chown mfs:mfs /mnt/chunks1 /mnt/chunks2 /mnt/chunks3 chmod 770 /mnt/chunks1 /mnt/chunks2 /mnt/chunks3
Repeat steps above for second (third, ...) Chunkserver.
mkdir /mnt/mfs mount -t moosefs mfsmaster: /mnt/mfs
mfsmount -H mfsmaster /mnt/mfs if the above method is not supported by your system
/etc/fstabentry to mount MooseFS during the system boot:
mfsmaster: /mnt/mfs moosefs defaults,mfsdelayedinit 0 0
There are more configuration parameters available but most of them may stay with defaults. We do our best to keep MooseFS easy to deploy and maintain.
MooseFS, for testing purposes, can even be installed on a single machine!
moosefs-cgiserv is also recommended – it gives you a possibility to monitor the cluster online:
moosefs-cli moosefs-cgi moosefs-cgiservpackages (they are typically set up on the Master Server)
It is also strongly recommended to set up at least one Metalogger on a different machine than Master Server (e.g. on one of Chunkservers). Metalogger constantly synchronizes and backups the metadata:
cd /etc/mfs cp mfsmetalogger.cfg.sample mfsmetalogger.cfg
Refer to installation guides for more details.
Copyright (c) 2008-2021 Jakub Kruszona-Zawadzki, Core Technology Sp. z o.o.
This file is part of MooseFS.
MooseFS is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, version 2 (only).
MooseFS is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with MooseFS; if not, write to the Free Software Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA 02111-1301, USA or visit http://www.gnu.org/licenses/gpl-2.0.html.