[TOC]

It's a fuse plugin, and it can virtual merges files, and virtual replaces bytes.

when system read this file, it output the merged/replaced content of many really files that you set.

But it's not a really merged file, it only output the merged content when you use fread pread, even md5... in linux.

So, you can save so many disk space.

the code is based by https://github.com/schlaile/concatfs, Thanks!

Example

create /the/src/dir/1.txt

12345678

create /the/src/dir/2.txt

abcdefghi

create a file named /the/mounted/dir/1-merged-.txt,

-merged- is a special words in the file name, and the content is

JSON format

[
    {
        "path": "1.txt"
    },
    {
        "path": "2.txt"
    }
]

cat /the/mounted/dir/1-merged-.txt, output:

12345678abcdefghi

So it virtual merges two files, with a json, and output the merged content when reading.

Of course, this plugin builds for BIG SIZE files. eg: mkv, mp4,

Or so many BIG SIZE copies with a few difference. eg: program copies(with different biz channel ID)

• Runs in userspace (FUSE);
• Files with the string -merged- anywhere in the filename are considered concatenation description special files;
• JSON format;
• Save disk space;
• Virtual merge files;
• Virtual replace file's content.
• Auto mount in fstab at Boot

It needs GCC 4.9, Install GCC 4.9 in CentOS 6/7

modern C++ 11

yum install fuse fuse-devel

cd merged-fuse
make
make install

Uninstall

make uninstall

It's a FUSE plugin, so it uses two directories:

• source dir
• be mounted dir

mkdir /the/src/dir
mkdir /the/mounted/dir

You can Write your -merged- file at source dir

And Read your -merged- file at mounted dir after merged-fuse or fstab

merged-fuse /the/src/dir/ /the/mount/dir/

see http://man7.org/linux/man-pages/man8/mount.fuse.8.html https://www.cs.hmc.edu/~geoff/classes/hmc.cs135.201109/homework/fuse/fuse_doc.html#other-options

merged-fuse /the/src/dir/ /the/mount/dir/ -d

create your config to /etc/fuse.conf

see http://manpages.ubuntu.com/manpages/precise/man8/mount.fuse.8.html

user_allow_other

run with user 'apache' and allow other user read/write

sudo -u apache merged-fuse /the/src/dir/ /the/mount/dir/ -o allow_other

umount /the/mounted/dir/

To have the pool mounted at boot or otherwise accessable from related tools use /etc/fstab.

# <file system>    <mount point>     <type>            <options>             <dump>  <pass>
 /the/src/dir      /the/mounted/dir  fuse.merged-fuse  defaults,allow_other  0       0

Write at src dir

/the/src/dir/game.of.thrones-merge-.mp4

[
    {
        "path": "1.mp4"
    },
    {
        "path": "2.mp4"
    },
    {
        "path": "3.mp4"
    }
]

Read at mounted dir

/the/mounted/dir/game.of.thrones-merge-.mp4

Write at src dir

/the/src/dir/1-merge-.zip

• offset [long long]: may ±, current file's offset,

  If offset is negative, it will seeking from the end of file

  If offset is out of file, return error.

• length [short]: max value is 1024

  If length is greater than the offset to the end of file, it's fine, the replaced content will be truncate, and it'll not overflow.

• content [string]: BASE64, the repleaced content(supported Binary)

  If BASE64 DECODED Content's size is less than length, return error.

[
    {
        "path": "1.zip",
        "replaces": [
            {
                "offset": 10,
                "length": 4,
                "content": "NDMyMQ=="
            },
            {
                "offset": -2,
                "length": 2,
                "content": "MjE="
            }
        ]
    },
    {
        "path": "2.text"
    }
]

Read at mounted dir

/the/mounted/dir/1-merge-.zip

change /dev/fuse's group to fuse

chgrp fuse /dev/fuse

add your user to fuse's group, e.g. nobody, apache

usermod -a -G fuse root
usermod -a -G fuse nobody
usermod -a -G fuse apache

change your dir's user/group to who merged-fuse running, eg: apache

chown apache:apache /your/mounted/dir/

$ yum install centos-release-scl-rh
$ yum install devtoolset-3-binutils devtoolset-3-gcc devtoolset-3-gcc-c++


# Backup your old gcc
$ mv /usr/bin/gcc /usr/bin/gcc-v4.4.7
$ mv /usr/bin/g++ /usr/bin/g++-v4.4.7
$ mv /usr/bin/cc /usr/bin/cc-v4.4.7

$ ln -s /opt/rh/devtoolset-3/root/usr/bin/gcc /usr/bin/gcc
$ ln -s /opt/rh/devtoolset-3/root/usr/bin/gcc /usr/bin/cc
$ ln -s /opt/rh/devtoolset-3/root/usr/bin/g++ /usr/bin/g++

If you cannot install centos-release-scl-rh, install this repo first.

cat > /etc/yum.repos.d/CentOS-Sclo-RH.repo << EOF
[centos-sclo-rh]
name=CentOS-$releasever - SCLo rh
baseurl=http://mirror.centos.org/centos/$releasever/sclo/$basearch/rh/
gpgcheck=0
enabled=1
#gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-SCLo
EOF