minowak / qosfs

Filesystem with Quality of Service support

QoSFS

Builds:

• master:
• develop:

Filesystem with Quality of Service support.

Written in C using FUSE.

Project structure

Preparing project

Necessary libraries

• FUSE Development library (libfuse-dev)

Setting up VIM

As project is written in C, Vim was choosen as default development environment. There is a vim configuration file in root directory - .vimrc.

To use this prepared vim configuration one should Add line below to main .vimrc file

set exrc*

Install Vundle

$ git clone https://github.com/VundleVim/Vundle.vim.git ~/.vim/bundle/Vundle.vim

Run vim from root directory and install plugins

$ vim
:PluginInstall

If there is a newer version of YouCompleteMe, update it

$ sudo apt-get install build-essential cmake
$ sudo apt-get install python-dev
$ cd ~/.vim/bundle/YouCompleteMe
$ ./install.sh --clang-completer

External links

• FUSE (http://fuse.sourceforge.net/)
• Vim (http://www.vim.org/)
• Vundle (https://github.com/VundleVim/Vundle.vim)
• YouCompleteMe (https://github.com/Valloric/YouCompleteMe)
• NERDTree (https://github.com/scrooloose/nerdtree)

qosfs's Issues

Scheduler

Write process scheduler

Check first if it is possible to use kernel scheduler

Add test to make

test:
./test.sh

[QoSFS-9] Add debug flag

All debug messages (printf) should be visible only when compiled with DEBUG flag

Test direct/buffered I/O

Test for buffered and direct write and read operations. According to RedHat manual

"Currently, the Block I/O subsystem does not work for buffered write operations. It is primarily targeted at direct I/O, although it works for buffered read operations."

Write makefiles

• Write global make file
• Write FUSE makefile

Should be generic

Mounting as normal user

Check if its possible to mount/use FS as a normal user. cgceate (and some other tools) requires admin privileges
(maybe sending uname through parameters? Or mounting through script)

Write first chapter of documentation

[QoSFS-5] Scheduler

• deadline driven
• run processes only when resources are available or deadline has been met
• carefull of starving write requests

[QoSFS-7] Admission controller

Write admission controller using deadline driven admissions.

It should try to provide QoS as soon as possible and if its not possible, try as best.

[QoSFS-6] Add cgroups support

Add date to logs

Add date while logging messages

Fail to mount if cgroups fails

Write mounting script

• Add QoS arguments while mounting
• Write mounting script using this arguments

[QoSFS-4] Add tests

Test callbacks

[QoSFS-10] Introduce new throttling mechanism

Remove unused callbacks

Think which callback would be useful and remove the rest

Add CI

Rethink is it really necessary

[QoSFS-3] Send rootdir through FUSE private data

It's the last argument in fuse_main

[QoSFS-8] Benchmarks

Write couple of benchmarks (using ftp + find)

Check fio

[QosFS-1] Write logger

[QoSFS-2] Default implementation of callback

Write default implementation of callback so filesystem will work (without QoS at this time).