leo-project / leofs Goto Github PK

• Able to retrieve a part of an (large) object from the storage-cluster
  • Make available log-data analysis, etc
• Reference:
  • GET Object

• Synchronized object(s) by "unit of a file" and "unit of storage-node"
  • Able to recover manually

• Deletion chunked objects are set as the object of a compaction.

Could you detail a bit how you got the bash_bench driver working?

• ibrowse is up and running
• basho_bench http raw driver works

but the leofs driver gives me:

10:21:59.096 [debug] Supervisor folsom_sup started folsom_sample_slide_sup:start_link() at pid <0.70.0>
10:21:59.097 [debug] Supervisor folsom_sup started folsom_meter_timer_server:start_link() at pid <0.71.0>
10:21:59.098 [debug] Supervisor folsom_sup started folsom_metrics_histogram_ets:start_link() at pid <0.72.0>
10:21:59.098 [info] Application folsom started on node nonode@nohost
10:21:59.111 [debug] Supervisor basho_bench_sup started basho_bench_stats:start_link() at pid <0.65.0>
10:21:59.114 [debug] ID 1 generating range 0 to 20833
10:21:59.209 [error] Failed to initialize driver basho_bench_driver_leofs: {'EXIT',{undef,[{basho_bench_driver_leofs,new,[1],[]},{basho_bench_worker,worker_idle_loop,1,[{file,"src/basho_bench_worker.erl"},{line,201}]}]}}

• Target libs
  • leo_object_storage
  • leo_backend_db

• Related issues:
  • #19
  • #20

While doing compaction, Since a src file will be read by ONLY sequential read AND a dst file will be written by ONLY sequential write, So we expect to improve compaction performance by using posix_fadvise.

• links
  • http://erlang.org/doc/man/file.html#advise-4

• Able to recognize and expect when consumption of queue's message completed for administrators
  • This function can use from manager-console
    • command: status $node

• The correct processing of commands which does not need parameter(s)

ONLY OS processes of LeoFS Storage should be able to handle raw files.

NOTE
As you may know, there are some limitations on the linux Implementations(see second link's chapter 0). But in our usecases, we have no effect with those limitations

• links
  • http://www.thegeekstuff.com/2012/04/linux-file-locking-types/
  • http://kernel.org/doc/Documentation/filesystems/mandatory-locking.txt

• Results:

    New settings:
      Access Key: 05236
      Secret Key: 802562235
      Encryption password: 
      Path to GPG program: /usr/bin/gpg
      Use HTTPS protocol: False
      HTTP Proxy server name: 
      HTTP Proxy server port: 0

    Test access with supplied credentials? [Y/n] Y
    Please wait, attempting to list all buckets...
    ERROR: Test failed: no element found: line 1, column 0

• Output value with 'MB'

The characteristic of compaction causes polluting OS page caches.
The solution is already here(see below link)

• links
  • https://issues.apache.org/jira/browse/CASSANDRA-1470
  • http://www.erlang.org/doc/man/file.html#advise-4 (use dont_need flag)

A bit unsure on how to explain these things so I'll put the few issues we discussed here:

• The bucket must be created before tests are ran, using the special test user (command and key should be given from the documentation directly)
• The bucket name cannot contain _ (underscore), so the "test_bucket" provided as example plain doesn't work, and it's not obvious from this page alone that it isn't
• The benchmark file given as an example at the end doesn't work without extra configuration, you have to edit the file to set the right port and bucket name first

I am writing an installer for my dev env using information found on the quickstart guide.

#!/bin/bash
#http://www.leofs.org/docs/getting_started.html
#http://www.erlang.org/download_release/16
#https://github.com/leo-project/leofs

sudo apt-get install libncurses5-dev
http://www.erlang.org/download/otp_src_R14B04.tar.gz
tar xzf otp_src_R14B04.tar.gz
cd otp_src_R14B04
./configure --prefix=/usr/local/erlang/R14B04 --enable-smp-support --enable-m64-build --enable-halfword-emulator --enable-kernel-poll --without-javac --disable-native-libs --disable-hipe --disable-sctp --enable-threads
make
sudo make install

git clone https://github.com/leo-project/leofs.git
cd leofs
make
make release

the second last line of code produces this output

==> leo_commons (get-deps)
==> proper (get-deps)
==> jiffy (get-deps)
==> leo_logger (get-deps)
WARNING: deprecated port_envs option used
Option 'port_envs' has been deprecated
in favor of 'port_env'.
'port_envs' will be removed soon.

==> meck (get-deps)
WARNING: deprecated port_envs option used
Option 'port_envs' has been deprecated
in favor of 'port_env'.
'port_envs' will be removed soon.

==> bitcask (get-deps)
WARNING: deprecated port_envs option used
Option 'port_envs' has been deprecated
in favor of 'port_env'.
'port_envs' will be removed soon.

==> eleveldb (get-deps)
==> leo_backend_db (get-deps)
==> leo_object_storage (get-deps)
==> leo_mq (get-deps)
==> leo_redundant_manager (get-deps)
==> bear (get-deps)
==> folsom (get-deps)
==> leo_statistics (get-deps)
==> leo_s3_libs (get-deps)
==> leo_manager (get-deps)
==> lz4 (get-deps)
==> leo_ordning_reda (get-deps)
==> leo_storage (get-deps)
WARNING: deprecated port_envs option used
Option 'port_envs' has been deprecated
in favor of 'port_env'.
'port_envs' will be removed soon.

==> cherly (get-deps)
==> ecache (get-deps)
==> cowboy (get-deps)
==> leo_gateway (get-deps)
==> rel (get-deps)
==> leofs (get-deps)
==> leo_commons (compile)
ERROR: OTP release R15B01 does not match required regex R14B04|R15B02|R15B03
ERROR: compile failed while processing /home/paul/leofs/deps/leo_commons: rebar_abort
make: *** [compile] Error 1

• This function implement for leo-tamer (Web GUI console)

• When regularly stop the storage-process, It writes current status in a file. Then it restarts the storage-process when reading the file.

• Object of Configs
  • Application.config (app.config)
  • VM.config

Can't get a simple developer model deployment to run. Everything comes up, but spits out a 403 Forbidden when I access using s3cmd or DragonFS. Any logs I can look at to figure why it's failing ? I'm new to Erlang, but have loads of dev experience otherwise.

• Need to modify by changed object-cache configuration (gateway) from v0.14
• Easily understand that for administrators and developpers

• Elements:
  • vm_version
  • process_limit
  • kernel_poll
  • thread_pool_size

• It has occurred to degradation of temporary performance.

• Currently, s3-endpoint set up on manger before launch gateway

• We reduce cost of "list_to_binary/1" for improve performances.

• Exists plural the same filename objects when using "get-objects"

• Able to gradually compact data
  • Assignable data-compaction target raw-file(s)
• Able to suspend/resume compaction
  • Need to implement commands of compact status, compact suspend, compact resume and compact start in LeoFS-Manager

• For the secure application

• Reference is "Amazon S3: Multipart Upload".

• Target module is 'leo_object_haystack'
  • reference: http://www.erlang.org/news/35

• ASIS: per AVS(a raw file on OS filesystem)
• TOBE: per some time unit ( ex. 5sec/1min ... )
• TODO
  • To prevent gen_server from blocking, must do compaction on another process.
  • To realize time unit controlable, a compaction process must invoke receive regulaly.
• Files to be modified
  • leo_object_storage_server
  • leo_compaction_manager_fsm
  • leo_object_storage_api

• We are difficult to recognize the LeoFS's processes on Erlang's console.

Currently we'd recommend LeoFS users using xfs where to store raw data files,
but F2FS might become more suitable one when using SSD.
let's check it out!

• links
  • http://git.kernel.org/?p=linux/kernel/git/torvalds/linux.git;a=blob;f=Documentation/filesystems/f2fs.txt;h=dcf338e62b71108a3a02e0198edf0eb564930121;hb=refs/heads/master