Coder Social home page Coder Social logo

christianbaun / ossperf Goto Github PK

View Code? Open in Web Editor NEW
70.0 7.0 12.0 157 KB

A lightweight tool for analyzing the performance and data integrity of object-based storage services

License: GNU General Public License v3.0

Shell 100.00%
cloud storage-service object-storage aws-s3 cloud-storage performance-testing shell

ossperf's Issues

Standard_in errors causes no results

I'm running this tool on a local minio instance and have tried using both -m and just the standard s3cmd utility. Everything appears to work fine, except there are many parse errors coming from standard_in and at the end, no results are displayed:

[OK] Bucket ossperf-testbucket has been erased with mc.
(standard_in) 1: illegal character: N
(standard_in) 1: illegal character: N
[OK] The directory testfiles has been erased.
[1] Required time to create the bucket:                  s
[2] Required time to upload the files:                   s
[3] Required time to fetch a list of files:              s
[4] Required time to download the files:                 s
[5] Required time to erase the objects:                  s
[6] Required time to erase the bucket:                   s
(standard_in) 1: parse error
    Required time to perform all S3-related operations:  s

    Bandwidth during the upload of the files:            Mbps
    Bandwidth during the download of the files:          Mbps

How to use -l option

Hi,
I was trying to use -l location option but getting error if i directly use the command

for eg:
./ossperf.sh -n 10 -s 1048576 -b ossperf-testbucket -a -l
./ossperf.sh: option requires an argument -- l
[ERROR] Invalid option!

and if i give some random input then also it's executing;

eg: ./ossperf.sh -n 10 -s 1048576 -b ossperf-testbucket -a -l 123
[INFO] The tool s3cmd has been found on this system.
s3cmd version 2.0.1
[INFO] The tool bc has been found on this system.
bc 1.07.1
[INFO] The tool md5sum has been found on this system.
md5sum (GNU coreutils) 8.28
[INFO] The tool ping has been found on this system.
ping utility, iputils-s20161105
[INFO] The swift client has been found on this system.
[OK] This computer has a working internet connection.
[OK] The storage service can be accessed via the tool swift.
[OK] The directory testfiles has been created in the local directory.
1048576+0 records in
1048576+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 2.41526 s, 434 kB/s
[OK] File with random content has been created.
^Z
[3]+ Stopped ./ossperf.sh -n 10 -s 1048576 -b ossperf-testbucket -a -l 123

So my question here is whats the right way to use -l option while executing the ossperf command.

Download / erase duration incorrect

Hi,

First, thanks for this amazing tool.

I run ossperf with the following parameters:

./ossperf.sh -n 100 -s 16777216 -b benchmark-test -p -m {mc_alias} -o

I get this result:

[1] Required time to create the bucket:                 2.262 s
[2] Required time to upload the files:                  60.858 s
[3] Required time to fetch a list of files:             0.297 s
[4] Required time to download the files:                0.194 s
[5] Required time to erase the objects:                 0.431 s
[6] Required time to erase the bucket:                  0.692 s
    Required time to perform all S3-related operations: 64.734 s

    Bandwidth during the upload of the files:           220.542 Mbps
    Bandwidth during the download of the files:         69184.395 Mbps

Is 0.194 s the required time to download all the 100 files or just one of them? Same question to erase objects.

any current benchmarks available?

Hey there,

thank you for putting this together :)

I wanted to know if there are any current benchmarks, since the last published one is quite outdated. Otherwise I will see to setup one on my own.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.