Comments (10)
I'd be curious to see the benchmarks on bzip2 taking "a long time" for various archive sizes
from shield-boshrelease.
Hello,
I used the fs plugin to backup up the Cloud Foundry blobstore.
I backuped the /var/vcap/store/shared folder.
The size of the backuped folder is 105 GB.
Shield took 7h to perform the backup.
The final size of the backup is 101,1 GB.
Best regards
from shield-boshrelease.
from shield-boshrelease.
@geofffranks
I am using an internal s3 storage service.
I uploaded the same amount of data using an s3 client. It took about 1 hour.
from shield-boshrelease.
Which S3 client?
from shield-boshrelease.
Also, what is backing your s3 storage API? (assuming it's not on-prem AWS
from shield-boshrelease.
@jhunt , i used s3cmd .
Right i am not using on-prem AWS :) . I am using an internal S3 storage (20 MB/S download speed).
from shield-boshrelease.
Just to double-check, when you uploaded the same amount of data, were you standing on the same VM that was executing the s3 plugin in the slow-scenario?
from shield-boshrelease.
@jhunt , yes
from shield-boshrelease.
Reopening against the SHIELD project proper.
from shield-boshrelease.
Related Issues (20)
- Import job doesn't support multiple concurrent executions HOT 1
- Cloud storage are marked as failing when I migrate from 8.0.17 to 8.1.0 HOT 2
- Please update to the 8.3 release HOT 1
- Slack invite link on README.md is not longer valid HOT 1
- 301 response missing Location header HOT 5
- failsafe password issue - overriding has no effects in 8.5.0 HOT 1
- ERROR: failed to set up schema in database HOT 2
- Shield 8.6.1 deploy issue shield.db: table jobs_new already exists HOT 3
- Import errand fails with exit status 0 HOT 1
- Default Value for `token_name` includes timestamp, causes BOSH deploy churn HOT 4
- Missing tag for SHIELD v8.7.0? HOT 1
- Unable to render templates for job 'shield-agent' HOT 3
- import errand error /var/vcap/jobs/import/bin/run: line 10: syntax error near unexpected token `}' HOT 5
- Nginx `client_max_body_size` is 10M, caused backup file for shield itself larger than that can not be restored HOT 1
- Shield import errand is failing HOT 1
- Shield vulnerability HOT 1
- automated backups not working for 8.7.4 HOT 1
- Release 8.8.6 and 9.1.0 unable to init a new Shield deployment HOT 7
- shield (vault embedded) failure with jammy stemcell HOT 3
- bbr restore fails through Shield UI and CLI whereas it works via bbr cli
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from shield-boshrelease.