Comments (6)
Our artifact currently doesn't support multiple namespaces, but you can likely still get this working with a few tweaks.
The quickest way is to create separate KernFS configurations for each replica group and assign them to distinct NVM namespaces. You should set g_n_hot_reps = 3
since you're doing 3-way replication. You might need to assign different port numbers to your KernFS instances if they're sharing the same machines. You can set this using the environment variable PORTNO
for both LibFS and KernFS.
I'd be interested in adding proper support for namespaces, so any PR requests are also welcome here.
from assise.
For a single namespace, is there a way to run with 4 or more machines, with 3-way replication of data in the current prototype? For example, say I want to run RocksDB or Filebench with 4 nodes, how can I configure the cluster?
I can give a shot at namespace support soon.
from assise.
You can try setting g_n_hot_reps = 4
and then manually override the replication factor in LibFS by setting the environment variable MLFS_RF
to 3. This will skip the last replica in the chain.
This is a bit hackish though, so no guarantee it'll work out-of-the-box. You can write back here if you run into issues, and I'll help debug.
from assise.
I tried this, and all the kernfs instances segfaulted at:
digest_logs()->digest_inode()->mlfs_mark_inode_dirty()->rb_insert()->inode_cmp()
I can also provide access to this cluster if that helps.
from assise.
Thanks for the update. I'll check on my end first and get back to you.
from assise.
I wasn't able to get this working properly yet, and it will likely require some non-trivial changes. I'd recommend for now that you limit your setup to the number of replicas.
I'll keep this issue open and will take another stab once I have free cycles.
from assise.
Related Issues (20)
- about zookeeper HOT 6
- Not using Assise's libpmem during runtime. HOT 2
- registeration memory failed with errno: Cannot allocate memory HOT 2
- Compile errors HOT 1
- Confused about function compute_log_blocks in libfs/src/log/log.c HOT 2
- How to set up log recovery in Assise? HOT 4
- Access control in Assise HOT 2
- Segmentation fault when leases are enabled HOT 5
- Cleanup of threads managing connections to SharedFS HOT 1
- Updation of number of inode links not persisted HOT 4
- Hitting assertion failure during replication HOT 3
- Setting up Cluster with Multiple Nodes - Segmentation Fault HOT 12
- Memory Region Failure ibv_reg_mr failed [error code: 14] HOT 3
- Benchmark Details HOT 5
- Multi-thread Filebench HOT 1
- Running the warm replicas experiment from the paper
- Segmentation fault on pthread_create when initializing connections
- I see that the global lru list "g_fcache_head" is not protected by locks, which may cause something wrong? HOT 1
- Can we run assise directly on dram? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from assise.