replikativ / kabel

A library for simple wire-like connectivity semantics.

replikativ

Project homepage

Changelog

Roadmap (suggestions)

0.3.0

• Investigate JS side integration of http://y-js.org/
• Investigate integration with similar systems, eg. IPFS pubsub
• Split middleware from replicated datatype implementations
• Improve network IO library kabel (Android support) [DONE]
• Move hashing into fetch middleware to simplify parallelization. [DONE]
• Experimental automatic Gossip protocol
• Experimental Snapshot Isolation
• Build reasonable small support libraries to partition application data for efficient client side consumption, Datomic and Datascript. Look into datsync etc.
• Add a monitoring interface as a cljs library with basic web views for applications to communicate their synching state to the user in a uniform way. [DONE]
• Introduce clojure.spec to stage/... API.

0.4.0

• Authentication with signed public-private key signatures
• Model some level of consistency between CRDTs, probably Snapshot Isolation, to compose CRDTs. (NMSI, Antidote, research)
• Implement more useful CRDTs (counter, vector-clock, ...) from techreview and other papers and ship by default.

0.5.0

• Use p2p block distribution similar to BitTorrent for immutable values (similar to blocks)
• support WebRTC for value distribution similar to BitTorrent
• Java bindings

Long-term (1.0.0)

• Encryption of transaction with CRDT key encrypted by userkeys, public key schema, explore pub/private key solutions. Maybe metadata signing can work (slowly) on a DHT?
• Distribute bandwidth between CRDTs.
• Negotiate middlewares with versioning.
• Implement diverse prototypes, from real-time to "big-data".

Contributors

• Konrad Kuehne
• Christian Weilbach

Support

If you would like to get some commercial support for replikativ, feel free to contact us at lambdaforge.

License

Copyright © 2013-2018 Christian Weilbach, Konrad Kühne

Distributed under the Eclipse Public License, the same as Clojure.

kabel's Issues

supervisor

WARNING: bounded-count already refers to: #'clojure.core/bounded-count in namespace: clojure.core.async, being replaced by: #'clojure.core.async/bounded-count
Exception in thread "main" java.lang.RuntimeException: No such var: async/poll!, compiling:(superv/async.cljc:757:5)
...
Caused by: java.lang.RuntimeException: No such var: async/poll!
	at clojure.lang.Util.runtimeException(Util.java:221)
	at clojure.lang.Compiler.resolveIn(Compiler.java:7188)
	at clojure.lang.Compiler.resolve(Compiler.java:7158)
	at clojure.lang.Compiler.analyzeSymbol(Compiler.java:7119)
	at clojure.lang.Compiler.analyze(Compiler.java:6680)
	... 309 more

option to set verbosity of logging

how to set logging in the ping-pong example - it is info by default?

build warning

Below are error messages when i run 'lein cljsbuild once':

Compiling "resources/public/js/client.js" from ["src"]...
WARNING: Use of undeclared Var taoensso.timbre/-log! at line 19 src/kabel/middleware/block_detector.cljc
WARNING: Use of undeclared Var taoensso.timbre/*config* at line 19 src/kabel/middleware/block_detector.cljc
WARNING: Use of undeclared Var taoensso.timbre/-log! at line 28 src/kabel/middleware/block_detector.cljc
WARNING: Use of undeclared Var taoensso.timbre/*config* at line 28 src/kabel/middleware/block_detector.cljc

The bug is resolved by my fix which is attached below as a patch. I hope it helps:

--- a/src/kabel/middleware/block_detector.cljc
+++ b/src/kabel/middleware/block_detector.cljc
@@ -7,10 +7,11 @@
                              go-loop pub sub unsub close!]]
                :cljs [cljs.core.async :as async
                      :refer [<! >! timeout chan put! pub sub unsub close!]]))
-  #?(:cljs (:require-macros [cljs.core.async.macros :refer (go go-loop alt!)]
+  #?(:cljs (:require-macros [cljs.core.async.macros :refer [go go-loop alt!]]
                             [kabel.platform-log :refer [debug info warn error]])))


+#?(:cljs (enable-console-print!))

build error

Below are error messages when i run 'lein cljsbuild once':
It seems like that wamp.cljc does not require [cljs.core.async]

guruma@mac kabel (master) $ lein cljsbuild once
Compiling ClojureScript...
Compiling "resources/public/js/client.js" from ["src"]...
WARNING: Use of undeclared Var taoensso.timbre/-log! at line 19 src/kabel/middleware/block_detector.cljc
WARNING: Use of undeclared Var taoensso.timbre/*config* at line 19 src/kabel/middleware/block_detector.cljc
WARNING: Use of undeclared Var taoensso.timbre/-log! at line 28 src/kabel/middleware/block_detector.cljc
WARNING: Use of undeclared Var taoensso.timbre/*config* at line 28 src/kabel/middleware/block_detector.cljc
Compiling "resources/public/js/client.js" failed.
clojure.lang.ExceptionInfo: failed compiling file:src/kabel/middleware/wamp.cljc {:file #object[java.io.File 0x5766a13e "src/kabel/middleware/wamp.cljc"]}
	at clojure.core$ex_info.invokeStatic(core.clj:4725)
	at clojure.core$ex_info.invoke(core.clj:4725)
	at cljs.compiler$compile_file$fn__5880.invoke(compiler.cljc:1443)
	at cljs.compiler$compile_file.invokeStatic(compiler.cljc:1408)
	at cljs.compiler$compile_file.invoke(compiler.cljc:1384)
	at cljs.closure$compile_file.invokeStatic(closure.clj:488)
	at cljs.closure$compile_file.invoke(closure.clj:479)
	at cljs.closure$eval7809$fn__7810.invoke(closure.clj:557)
	at cljs.closure$eval7745$fn__7746$G__7734__7753.invoke(closure.clj:441)
	at cljs.closure$compile_sources$iter__7945__7949$fn__7950.invoke(closure.clj:905)
	at clojure.lang.LazySeq.sval(LazySeq.java:40)
	at clojure.lang.LazySeq.seq(LazySeq.java:49)
	at clojure.lang.Cons.next(Cons.java:39)
	at clojure.lang.RT.next(RT.java:703)
	at clojure.core$next__6391.invokeStatic(core.clj:64)
	at clojure.core$dorun.invokeStatic(core.clj:3115)
	at clojure.core$doall.invokeStatic(core.clj:3121)
	at clojure.core$doall.invoke(core.clj:3121)
	at cljs.closure$compile_sources.invokeStatic(closure.clj:899)
	at cljs.closure$compile_sources.invoke(closure.clj:888)
	at cljs.closure$build.invokeStatic(closure.clj:2284)
	at cljs.closure$build.invoke(closure.clj:2216)
	at cljs.build.api$build.invokeStatic(api.clj:202)
	at cljs.build.api$build.invoke(api.clj:189)
	at cljs.build.api$build.invokeStatic(api.clj:192)
	at cljs.build.api$build.invoke(api.clj:189)
	at cljsbuild.compiler$compile_cljs$fn__8689.invoke(compiler.clj:60)
	at cljsbuild.compiler$compile_cljs.invokeStatic(compiler.clj:59)
	at cljsbuild.compiler$compile_cljs.invoke(compiler.clj:48)
	at cljsbuild.compiler$run_compiler.invokeStatic(compiler.clj:168)
	at cljsbuild.compiler$run_compiler.invoke(compiler.clj:122)
	at user$eval8844$iter__8892__8896$fn__8897$fn__8923.invoke(form-init8771950848216065415.clj:1)
	at user$eval8844$iter__8892__8896$fn__8897.invoke(form-init8771950848216065415.clj:1)
	at clojure.lang.LazySeq.sval(LazySeq.java:40)
	at clojure.lang.LazySeq.seq(LazySeq.java:49)
	at clojure.lang.RT.seq(RT.java:525)
	at clojure.core$seq__6407.invokeStatic(core.clj:137)
	at clojure.core$dorun.invokeStatic(core.clj:3106)
	at clojure.core$doall.invokeStatic(core.clj:3121)
	at clojure.core$doall.invoke(core.clj:3121)
	at user$eval8844.invokeStatic(form-init8771950848216065415.clj:1)
	at user$eval8844.invoke(form-init8771950848216065415.clj:1)
	at clojure.lang.Compiler.eval(Compiler.java:6977)
	at clojure.lang.Compiler.eval(Compiler.java:6967)
	at clojure.lang.Compiler.load(Compiler.java:7429)
	at clojure.lang.Compiler.loadFile(Compiler.java:7367)
	at clojure.main$load_script.invokeStatic(main.clj:277)
	at clojure.main$init_opt.invokeStatic(main.clj:279)
	at clojure.main$init_opt.invoke(main.clj:279)
	at clojure.main$initialize.invokeStatic(main.clj:310)
	at clojure.main$null_opt.invokeStatic(main.clj:344)
	at clojure.main$null_opt.invoke(main.clj:341)
	at clojure.main$main.invokeStatic(main.clj:423)
	at clojure.main$main.doInvoke(main.clj:386)
	at clojure.lang.RestFn.applyTo(RestFn.java:137)
	at clojure.lang.Var.applyTo(Var.java:702)
	at clojure.main.main(main.java:37)
Caused by: clojure.lang.ExceptionInfo: Invalid :refer, var cljs.core.async/go does not exist in file src/kabel/middleware/wamp.cljc {:tag :cljs/analysis-error}
	at clojure.core$ex_info.invokeStatic(core.clj:4725)
	at clojure.core$ex_info.invoke(core.clj:4725)
	at cljs.analyzer$error.invokeStatic(analyzer.cljc:645)
	at cljs.analyzer$error.invoke(analyzer.cljc:641)
	at cljs.analyzer$error.invokeStatic(analyzer.cljc:643)
	at cljs.analyzer$error.invoke(analyzer.cljc:641)
	at cljs.analyzer$check_uses.invokeStatic(analyzer.cljc:1955)
	at cljs.analyzer$check_uses.invoke(analyzer.cljc:1950)
	at cljs.analyzer$check_use_macros.invokeStatic(analyzer.cljc:1968)
	at cljs.analyzer$check_use_macros.invoke(analyzer.cljc:1958)
	at cljs.analyzer$check_use_macros_inferring_missing$fn__4106.invoke(analyzer.cljc:1980)
	at clojure.lang.AFn.applyToHelper(AFn.java:154)
	at clojure.lang.AFn.applyTo(AFn.java:144)
	at clojure.core$apply.invokeStatic(core.clj:659)
	at clojure.core$update_in$up__7845.invoke(core.clj:6067)
	at clojure.core$update_in.invokeStatic(core.clj:6068)
	at clojure.core$update_in.doInvoke(core.clj:6054)
	at clojure.lang.RestFn.invoke(RestFn.java:445)
	at cljs.analyzer$check_use_macros_inferring_missing.invokeStatic(analyzer.cljc:1978)
	at cljs.analyzer$check_use_macros_inferring_missing.invoke(analyzer.cljc:1971)
	at cljs.analyzer$ns_side_effects.invokeStatic(analyzer.cljc:3163)
	at cljs.analyzer$ns_side_effects.invoke(analyzer.cljc:3131)
	at cljs.analyzer$analyze_STAR_$fn__4674.invoke(analyzer.cljc:3228)
	at clojure.lang.PersistentVector.reduce(PersistentVector.java:341)
	at clojure.core$reduce.invokeStatic(core.clj:6703)
	at clojure.core$reduce.invoke(core.clj:6686)
	at cljs.analyzer$analyze_STAR_.invokeStatic(analyzer.cljc:3228)
	at cljs.analyzer$analyze_STAR_.invoke(analyzer.cljc:3218)
	at cljs.analyzer$analyze.invokeStatic(analyzer.cljc:3246)
	at cljs.analyzer$analyze.invoke(analyzer.cljc:3230)
	at cljs.compiler$emit_source.invokeStatic(compiler.cljc:1279)
	at cljs.compiler$emit_source.invoke(compiler.cljc:1259)
	at cljs.compiler$compile_file_STAR_$fn__5857.invoke(compiler.cljc:1353)
	at cljs.compiler$with_core_cljs.invokeStatic(compiler.cljc:1178)
	at cljs.compiler$with_core_cljs.invoke(compiler.cljc:1167)
	at cljs.compiler$compile_file_STAR_.invokeStatic(compiler.cljc:1342)
	at cljs.compiler$compile_file_STAR_.invoke(compiler.cljc:1335)
	at cljs.compiler$compile_file$fn__5880.invoke(compiler.cljc:1431)
	... 54 more
Subprocess failed

build warning

Below are error messages when i run 'lein cljdbuild once':

Compiling "resources/public/js/client.js" from ["src"]...
WARNING: No such namespace: JSON, could not locate JSON.cljs, JSON.cljc, or Closure namespace "" at line 21 src/kabel/middleware/json.cljc
WARNING: Use of undeclared Var JSON/parse at line 21 src/kabel/middleware/json.cljc
WARNING: No such namespace: JSON, could not locate JSON.cljs, JSON.cljc, or Closure namespace "" at line 38 src/kabel/middleware/json.cljc
WARNING: Use of undeclared Var JSON/stringify at line 38 src/kabel/middleware/json.cljc

The bug is resolved by my fix which is attached below as a patch. I hope it helps:

--- a/src/kabel/middleware/json.cljc
+++ b/src/kabel/middleware/json.cljc
@@ -17,8 +17,8 @@
    (handler #(go-try S
                      (let [{:keys [kabel/serialization kabel/payload]} %]
                        (if (= serialization :string)
-                         (let [v #?(:clj (json/parse-string payload)
-                                    :cljs (js->clj (JSON/parse payload)))
+                         (let [v #?(:clj (json/parse-string payload)
+                                    :cljs (js->clj (.parse js/JSON payload)))
                                merged (if (map? v)
                                         (merge v (dissoc % :kabel/serialization
                                                          :kabel/payload))
@@ -35,7 +35,7 @@
                                  :value %})
                          {:kabel/serialization :string
                           :kabel/payload #?(:clj (json/generate-string %)
-                                            :cljs (JSON/stringify %))})))
+                                            :cljs (.stringify js/JSON %))})))
             [S peer [in out]])))