Comments (20)
Nice @ruebot
I would like to add also some requirements for the possible candidates if possible:
- 100% Sparql 1.1 compliant
- Opensource =)
- Good/active community+developers
- Nice if capable of making distributed/cross queries (my future needs)
- Horizontal Scaling and Clustering
- Multiple storage choices
Quick list from google
- Identify triplestores
- Apache Jena Fuseki (2.0?)
- BigOWLIM
- D2R Server
- Sesame
- Open Link Virtuoso
- 4store
AllegroGraph(not opensource)- BlazeGraph (Thanks @daniel-dgi )
Some existing work on benchmarks
- http://www.bioontology.org/wiki/images/6/6a/Triple_Stores.pdf
- http://www4.wiwiss.fu-berlin.de/bizer/BerlinSPARQLBenchmark/
- http://swat.cse.lehigh.edu/projects/lubm/
from documentation.
Blazegraph GPU on AWS EC2 G2 Family :-)
from documentation.
Stardog is not open source, although in my experience @kendall at @Complexible is approachable and very willing to have discussions about favorable licensing terms. I had that experience in the context of work I did for @ddavis at @Smithsonian, so YMMV.
from documentation.
from documentation.
Wanna throw BlazeGraph into the mix: http://www.blazegraph.com/ . It's what wikipedia is using.
from documentation.
Nice addition @daniel-dgi. BlazeGraph Looks really good. ++ for testing that one first.
from documentation.
Shall we identify benchmarks, and datasets from this RdfStoreBenchmarking list? Maybe we can coordinate with the Fedora community? Get some input there as well?
looks at @awoods
from documentation.
It would be good to identify usage characteristics and expectations of the community in order to ensure that we are looking at the right metrics. As a side note, I believe @no-reply at DPLA is also planning on such an analysis. Maybe we can extend the coordination.
from documentation.
Hi, do we have some stats on how many triples do we will get for every FF object?
from documentation.
No, but that should be easy to determine. My guess is 20.
from documentation.
Ok, that's less than what we got now in Fedora 3. A simple object with RELS-EXT + full DC document gives me about 30.
from documentation.
You will want to check what the F4 triples look like from your specific data, of course. I was just throwing out a guess. 30 may be closer to the truth.
from documentation.
Thanks @awoods! , i just wan't to try to infer what will be the reality for the largest (and ever growing) islandora implementations we have on the community. @ruebot , do you think we could make a quick and dirty poll about this on the google group? Like "how many objects are you handling right now, and how fast are you growing every year"?. I have read in the group of repos with over 250000 objects. That's 7.500.000 triples. To have this as basis to identify usage "characteristics and expectations" as @awoods correctly stated.
from documentation.
Looks like LUBM: http://swat.cse.lehigh.edu/projects/lubm/ is a standard test sets and tools used on benchmarking triple stores. At least Oracle thinks so!
http://download.oracle.com/otndocs/tech/semantic_web/pdf/OracleSpatialGraph_RDFgraph_1_trillion_Benchmark.pdf
from documentation.
fyi ... Open Link Virtuoso (i believe) is also used by the OSF for Drupal project
from documentation.
Nice Donald! OSF for drupal looks like a nice addition, reading quickly through the documentation i see there is a lot of things we could do without having to write custom code, even importing whole ontologies. Also 3.2 version does not require Virtuoso anymore, you can use any Triple store, even better. Thanks a lot, this could make the bridge and bring Linked data to Drupal.
from documentation.
This could be done as Fedora community Performance Scaling & Testing; relevant agenda item from this meeting.
from documentation.
Because sometimes we have a conversation on Twitter a year or so later:
https://twitter.com/ruebot/status/747955866385539072
...and a document now thanks to @cmh2166
https://docs.google.com/document/d/1EoD-JD4OxF9M-pfifQxF_0U7CLGThd8cMzjFH0DwKgU/edit#heading=h.84vdault4l0g
from documentation.
For Ruby users, I've done some initial work on a benchmark suite for ruby-rdf at: https://github.com/ruby-rdf/rdf-benchmark
My hope is that this will become a general purpose benchmark for RDF.rb, using the Berlin Benchmark data generator. It's early days, still, but the work might have more general usefulness.
from documentation.
Add Stardog to the list. h/t @ajs6f
from documentation.
Related Issues (20)
- [BUG] Islandora's ContextManager implementation retains references to previously evaluated contexts HOT 1
- [DOCS] Improve "Install a demo" from Islandora Camp 2023 feedback HOT 7
- Implement viewingDirection in IIIF manifest.
- Separate EntityMapper from Crayfish-Commons
- [DOCS]Add Starter Site to Installing a Development Server HOT 1
- [DOCS] Bad link to documentation on https://www.islandora.ca/docs HOT 3
- Drupal 10 Compatibility HOT 1
- [DOCS] Need to put in deprecation warnings to old ISLE7 docs HOT 1
- [USE CASE] Do we want to expose Media at their own URLs? HOT 3
- [BUG] Mirador from local file doesn't work with Aggregate Javascript HOT 2
- [DOCS] Rename "Linked Agent" to "Contributors" in metadata documentation page
- [BUG] NodeHasParent code throws error if runs on any new content type with Entity Reference field HOT 2
- PHP 8.2 Compatibility HOT 2
- [CODE TASK] Update all modules to `drupal/` namespace in Composer HOT 1
- Feature request: Cache terms returned by IslandoraUtils::getTermForUri()
- Retire isle-dc in favour of Isle Site Template HOT 1
- [BUG] Breadcrumb behaviour with multiple parents is undefined, output is problematic HOT 4
- [DOCS] 404 arising from inconsistent use of underscore vs hyphen in .md filenames HOT 1
- Ansible playbook errors in New year HOT 10
- [DOCS] Establish an ontology for maintaining URIs used in core Islandora vocabularies HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from documentation.