Comments (7)
Yes if the CDXJ input is limited to just the basic CDX11 fields it works.
from outbackcdx.
Commit 9d73df3 added support for storing arbitrary extra CDXJ fields using a CBOR-based record encoding when can be enabled with --index-version 5
. This is still experimental and a little more work is needed to actually make use of the method
and requestBody
fields when constructing the urlkey for compatibility with pywb.
from outbackcdx.
If it's helpful to have the WARC and CDXJ files please let me know!
from outbackcdx.
OutbackCDX does not (yet) support storing arbitrarily named fields.
from outbackcdx.
Note the "Things it doesn't do (yet): CDXJ" in the README. :-) While it can now map CDX11 fields to CDXJ for input/output it doesn't actually support storing arbitrary CDXJ data.
I don't have any short term plans to implement this myself but would be happy to accept a pull request.
from outbackcdx.
Now I'm confused why another CDXJ file worked.
from outbackcdx.
I think I understand now: current OutbackCDX can store CDXJ data of a known shape? And the method
property is not something it is expecting?
from outbackcdx.
Related Issues (20)
- OWB compat: annotate 'closest' capture for BubbleCalendar
- Access rule editor: clearing 'accessed between' fields doesn't work
- URL:s ending with an asterisk isn't found when searching for the same URL HOT 3
- Upgrade rocksdb
- Pasting a URL in the query field in the dashboard doesn't work
- Document index upgrades HOT 1
- ArrayIndexOutOfBoundsException, NumberFormatException when loading indexed ARC-files HOT 2
- Option to enable fsync on writes
- API to scan all records HOT 3
- Possible infinite loop upon malformed requests HOT 6
- Handling of `+` characters in queries HOT 1
- CDX11+3 support HOT 2
- Replication secondary applies the last batch over and over HOT 3
- resolving a surt-timestamp collision should not replace a non-revisit record with a revisit record HOT 9
- Signed WARC URL generation
- Handle invalid dates HOT 4
- Report exception to client in WbCdxApi HOT 2
- Possible race condition under load HOT 8
- XML protocol: numreturned and numresults
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from outbackcdx.