Comments (6)
my two cents: not hard.
On Tue, Sep 22, 2015 at 6:03 PM alldefector [email protected]
wrote:
Learned from @netj https://github.com/netj that MB Search works only
with Postgresql 9.3 (and not PGXL or Greenplum) because it uses the
to_json function.How hard is it to drop the requirement for to_json? Or at least ship a
basic version of it. E.g., the following could be used to patch PGXL:
http://www.pgxn.org/dist/json_enhancements/doc/json_enhancements.html
https://bitbucket.org/IVC-Inc/json_enhancements/overview—
Reply to this email directly or view it on GitHub
#49.
from mindbender.
OK, I managed to install the backport on PGXL, with the help of these posts:
http://sourceforge.net/p/postgres-xc/mailman/message/31914373/
http://sourceforge.net/p/postgres-xl/mailman/message/32623527/
Steps:
sudo apt-get install pgxnclient
pgxn install json_enhancements
(runpg_config
first to make sure it prints PGXL info not vanilla PG)- Edit
$PGXL_DIR/share/postgresql/extension/json_enhancements--1.0.0.sql
to remove the lastCREATE AGGREGATE
statement. - Run
CREATE EXTENSION json_enhancements
in PGXL. - Enjoy!
from mindbender.
@alldefector Awesome! I had to sometimes do a CREATE EXTENSION hstore
before step 4, but to_json
seems working great. I hope PGXL doesn't break on other parts of the SQL generated by MB Search.
from mindbender.
Btw the SQL produced by MB for loading into ES can be seen with:
mindbender hack jqDDlog '"has_spouse_candidates" | relationByName | sqlForRelationNestingAssociated' <(ddlog export-schema app.ddlog)
Just replace the first "has_spouse_candidates"
with the DDlog relation name.
from mindbender.
Is there any progress on solving this for greenplum?
from mindbender.
Not yet...
deepdive sql
has a fallback python script to do the formatting:
https://github.com/HazyResearch/deepdive/blob/13e8788b9bf39e2d3aa83d0883a6391c9c9d6592/database/db-driver/postgresql/db-query#L42
https://github.com/HazyResearch/deepdive/blob/13e8788b9bf39e2d3aa83d0883a6391c9c9d6592/database/pgtsv_to_json
However, I think it may not be reliable with long values (when I tried half a year ago). Any help to improve it is much appreciated :)
from mindbender.
Related Issues (20)
- Cannot run deepdive in examples/spouse_example folder HOT 4
- invalid mindbender COMMAND HOT 1
- Support @searchable for text[]? HOT 1
- How to trace source sentence with multiple keys? HOT 2
- Faceted Search in MBS: Support unified ES doc type so we can have faceted search HOT 1
- Spouse example does not work with latest DeepDive/ddlog HOT 3
- mindtagger search/filter function
- is_correct counts disappear after restarting mindtagger HOT 3
- Single-threaded jq can be a bottleneck for ES indexing HOT 5
- After opening a snapshot, pane is completely empty; fills after multiple refreshes
- Adapt Mindtagger Instance for Genepheno Precision alone HOT 2
- Master branch doesn't build, but there's an easy fix HOT 1
- Source Directory Must Be Lowercase
- How to change ip:port config to run mindbender in a server? HOT 1
- Error loading relation
- recall mode: tsv export fails to separate mention spans
- Precision Mode: Mindtagger does not automatically update Tags Statistics when update new data
- Mindtagger: Defining categorical tags/labels
- Parametric tag remove button doesn't commit
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mindbender.