jetbrains / xodus-entity-browser

Web UI entity browser for xodus database

Xodus entity browser

Web UI entity browser for Xodus database stores. Used in support activities for YouTrack and Hub applications. Highly desirable to use entity browser shipped with the same Xodus version as used in application which works with database.

Features

• searching entities with specific query language (search by property values and by links)
• bulk delete operations for search results
• creating new entity types
• edit entities properties and links (blobs are readonly)
• creating and deleting entities
• ability to work with few databases

Run

• get latest release and unpack it
• execute run.bat or run.sh
• browser should open automatically. Otherwise goto http://localhost:18080

Custom JVM parameters and custom server port can be specified in startup script.

Build from sources

>./gradlew clean build

Run backend

Run method main in Main.kt or execute

>./gradlew runShadow

Run frontend

Command starts frontend on 19090 port

>npm install

>npm start

xodus-entity-browser's Issues

Ability to delete several entities at a time

Would be nice to be able to delete all the entities which are result of a query or just all entities of an entity type. For suitable performance of huge deletions, please delete approx. 1000 entities per transaction.

Support search by a link

Frontend doesn't work if it's hosted on a non-root location of a website

Example

location /entity-browser {
        proxy_pass       http://localhost:18080;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header Host $http_host;
}

Question on using entity browser

Hello! I've created Xodus DB using Xodus-DNQ definitions and I've checked that it works (data is saved successfully and can be obtained later), however, when I try to add same database to Entity Browser, it opens DB but says "Database is empty - you can add ", which is strange, since there IS data in DB.
When DB is opened in write-mode, it prompts me to create new Entity Type. I've tried to enter models names into corresponding field, but then it still shows "Nothing was found".
What am I missing? Thanks in advance!

Use "read-only xodus stack watching file system" for entity browser

see youtrack issue

Query by range is broken

Query by range seems to be completely broken. Though strangely, it seems to be broken in different ways depending on the data type. With entity browser version 1.3 and this database:

• Select the FileNode entity and run the query CreationSeqNum = [0,2]. FileNode[2-3] is included in the results even though it should not be.
• Select the TagMetadata entity and run the query Priority = [0,2]. No results are found even though some should be.

Also, the help provided by the ? button is a little unclear about the behavior of search by range. It says the search looks for values "inside the specified interval" but doesn't say whether the interval is inclusive or exclusive.

Backend launch instructions are misleading

Should we use another task to run backend?

$./gradlew runShadow

Task 'runShadow' not found in root project 'xodus-entity-browser'.

NPE on entity type select

java.lang.IllegalStateException: kotlin.TypeCastException: null cannot be cast to non-null type com.lehvolk.xodus.web.UIPropertyTypes.UIPropertyType<T>
    at com.lehvolk.xodus.web.TransformationsKt.value2string(Transformations.kt:103) ~[classes/:na]
    at com.lehvolk.xodus.web.TransformationsKt.propertyView(Transformations.kt:69) ~[classes/:na]
    at com.lehvolk.xodus.web.TransformationsKt.asLightView(Transformations.kt:20) ~[classes/:na]
    at com.lehvolk.xodus.web.TransformationsKt.linkView(Transformations.kt:34) ~[classes/:na]
    at com.lehvolk.xodus.web.TransformationsKt.asView(Transformations.kt:11) ~[classes/:na]
    at com.lehvolk.xodus.web.PersistentStoreService$searchType$1.invoke(PersistentStoreService.kt:74) ~[classes/:na]
    at com.lehvolk.xodus.web.PersistentStoreService$searchType$1.invoke(PersistentStoreService.kt:10) ~[classes/:na]
    at com.lehvolk.xodus.web.PersistentStoreService$readonly$1.compute(PersistentStoreService.kt:178) ~[classes/:na]
    at jetbrains.exodus.entitystore.PersistentEntityStoreImpl.computeInReadonlyTransaction(PersistentEntityStoreImpl.java:558) ~[xodus-entity-store-1.0-20160512.155606-10.jar:1.0-SNAPSHOT]
    at com.lehvolk.xodus.web.PersistentStoreService.readonly(PersistentStoreService.kt:178) ~[classes/:na]
    at com.lehvolk.xodus.web.PersistentStoreService.searchType(PersistentStoreService.kt:70) ~[classes/:na]
    at com.lehvolk.xodus.web.XodusRestService.searchEntities(XodusRestService.kt:53) ~[classes/:na]
    at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source) ~[na:na]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_73]
    at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_73]
    at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) [jersey-server-2.19.jar:na]
    at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) [jersey-server-2.19.jar:na]
    at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) [jersey-server-2.19.jar:na]
    at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:205) [jersey-server-2.19.jar:na]
    at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) [jersey-server-2.19.jar:na]
    at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) [jersey-server-2.19.jar:na]
    at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) [jersey-server-2.19.jar:na]
    at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) [jersey-server-2.19.jar:na]
    at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:308) [jersey-server-2.19.jar:na]
    at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.19.jar:na]
    at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.19.jar:na]
    at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.19.jar:na]
    at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.19.jar:na]
    at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.19.jar:na]
    at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.19.jar:na]
    at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:291) [jersey-server-2.19.jar:na]
    at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1140) [jersey-server-2.19.jar:na]
    at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:403) [jersey-container-servlet-core-2.19.jar:na]
    at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:386) [jersey-container-servlet-core-2.19.jar:na]
    at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:334) [jersey-container-servlet-core-2.19.jar:na]
    at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:221) [jersey-container-servlet-core-2.19.jar:na]
    at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:808) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.server.Server.handle(Server.java:497) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) [jetty-runner.jar:9.2.10.v20150310]
    at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) [jetty-runner.jar:9.2.10.v20150310]
    at java.lang.Thread.run(Thread.java:745) [na:1.8.0_73]
Caused by: kotlin.TypeCastException: null cannot be cast to non-null type com.lehvolk.xodus.web.UIPropertyTypes.UIPropertyType<T>
    at com.lehvolk.xodus.web.UIPropertyTypes.uiTypeOf(UITypes.kt:134) ~[classes/:na]
    at com.lehvolk.xodus.web.TransformationsKt.value2string(Transformations.kt:100) ~[classes/:na]
    ... 55 common frames omitted

Support encrypted databases

Introduced in Xodus 1.2.0

Add link action is broken

vendor.726975f….js:20 TypeError: t.push is not a function
    at Object.r.addNewLink (main.726975f….js:2)
    at fn (eval at compile (vendor.726975f….js:22), <anonymous>:4:269)
    at t (vendor.726975f….js:21)
    at r (vendor.726975f….js:23)
    at h.$eval (vendor.726975f….js:21)
    at h.$apply (vendor.726975f….js:21)
    at HTMLAnchorElement.<anonymous> (vendor.726975f….js:23)
    at HTMLAnchorElement.dispatch (vendor.726975f….js:49)
    at HTMLAnchorElement.m.handle (vendor.726975f….js:48)

Feature request: add regex and/or substring search option

Background: https://stackoverflow.com/questions/61469467/substring-or-regex-search-in-xodus/61477624?noredirect=1#comment108777519_61469467

Probably adding regex support makes the most sense because it covers substring search too.

Support search by the null value

Add a flag in UI for choosing one of default database keys

It is often hard to remember the key for a database of a particular service. Please add some default variants in UI (on database selection screen), at least for YouTrack and Hub,

Mark broken links in UI

• mark with badge if link is broken.
• add ability to run heavyLinks refactoring to database

Open youtrack database empty

Both my entity-browser and youtrack are hosted in windows platform.

When I tried to use the entity-browser, click [add] database, what should I fill for the path of the database?

The first one is directly pointing to my youtrack home directory. I can click on the link, but it shows "Database is empty - you can add"

The second one is pointing to my youtrack export. I can't even click on the link.

May I know if I have missed anything?

How to create a database from scratch?

I want to create some entity stores. For this purpose I try to setup it by entering some existing path in the "location" field and a property name in the "key" field. When I submit the form I get the error "There is no entity types in Xodus store. Try setup another one".

How can I create a new entity store?

Question: Using entity browser

I have some few questions:

1. What's the purpose of Database State ON/OFF in the browser?
2. Can the Xodus Entity Browser manage production database? I understand that you can't open the same environment that is locked by an application, so how can this entity browser work at all?
3. Does it mean that it manages database that are either copied or synced from a remote server?

Display entity link as a list of entities

Provide ability to see result of entity.getLinks() on

• search page
• entity view and edit pages

Database is not unlocked when it is in the "Off" state

Issue description

Can't connect to database from another application if Entity Browser is launched but database is not enabled in UI:

Steps to reproduce

1. Run Entity Browser.
2. Add your database in writable mode.
3. Close database and put State switcher in Off state.
4. Connect to the same database from another application (e.g. your Kotlin program).

AR

Can't acquire lock from another process.

ER

Another process can connect to database successfully.

Note: terminating Entity Browser releasing lock.

Can't search links by '!=' operand