Coder Social home page Coder Social logo

vitrivr / adampro Goto Github PK

View Code? Open in Web Editor NEW
15.0 5.0 8.0 33.64 MB

ADAMpro is a database system to store and retrieve multimedia data. It provides Boolean retrieval and similarity search and makes use of a various index structures for efficient retrieval.

Home Page: http://www.vitrivr.org

License: MIT License

Scala 78.81% Shell 1.88% Java 0.27% HTML 13.07% CSS 1.42% JavaScript 3.40% Dockerfile 1.15%
database multimedia-retrieval multimedia-database

adampro's People

Contributors

ivangiangreco avatar lukasbeck avatar silvanheller avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

adampro's Issues

Exclude log4j.properties in SBT

Logging is currently broken in the docker-container as a log4j.properties file. The preferred fix is to exclude the log4j.properties file, alternatively you could just switch to .properties from .xml

SLF4J marked as provided dependency

My IntelliJ thinks org.slf4j:slf4j-api:1.7.22 as a provided dependency and therefore doesn't compile. slf4j-api:1.7.10 is a runtime dependency according to the SBT tool (see screenshot)
image

Verbose Logging in selfcontained Docker container

Currently, the latest selfcontained docker container logs unnecessary information like

18/11/16 14:05:34 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 172.17.0.2, 34401, None)
18/11/16 14:05:34 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 172.17.0.2, 34401, None)
18/11/16 14:05:34 INFO BlockManager: Reporting 2 blocks to the master.
18/11/16 14:05:34 INFO BlockManagerInfo: Updated broadcast_22_piece0 in memory on 172.17.0.2:34401 (current size: 4.1 KB, original size: 4.1 KB, free: 366.3 MB)

which makes it hard to see relevant logging

Dropping entities does not work on solr

Solr version: 7.5
ADAMpro branch: master
To reproduce: Create an entity with the solr handler, fill it with some data, and then try dropping it
Expected result: Entity is gone / Data is gone
Actual result: Entity is still there with all the data.

Or is it possible that ADAMpro does not remember the old entity name which causes it to just create a new entity with a new random number at the end?

Error when previewing empty Entities

Description

System setup: current docker container
Full Stacktrace: trace.txt

Steps to reproduce:

  • Create a new entity with a column using parquet
  • Try to preview it using the Web-UI

Comments

I'm not sure of the actual cause, it might be caused by one of the following things / is fixable at all of them:

  • There is no file for an entity when using Parquet
org.vitrivr.adampro.utils.exception.GeneralAdamException: no data available for file at features_averagecolorcldnormalized
	at org.vitrivr.adampro.storage.engine.ParquetLocalStorage.read(ParquetEngine.scala:185)
  • The Webcontroller can't handle empty lists:
[finagle/netty3-1] ERROR monitor - Exception propagated to the root monitor!
java.lang.UnsupportedOperationException: empty.head
	at scala.collection.immutable.Vector.head(Vector.scala:193)
	at org.vitrivr.adampro.web.controller.AdamController$$anonfun$10.apply(AdamController.scala:176)
	at org.vitrivr.adampro.web.controller.AdamController$$anonfun$10.apply(AdamController.scala:166)
  • The Preview-API can't handle None:
ERROR DataQuery: None.get
java.util.NoSuchElementException: None.get
	at scala.None$.get(Option.scala:347)
	at scala.None$.get(Option.scala:345)
	at org.vitrivr.adampro.communication.api.EntityOp$$anonfun$preview$1.apply(EntityOp.scala:182)
	at org.vitrivr.adampro.communication.api.EntityOp$$anonfun$preview$1.apply(EntityOp.scala:178)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.