pmandera / duometer Goto Github PK

Currently duometer crashes whenever it cannot extract information from a file. It should rather report error and continue with remaining files.

Currently too much logic is included in the main method of the program. This impedes extensibility. For example, it will make it difficult to reuse code if gui is created.

Hi
Get this error on Win7x64:
Unrecognized option -input (or -i) Error: Could not create Java Virtual machine Error: A fata exception has occured. programm will exit.

Hi,

I installed duometer as informed in readme (https://github.com/pmandera/duometer) and runned the following command:

./duometer -i /home/manu/Joplin/MD -o /home/manu/Joplin/texts-duplicates.txt

I got the following exception:

Exception in thread "main" java.util.NoSuchElementException: next on empty iterator at scala.collection.Iterator$$anon$2.next(Iterator.scala:39) at scala.collection.Iterator$$anon$2.next(Iterator.scala:37) at scala.collection.IterableLike$class.head(IterableLike.scala:107) at scala.collection.AbstractIterable.head(Iterable.scala:54) at com.pawelmandera.duplicates.SharedMemberCandidates$class.candidates(SharedMemberCandidates.scala:17) at com.pawelmandera.main.MinHashMain$$anon$2.candidates(MinHashMain.scala:116) at com.pawelmandera.duplicates.MinHashDetection$class.detect(MinHashDetection.scala:29) at com.pawelmandera.main.MinHashMain$$anon$2.detect(MinHashMain.scala:116) at com.pawelmandera.main.MinHashMain$.main(MinHashMain.scala:121) at com.pawelmandera.main.MinHashMain.main(MinHashMain.scala)

I run duometer on archlinux and java version is:

$ java -version
openjdk version "1.8.0_282"
OpenJDK Runtime Environment (build 1.8.0_282-b08)
OpenJDK 64-Bit Server VM (build 25.282-b08, mixed mode)

I also installed scala which did not change anything.

Implement duplicate detection from other file formats. PDFs and MS Office would be a minimum. It seems that it could be easily achieved with Apache Tika, which extract text from many different file formats.