yarl / vicuna

Tool for uploading files to Wikimedia Commons and other Wikimedia projects

VicuñaUploader

ultimate tool for upload files to Wikimedia Commons and other Wikimedia projects

Usage

For manual, take a look at project wiki and website.

Build and Run

Program is being written using any IDE (NetBeans preferred) you want and Gradle is used for building. Minimal version is Java 11. In order to download and build source code, do following:

git clone https://github.com/yarl/vicuna.git
cd vicuna
./gradlew build

You will find distribution tar and zip build/distributions directory.

cd build/distributions/
unzip cuploader.zip
./cuploader/bin/cuploader

If you want to just run local build:

./gradlew run

Create org-wikipedia-Wiki.jar file (be careful, we need class file in Java 11 version):

git clone https://github.com/MER-C/wiki-java.git
cd wiki-java
mkdir -p org-wikipedia-Wiki/org/wikipedia
cp src/org/wikipedia/Wiki.java org-wikipedia-Wiki/org/wikipedia/
javac org-wikipedia-Wiki/org/wikipedia/Wiki.java
jar cfv org-wikipedia-Wiki-`git rev-parse --verify HEAD --short=6`.jar -C org-wikipedia-Wiki/ .

Contribute

Feel free to fork and suggest changes. However, please do not send pull requests with radical changes without prior discussion. Also, changes should work on NetBeans (especially project building and Form Designer).

License

Copyright 2015 Paweł Marynowski

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

Contributors

Florian Straub
Michal Josef Špaček
Nicolas Raoul

External libs used

• wiki-java (AGPLv3+ / GPLv3+)
• metadata-extractor (Apache 2.0)
• jxmapviewer2 (LGPL)
• IU icons by Yusuke Kamiyamane (CC BY-3.0)

vicuna's Issues

Option for disable Description tag.

Is it possible to add option for disabling =={{int:filedesc}}== and {{Information}} tag? I'm ofter uploading with Artwork tag and this is a problem. I had to delete it manualy.

See here: http://commons.wikimedia.org/w/index.php?title=File:Backgammon_board_in_Moravian_Gallery_(02).jpg&diff=92481009&oldid=92479259

Select all, and suggestions

"Select all" doesn't do what it is supposed to do. Also, all of the files should be selected by default.

Some requests:

1. Remember the last-used folder for uploads
2. Remember login password

Some dialog boxes should block access to the main program

When Uploading, Logging in (and I guess some other actions) bring smaller dialog boxes infront of the main program, but should block access to the program!

Add support of PDF files

Per request by Jarekt.

Tick copy file name

I got a new build of 1.14 you repaired. It seems to me those blue ticks use to copy the description and categories, newly copyies also file name.

V 1.16 wrong file name check

I got wrong file name check:
*Zásmuky, věž zámku.jpg - file must have a unique name
*Zásmuky, mariánský sloup, svatý (001).jpg - same

these files doesnt exist on Commons.

Bug: specialcharacter defect !

i define the default categorie "Lübeck" - with the special-character "ü".

then i save to xml-file and open by notepadd++ to search and replace. notepadd++ show UTF8 without BOM.

after edit some words, save and reopen in vicuna - now when look into options the special-character will demage !!! �

regards Jan

"Logging in" doesn't work

Nondistinct user agent

Our API etiquette requires, at a very minimum, either a contact address of a URL to the software's project page.

xml-File did not save geocoord

hi !

it would be nice if the geocoord will save in inte session-xml-File!

reagards Jan

1.15 doesnt show subcats

v. 1.15 doesnt show subcat when hower. E.g. commons:Category:Unidentified automobiles by country add in to Categories field. When I hower it it offers the same category and as a subchoice to open in browser, but if you have a look to that cut, there are subcats.

three new wishes - address / session save / georef with viewpoint and orientation

hi !

very nice too, but i have three wishes:

1.) search place (villages) easier by input adress - look http://wiki.openstreetmap.org/wiki/Nominatim

2.) when save named session and you click save again every time the session-file is to define - better: save as / save....

3.) in the map (so i know) only a place can define - i would like to define interactiv the camera-place and the orientation of the photo...

regards Jan

Upload summary

It'd be nice if an upload summary could be added, rather than just "VicuñaUploader X.XX"

CTRL+DEL doesnt work in 1.15

CTRL+DEL doesnt work in 1.15 after edditing. I didnt figure what to do if I work on files and than Id like to crear session using a shortcut.

Allow uploading WebM, FLAC and WAVE files

Since early August 2013, Wikimedia Commons has allowed uploading files with the following new extensions: .webm, .flac, .wav. Please enable uploading them in VicunaUploader, thank you!

Duplicate prevention

I believe that commons uploading tools should detect duplicates of existing files and at least warn before accepting to upload such files.

Maybe useful:
Exact duplicates are already automatically detected on Commons and get listed here:
https://commons.wikimedia.org/wiki/Special:ListDuplicatedFiles
I don't know if there's already the possibility to query Commons with a file hash..?

Such features are also mentioned here:
https://de.wikipedia.org/wiki/Wikipedia:Umfragen/Technische_W%C3%BCnsche_2015/Dateien_und_Commons#Upload
(list of requests for tech features from a poll)

Upload doesnt work

I have tried two times, but the upload doesnt worked. Having 4 ogv files and about 137 MB.

Ant build does not result in the same jar as distributed

1. Download latest vicuna source code
2. Run ant jar
3. Run java -jar dist/vicuna.jar
4. Result: Crash Exception in thread "main" java.lang.NoClassDefFoundError: com/thoughtworks/xstream/io/HierarchicalStreamDriver

Running java -jar /tmp/vicuna.jar (downloaded from http://yarl.github.io/vicuna/) works.

The vicuna.jar built from source code contains much less classes than the distributed one.

Running java -cp lib/xstream-1.4.3.jar:lib/jmapviewer.jar:lib/metadata-extractor-2.6.0.jar:lib/xmpcore.jar -jar dist/vicuna.jar does not work either.

In any case, a start script would be welcome in the source version too.

Angle in GPS

GPS coordinations are given into Location template, which includes angle field, which is necessary to correct identification of the place in the picture. It would be nice to add this option to Vicuňa.

Add option to use external script to generate wikitext

This is useful for mass uploading data which already has external metadata (e.g. cultural heritage institutions) or there are custom template requirements.

Configuration:
Extra option for Settings -> Program -> External program
String for command should include variables for the file name and full path
e.g.
my_wikitext_generator.sh %FILENAME% %FILEPATH%

Language not selected on first load

First load is in English, but if you look at Tools -> Language, nothing is selected.

Selecting English and restarting does remember the option

error with Category

not recorded general categories from settings and category for a specific file

Connecting to wiki outside of wikimedia foundation projects

Hi,
I am speaking on behalf of wikiskripta.eu, which is a wiki for medical specialists. We would like to use vicuna uploader for bulk uploading images to our wiki. Would it be possible? What can we do for it to happen?

Thank you very much,

CC-BY-SA-4.0 licence

Is it possible to add CC-BY-SA-4.0 licence to the default list? Or let users to specify author when using CC-BY-SA-4.0 (this option is not editable and usable when "other" licence is selected)?

Use of locale specific decimal separator when creating {Location dec}

I'm using built from source repository version of Vicuna. When I upload photos with geolocation - Vicuna uses locale specific decimal separator instead of dot (regardless of locale).

Error when creating gallery

There is an unknown error, when creating gallery. Dont know what more to say about this bug, but more people encountered that.

Settings imported from the session vs. default settings

Loading a session overrides all program defaults. This can be what is expected, but can
also be confusing:

1. Disable server connection monitoring (database lag)
2. Open old session file
3. Connection monitoring will be enabled again if this was set in the session file

multi-author

Hi, Vicuña seems great. I'll use it to upload heritage photos, after negotiating the liberation with its authors.
One thing that would be useful is to put more than one author.
Maybe it is there but I can't find an option to do that in Vicuña.
It is possible to put a field for "author" in the picture form?
Thanks!

Option to disable getCurrentDatabaseLag check?

Thanks for this great software!

I use it over a costly mobile connection. It usually takes me days to categorize all of my pictures (a bit every evening).
I noticed that Vicuna sends requests all day long, even before I log in.
It makes me worry for my mobile connection, and for the Wikimedia resources.

INFO: [commons.wikimedia.org] Current database replication lag is 0 seconds
Apr 30, 2015 5:25:59 PM Wiki getCurrentDatabaseLag
INFO: Fetching URL https://commons.wikimedia.org/w/api.php?maxlag=5&format=xml&action=query&meta=siteinfo&siprop=dbrepllag

Is there any way to disable this ping?
Thanks!

No recent build on http://yarl.github.io/vicuna/

There is no recent build on http://yarl.github.io/vicuna/. This also means that the latest localisation are not being made available to potential users.

Open session function truncates descriptions which contain wiki links

If I save session with file descriptions that use links to wiki pages like
... text ... [[:en:Aspergillus fumigatus|Kropidlák]] ... text...
and then try to open the session file later, it does not load full descriptions. The descriptions are cut after second appearance of ]] and even strangely the continuation of description for first image is used as description for second image, again truncated after second ]].
When I replace the [[ and ]] characters by // and , descriptions are loaded correctly, but it is then useless as the links will not work this way.
I would like to upload about 400 micrograph pictures so I need to prepare the XML session file externally (I have it already).
If needed I can send small XML session file example and screen shots as well.
If you correct it will there be a new release or how can I get it working?
I would very appreciate if you correct this bug. Thank you.

Keyboard shortcut for cat dropdown help

Hi,

can you add keyboard shortcut for category dropdown help. It is usefull, but sumetimes it disturb, so swiching off via shortcut would be useful.

Display wikitext loaded from external file in the overview

At the moment, it is not clear from the main view whether the uploaded text is generated from the GUI input or from an external file.
Display should either grey out the input fields if they are not used, or display an info text instead, e.g. "Content from my_external_description.txt: ...."

Grey out files that are already on Commons

I often don't remember what files I have already uploaded.
So I spend a lot of time writing descriptions, and finding categories, for nothing.

It would be great if Vicuna could grey out files that have already been uploaded, so that I don't waste time filling their metadata.

Ideally it would calculate the checksum of the file and check against a database of all Commons files (if that exists) or a local database of checksums of files uploaded by me.

Focus on password box if username already entered

When you load the software again, and select File -> Log in, it would make more sense if the form focused on the password box if the username box was filled out

default directory is determined by the last open image file (almost) forever

The default directory is determined by the last open image file. It then gets saved into session and the main settings file. As in #46, my session default directory got set to the parent of my home and I could not force vicuna to change it, except doing the following:

• open vicuńa
• open session.xml
• open some file in the directory I want to be current
• delete that file
• save session.xml

Coord window behind

v.1.16, Windows Vista

Sometimes the coordination tab goes to the bottom of all windows.

Minor "dirt" in description

Hi another minor problem. There is something which looks like the dubble dot uppon German letters. I attach screenshot. Now in the moment it is upon "R", and as I type it disapears or move upon text.

Err how to attach file?

Save button in Setting doesnt work

Hi,

if I click on Save in Settings window. Nothing happen.

Enable overwriting existing files

It should be possible to overwrite existing files; the current behaviour is to warn the user that the filename already exists and to stop the upload.

The user should be able to overwrite existing files after confirming that s/he knows what s/he's doing.

Empty category adds

v.1.16 adds empty category. See e.g. here: https://commons.wikimedia.org/wiki/File:P%C3%A1le%C4%8Dek,_auto.jpg

easy upload for derivative works ?

Hello all.
I've just discovered this project.
It seems to be very cool and i wanted to know if it could be adjusted to help me for uploading large number of wikivoyage banner.
Wikivoyage is a project who need lot of derivative works of wikimédia commons content to have lots of banner .

I personnally create more than 1.000 banners for wikivoyage but uploading to wikimédia commons is painfull,
i have to copy-paste all descriptions, original authors and original licenses (and there not always the same).

So, i wanted to know if it's possible to make a feature specialy for derivative works.
There was before a sort of program, DerivativeFX to do stuff like this but was not very pratical to upload tons of derivates files.
It will be very helpfull if i just have to insert original file and the program download all original informations from this file, so i've just to change categorie (or use a "forced category") and (maybe automatically) add my speudonyme to the list of authors.

That will be a awesome feature.

Uploading problem

Again, I have uploading problem. There are 2 jpg files to upload, but several minutes passed and nothing happened. Wikimedia Sever status seems to be OK, I chacked my connection via external service at rychlost.cz and seems to be ok, too.

Illegal argument exception while uploading files in 1.14

When uploading an OGV file with Vicuna 1.14, I am getting the following error visible in the command line output:

Exception in thread "Thread-6" java.lang.IllegalArgumentException: File:[B@1f93ace is an illegal title
at org.wikipedia.Wiki.normalize(Wiki.java:6363)
at org.wikipedia.Wiki.getPageInfo(Wiki.java:1311)
at org.wikipedia.Wiki.upload(Wiki.java:3246)
at cuploader.frames.FUpload$3.run(FUpload.java:390)
at java.lang.Thread.run(Thread.java:636)

This issue has apparently been fixed in 1.15, but it still remains a problem for people using 1.14 which is the default stable version right now.

Place for other templates

Hi, this is a suggestion to somehow make possible to add templates under description. Now this opportunity is only in Settings as far as I know (called "text under license"). If I place there a template it pose it nicely under licence tag. If I dont want to use such template to all files, I will add it to description to each file I need.

But some crowds on Commons say, this mess up the description. I dont necessary need that, what do you think?

Enable providing different external descriptions for uploaded files

It would be handy to be able to provide different external descriptions for multiple files uploaded at once; this would help a lot with batch uploading, when file descriptions are very similar to each other, and are only changed with command line text processing tools (sed, grep, awk, etc.).

Japanese characters showing as tofu in description

The squares should show: 桜食堂

For some reason the "Name" and "Categories" fields do not have this problem.
Ubuntu 2014.04

Not a big problem, but worth fixing if easy :-)

File ending/extension capitalization changed when re-uploading; accidentially created new image file

Forwarding from Commons.

Atamari uploaded some files as File:xy.JPG (capital file extension; example: File:Axxis Wuppertal 2014-03-26 001.JPG). After editing the images in the local folder the user wanted to re-upload the edited image files, but VicuñaUploader changed the filename to File:Axxis Wuppertal 2014-03-26 001.jpg (no capital file ending anymore) and hence a new, separate file was created. VicuñaUploader should not change the file name and especially the file extension (or there should be a setting for that).

Replace JMapViewer in FAbout.form with jxmapviewer2

... sorry I've not installed your IDE to fix this

v 1.14: HTML code visible

Minor bug: HTML code in the surroundings of "Desc" visible.