magnusmanske / listeria_rs Goto Github PK
View Code? Open in Web Editor NEWRepo for the Wikimedia Listeria bot
Home Page: https://listeria.toolforge.org/
Repo for the Wikimedia Listeria bot
Home Page: https://listeria.toolforge.org/
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/79/czech-wikipedia-bot
Hello, could you please request for a bot flag on Czech Wikipedia? See this page: https://cs.wikipedia.org/wiki/Wikipedie:Bot/%C5%BD%C3%A1dosti I can see edits of the bot at recent changes and it is annoyed. Thanks!
Message from update page:
Trying to update Wikidata:WikiProject_sum_of_all_paintings/Catalog/Paintings_per_catalog...
./target/release/main 'www.wikidata.org' 'Wikidata:WikiProject_sum_of_all_paintings/Catalog/Paintings_per_catalog'
Done.
Return to Wikidata:WikiProject_sum_of_all_paintings/Catalog/Paintings_per_catalog
Also, check out the current bot status!
Status: OK
I checked the query in case the problem is a timeout, but it works. Also another list of lists (Hofstede de Groot catalogs) does update. For the problem list, see https://www.wikidata.org/wiki/Wikidata:WikiProject sum of all paintings/Catalog/Paintings per catalog
For the following pages
a) the SPARQL runs within 60 seconds in WDQS
and the issue is
b) a Listeria manual update yields a status page saying 'all is good', but the pages are not, in fact, updated.
Some columns (like Street address, here https://en.wikipedia.org/wiki/User%3ADrThneed%2FDelisted_heritage_buildings) appear with a language tag at the front, is there a way for me to get rid of this?
This may or may not related to a second issue with language. In this table (https://en.wikipedia.org/wiki/User%3ADrThneed%2FCritteroftheWeek), Taxon common name P1843 is given in every language it is entered in, I need a way to limit it to English only if possible. I tried setting language=en but it made no difference (documentation suggests that only affects label and description language).
For the following 4 lists:
a) the SPARQL times out when run in WDQS
and the issue is:
b) A Listeria manual update yields a status page that suggests all is fine & that the page has been updated. however the page has not been updated, and if the cause is a SPARQL time out, that is not being reported.
when page uses template for formatting otput, icluded styles breaks output:
please, don't include classses when row_template = yes
Problem is evidenced on versions of https://en.wikipedia.org/wiki/Wikipedia:WikiProject_Women_in_Red/Missing_articles_by_dictionary/Grove_Art
The SPARQL in the query selects a variable, which is then used as a column.
When the variable name is ?entry all is fine - desired values appear in the column.
When the variable name is ?Entry the column is blank.
variable name set to ?entry in 00:05, 13 November 2020
Listeria populates column in 00:06, 13 November 2020 update
variable name set to ?Entry in 00:24, 13 November 2020
Listeria blanks column in 00:24, 13 November 2020 update
In this list the sorting order was inverted to oldest first in this list compared to V1. However, it was easy to fix by sorting the list already in SPARQL so this is just for reporting the change.
Hello! It's a month now ListeriaBot is not editing anymore at euwikipedia.
Thanks!
Bluelinks (with URLs pointing to wikidata) appearing in the first column; don't think they should be there. Have never seen such things in my Listeria experience.
See this edit:
Because of bug #34
I added to lists parameter
|freq=7
, which, according documentation, should sstop bot from editing for next 7 days.
https://cs.wikipedia.org/w/index.php?title=Wikipedie:WikiProjekt_Drobné_památky/okres_České_Budějovice/Boršov_nad_Vltavou&diff=19201230&oldid=19197329&diffmode=source
Bot made two new self-reverting edits in next few hours...
https://cs.wikipedia.org/w/index.php?title=Wikipedie:WikiProjekt_Drobné_památky/okres_České_Budějovice/Boršov_nad_Vltavou&action=history
In ListeriaBot V1 it was possible to define the SPARQL query with template which was shared to multiple lists. With V2 this is not anymore possible as the saving the result will fail to find the correct area in the the template for updating the data.
Example - https://fi.wikipedia.org/w/index.php?title=Malline:Wikidata-galleria/Pengerkatu&oldid=19351308
Bot now updates pages several times daily.
In one edit deletes machine-created description, in second adds it, in third deletes it again...
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/78/output-to-template-is-broken-because-of
when page uses template for formatting otput, icluded styles breaks output:
Steps to reproduce:
Take a Listeria list on Commons, e.g. this one
https://commons.wikimedia.org/wiki/User:Spinster/WikiFlix/Films_from_France
Click 'Manually update list'
The 'output page' on Toolforge then produces a hyperlink to https://commons.commons.org/wiki/User%3ASpinster%2FWikiFlix%2FFilms_from_France which should be https://commons.wikimedia.org/wiki/User%3ASpinster%2FWikiFlix%2FFilms_from_France
similar issue to #10 (milleniums would be wrong too according to fix there).
examples at https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings/Collection/Georgia_Museum_of_Art (listed as 190s).
On https://en.wikipedia.org/wiki/Wikipedia:WikiProject_Women_in_Red/Metrics/Wikidata_humans_no_gender
Asks for sort=label
Gets sort=QId
A large number of depicts statements seems to prevent Listeria from updating a list on #Wikidata . See for example https://www.wikidata.org/wiki/User:Multichill/1001_Schilderijen
(original issue by @mdammers on Twitter)
Example:
https://en.wikipedia.org/wiki/User:GerardM/Vice_Presidents_of_Egypt
(originally by Gerard Meijssen)
should have ~940 rows.
A manual update just now produced zero rows.
The WDQS report for the SPARQL in the list gives ~940 rows.
I created a page using listeria bot and it's not populating.
Manually updating gives the message below and still doesn't populate it. My query returns results so I do not think it's the query.
As a new user t took me quite a while to realise my mistake when I clicked "update the list now" and it worked fine the first time but the second time it appended rather than overwriting.
So I suggest adding an error or warning message when
{{Wikidata list end}} is missing.
It seems to me that for items with multiple values Listeria Bot currently treats deprecated statements the same way as non-deprecated statements. I would propose that it either completely ignores the deprecated statements or marks them with strikethrough.
follow-up to #10
examples at https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings/Collection/Georgia_Museum_of_Art : dates listed as 19th century when they are actually 20th century (creator was merely a toddler at end of 19th century).
Examples from https://en.wikipedia.org/wiki/Wikipedia%3AWikiProject_Women_in_Red%2FMissing_articles_by_occupation%2FPhilanthropists
Where there's an item with no article, having a label matching another article, Listeria produces a link to the other article, rather than (in this instance) to a suffixed title
e.g. https://en.wikipedia.org/wiki/Sarah_Hoffman -> https://www.wikidata.org/wiki/Q19862161
versus
No article - https://www.wikidata.org/wiki/Q43920575
anchor for the redlink should be Sarah_Hoffman (Q43920575)
anchor for the redlink is Sarah_Hoffman
When trying to update any ListeriaBot list(s) on Arabic Wikipedia we are facing:
ERROR: Namespace 0 not allowed for edit on arwiki
OR
ERROR: Namespace 2 not allowed for edit on arwiki
Same for all namespaces.
Last bot edits on 22:22، 10 Nov 2020
https://w.wiki/qEw
What's the problem here? and why stopped on all arwiki namespaces?
Thanks in advance
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/77/lysteriabot-v2-section-logic-does-not-work
Geert Van Pamel
Since LysteriaBot V2 the section logic is broken when using "section=?city", but still works in the syntax "section=P131".
Example of broken logic:
https://nl.wikipedia.org/wiki/Wikipedia:Wikiproject/Erfgoed/Vlaanderen/Pajottenland-Zennevallei/ListeriaBot/Personen_geboren_in_het_Pajottenland
It worked with the previous Lysteria version until:
https://nl.wikipedia.org/w/index.php?title=Wikipedia:Wikiproject/Erfgoed/Vlaanderen/Pajottenland-Zennevallei/ListeriaBot/Personen_geboren_in_het_Pajottenland&oldid=56957275
One of the lists in question is here
These lists previously only included wikidata items in their results. Now they are also including wikidata properties, but there is something going on with how the results are generated that gives me a "page does not exist" (screenshots below).
I think this is making it impossible to filter them out using SPARQL. I tried a number of queries today without success, and sometimes had trouble getting the bot to populate any results at all so I just put my original query back. Thanks for creating and maintaining this tool @magnusmanske !
Links in the bots toolforge page are still pointing to old version in bitbucket and not to this github repo .
There could be also link to the listeria evolution blogpost in the toolforge summary
I recently noticed that in Czech Wikipedia, the bot's activity is shown in the recent changes, even that the bot has the bot flag. Can you fix that, please?
Some columns are rendered too wide. This disturbs the table layout.
Example: The Voice recording column P990 is too wide, see https://nl.wikipedia.org/wiki/Wikipedia:Wikiproject/Erfgoed/Vlaanderen/Denderstreek/ListeriaBot/Personen_uit_de_Denderstreek/Query
A minium audio player icon should be enough.
Some browsers like Opera and Google Chrome are worse then Firefox or Microsoft Edge.
It should be possible to set the width of a column explicitly as a number of px just as it is possible to set the column title?
It appears that the width of the audio player (icon image) is set equal to the parameter thumb=90, which is OK for an image thumbnail but is much too wide for a small audio player icon.
(small extract from the above table)
| [[File:Wikimedia Conferentie 2016 - RONN - 22.jpg|center|90px|]]
| [[File:Geert Van Pamel - voice - nl.ogg|center|90px|]]
A possible workaround might be to just leave out the pixel width for the audio files? Or maybe we might need to introduce a CSS class? Or another Listeria configuration parameter like e.g. audio_icon=40?
When trying to update manually, Listeria returns almost immediately with
error decoding response body: expected value at line 1 column 1
Query works on WDQS taking some 20-25s
Some fields are not updated by the bot.
Data of Q13111511 is not updated at this page.
Often ListeriaBot displays geographical coördinates like e.g. 50°55′27″N 4°06′39″E / 50.924166666666665°N 4.110833333333334°E which has little sense. It Should rather be displayed like 50°55′27″N 4°06′39″E / 50.924167°N 4.110833°E.
Using 6 decimals after the comma allows for a precision up to 0,1 m which should be more than sufficient for all our applications.
1/100 of a latitude arc second corresponds to 1/360000 of an arc degree (111 km) which corresponds to 0,3 m.
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/76/recent-deaths-list
I report ListeriaBot has not been able to update this page, which is very useful for some projects, for three days, despite numerous attempts. Thanks for considering the issue.
afaics, based on playing with https://en.wikipedia.org/wiki/Wikipedia%3AWikiProject_Women_in_Red%2FMissing_articles_by_occupation%2FSculptors Listeria is not allowing a manual update to be performed, after the page's SPARQL has been altered, if the page was recently manually updated.
So the sequence should be:
What seems to be happening is
Trying to update Wikipedia:WikiProject_Women_in_Red/Missing_articles_by_occupation/Sculptors...
Done.
Return to Wikipedia:WikiProject_Women_in_Red/Missing_articles_by_occupation/Sculptors
Also, check out the current bot status!
Status: OK
Hi Magnus. Any idea why Listeria is emptying some lists please eg this one. Thanks! Llywelyn2000
Originally from https://www.wikidata.org/wiki/Topic:Vzibzru5ciwze2cr
When I click the link for a manual update from {{Wikidata list}}, I get a link to https://wikidata.wikidata.org/wiki/$1
, which doesn’t work at all (the right link would be https://www.wikidata.org/wiki/$1
or just https://wikidata.org/wiki/$1
).
The list at https://www.wikidata.org/wiki/Special:PermanentLink/1308147407 was replaced with the empty list by ListeriaBot v2. An unusual aspect of the list might be the creation of XML-/HTML-like MediaWiki tags within the query.
I think this is unconnected with the Rust update - was happening before, is still happening.
Example report having issue: https://en.wikipedia.org/wiki/Wikipedia%3AWikiProject_Women_in_Red%2FMissing_articles_by_occupation%2FPoliticians_-_country_unknown
Issue is, valid SPARQL, but an a manual update Listeria gets no further than saying:
Trying to update Wikipedia:WikiProject_Women_in_Red/Missing_articles_by_occupation/Politicians_-country_unknown...
Return to Wikipedia:WikiProject_Women_in_Red/Missing_articles_by_occupation/Politicians-_country_unknown
Also, check out the current bot status!
Status: OK
It does not actually write the output page - see https://en.wikipedia.org/w/index.php?title=Wikipedia:WikiProject_Women_in_Red/Missing_articles_by_occupation/Politicians_-_country_unknown&action=history
https://www.wikidata.org/wiki/Wikidata:WikiProject_Parliaments/lists/national_legislatures produces a list of countries and their legislatures, and includes a column list of:
|columns=?country:Country,label,description,P31,P1342,P527,P18,P856
Previously, the label, description, and Pxxx calls all applied to the ?item
(i.e. the legislature), but now they seem to apply to the ?country
instead: https://www.wikidata.org/w/index.php?title=Wikidata%3AWikiProject_Parliaments%2Flists%2Fnational_legislatures&type=revision&diff=1309295158&oldid=1264791914
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/74/broken-lists-on-ptwiki
Éder Porto:
Hi, Magnus,
I think the version 2 has broken several listeria lists on the Portuguese Wikipedia.
For example: https://pt.wikipedia.org/wiki/Acervo_de_brasões_no_Museu_Paulista and https://pt.wikipedia.org/wiki/Gretchen_Andrew
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/82/proposal-listeriabot-to-add-an-alias-meta
Geert Van Pamel:
Problem: LysteriaBot currently only knows "label", and "description" as standard item columns; "alias" is not recognised yet as a valid item header variable.
Who would benefit: Everyone that automatically creates Wikipedia tables based on a Wikidata Query.
Proposed solution: Add a pseudo-column "alias" that is automatically and transparently available for any query.
More comments: Currently this can be simulated by explicitly adding a SPARQL variable ?alias as:
OPTIONAL {
?item skos:altLabel ?alias.
FILTER((LANG(?alias)) = "nl")
}
This makes the Wikidata Query unnecessary complex, and leads to redundant user code in all individual LysteriaBot queries.
See also: (original proposal)
https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2021/Bots_and_gadgets/ListeriaBot_to_add_alias_meta-column#Discussion
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/80/listeriabot-v2-query-does-not-produce
Geert Van Pamel:
A query that previously ran OK, does not produce output any more.
The Bot status still shows an OK, but no new version of the Wiki page is produced.
No other error is shown. What happens?
This listeria list is not updating:
https://www.wikidata.org/wiki/Wikidata%3ALists%2Fcorona_virus_deaths#Detailed_list
After trying "Manually update list" the result is "Done." and "Status: OK", but the list itself is not updated, while there are (unfortunately) new items (see the results of underlying query - https://w.wiki/h6i).
Listeriabot unexpectedly started duplicating the lists, that's why it was banned from Hungarian Wikipedia :( There is a line of HTML code between the two tables.
Example:
HTML code fragment (CTRL+F search): sparql=SELECT ?item WHERE
...
Start (first error): 2020. november 20., 19:25
I used to just have the qualifier listed, now I get the qualifier value and the property it is qualifying
So in this table https://en.wikipedia.org/wiki/User:DrThneed/Listeria_for_Hokitika the "Date listed" column was just a date (value of P580, qualifier on P1435), now since the update it is showing the values of the P580 and the P1435.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.