magnusmanske / listeria_rs Goto Github PK
View Code? Open in Web Editor NEWRepo for the Wikimedia Listeria bot
Home Page: https://listeria.toolforge.org/
listeria_rs's People
Contributors
Stargazers
Watchers
listeria_rs's Issues
Czech Wikipedia bot
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/79/czech-wikipedia-bot
Hello, could you please request for a bot flag on Czech Wikipedia? See this page: https://cs.wikipedia.org/wiki/Wikipedie:Bot/%C5%BD%C3%A1dosti I can see edits of the bot at recent changes and it is annoyed. Thanks!
Listeria will not update for "list of lists" on Wikidata
Message from update page:
Trying to update Wikidata:WikiProject_sum_of_all_paintings/Catalog/Paintings_per_catalog...
./target/release/main 'www.wikidata.org' 'Wikidata:WikiProject_sum_of_all_paintings/Catalog/Paintings_per_catalog'
Done.
Return to Wikidata:WikiProject_sum_of_all_paintings/Catalog/Paintings_per_catalog
Also, check out the current bot status!
Status: OK
I checked the query in case the problem is a timeout, but it works. Also another list of lists (Hofstede de Groot catalogs) does update. For the problem list, see https://www.wikidata.org/wiki/Wikidata:WikiProject sum of all paintings/Catalog/Paintings per catalog
Category added wrongly
Lists not updating
For the following pages
a) the SPARQL runs within 60 seconds in WDQS
and the issue is
b) a Listeria manual update yields a status page saying 'all is good', but the pages are not, in fact, updated.
Language issues
Some columns (like Street address, here https://en.wikipedia.org/wiki/User%3ADrThneed%2FDelisted_heritage_buildings) appear with a language tag at the front, is there a way for me to get rid of this?
This may or may not related to a second issue with language. In this table (https://en.wikipedia.org/wiki/User%3ADrThneed%2FCritteroftheWeek), Taxon common name P1843 is given in every language it is entered in, I need a way to limit it to English only if possible. I tried setting language=en but it made no difference (documentation suggests that only affects label and description language).
Lists not updating, or, manual update status does not indicate the SPARQL times out
For the following 4 lists:
a) the SPARQL times out when run in WDQS
and the issue is:
b) A Listeria manual update yields a status page that suggests all is fine & that the page has been updated. however the page has not been updated, and if the cause is a SPARQL time out, that is not being reported.
problematic css classes
when page uses template for formatting otput, icluded styles breaks output:
please, don't include classses when row_template = yes
Use of variable starting with uppercase prevents data being used in column
Problem is evidenced on versions of https://en.wikipedia.org/wiki/Wikipedia:WikiProject_Women_in_Red/Missing_articles_by_dictionary/Grove_Art
The SPARQL in the query selects a variable, which is then used as a column.
When the variable name is ?entry all is fine - desired values appear in the column.
When the variable name is ?Entry the column is blank.
variable name set to ?entry in 00:05, 13 November 2020
Listeria populates column in 00:06, 13 November 2020 update
variable name set to ?Entry in 00:24, 13 November 2020
Listeria blanks column in 00:24, 13 November 2020 update
Sorting order is inverted? (V2)
In this list the sorting order was inverted to oldest first in this list compared to V1. However, it was easy to fix by sorting the list already in SPARQL so this is just for reporting the change.
ListeriaBot not working anymore at euwiki
Hello! It's a month now ListeriaBot is not editing anymore at euwikipedia.
Thanks!
Bluelinks (to wikidata) appear though |links=red parameter is set
Bluelinks (with URLs pointing to wikidata) appearing in the first column; don't think they should be there. Have never seen such things in my Listeria experience.
Sections by binded variable not working anymore
See this edit:
Bot ignores freq=
Because of bug #34
I added to lists parameter
|freq=7, which, according documentation, should sstop bot from editing for next 7 days.
https://cs.wikipedia.org/w/index.php?title=Wikipedie:WikiProjekt_Drobné_památky/okres_České_Budějovice/Boršov_nad_Vltavou&diff=19201230&oldid=19197329&diffmode=source
Bot made two new self-reverting edits in next few hours...
https://cs.wikipedia.org/w/index.php?title=Wikipedie:WikiProjekt_Drobné_památky/okres_České_Budějovice/Boršov_nad_Vltavou&action=history
ListeriaBot V2 SPARQL query cannot be defined via template
In ListeriaBot V1 it was possible to define the SPARQL query with template which was shared to multiple lists. With V2 this is not anymore possible as the saving the result will fail to find the correct area in the the template for updating the data.
Example - https://fi.wikipedia.org/w/index.php?title=Malline:Wikidata-galleria/Pengerkatu&oldid=19351308
self-reverting edits
Bot now updates pages several times daily.
In one edit deletes machine-created description, in second adds it, in third deletes it again...
Output to template is broken because of table tyles
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/78/output-to-template-is-broken-because-of
when page uses template for formatting otput, icluded styles breaks output:
Listeria's Toolforge 'output page' links to https://commons.commons.org, not https://commons.wikimedia.org
Steps to reproduce:
Take a Listeria list on Commons, e.g. this one
https://commons.wikimedia.org/wiki/User:Spinster/WikiFlix/Films_from_France
Click 'Manually update list'
The 'output page' on Toolforge then produces a hyperlink to https://commons.commons.org/wiki/User%3ASpinster%2FWikiFlix%2FFilms_from_France which should be https://commons.wikimedia.org/wiki/User%3ASpinster%2FWikiFlix%2FFilms_from_France
incorrect display of dates with decade precision
similar issue to #10 (milleniums would be wrong too according to fix there).
examples at https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings/Collection/Georgia_Museum_of_Art (listed as 190s).
Borked sort order
On https://en.wikipedia.org/wiki/Wikipedia:WikiProject_Women_in_Red/Metrics/Wikidata_humans_no_gender
Asks for sort=label
Gets sort=QId
Depict statements
A large number of depicts statements seems to prevent Listeria from updating a list on #Wikidata . See for example https://www.wikidata.org/wiki/User:Multichill/1001_Schilderijen
(original issue by @mdammers on Twitter)
Only one image per cell
Example:
https://en.wikipedia.org/wiki/User:GerardM/Vice_Presidents_of_Egypt
(originally by Gerard Meijssen)
Manual update incorrectly zeros table
should have ~940 rows.
A manual update just now produced zero rows.
The WDQS report for the SPARQL in the list gives ~940 rows.
Listeria not populating newly created list
I created a page using listeria bot and it's not populating.
Manually updating gives the message below and still doesn't populate it. My query returns results so I do not think it's the query.
Warning message suggestion
As a new user t took me quite a while to realise my mistake when I clicked "update the list now" and it worked fine the first time but the second time it appended rather than overwriting.
So I suggest adding an error or warning message when
{{Wikidata list end}} is missing.
Listeria Bot ignores deprecation
It seems to me that for items with multiple values Listeria Bot currently treats deprecated statements the same way as non-deprecated statements. I would propose that it either completely ignores the deprecated statements or marks them with strikethrough.
wrong display of century dates
follow-up to #10
examples at https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings/Collection/Georgia_Museum_of_Art : dates listed as 19th century when they are actually 20th century (creator was merely a toddler at end of 19th century).
Redlinks not suffixed where a bluelink exists
Examples from https://en.wikipedia.org/wiki/Wikipedia%3AWikiProject_Women_in_Red%2FMissing_articles_by_occupation%2FPhilanthropists
Where there's an item with no article, having a label matching another article, Listeria produces a link to the other article, rather than (in this instance) to a suffixed title
e.g. https://en.wikipedia.org/wiki/Sarah_Hoffman -> https://www.wikidata.org/wiki/Q19862161
versus
No article - https://www.wikidata.org/wiki/Q43920575
anchor for the redlink should be Sarah_Hoffman (Q43920575)
anchor for the redlink is Sarah_Hoffman
ListeriaBot not work anymore on Arabic Wikipedia
When trying to update any ListeriaBot list(s) on Arabic Wikipedia we are facing:
ERROR: Namespace 0 not allowed for edit on arwiki
OR
ERROR: Namespace 2 not allowed for edit on arwiki
Same for all namespaces.
Last bot edits on 22:22، 10 Nov 2020
https://w.wiki/qEw
What's the problem here? and why stopped on all arwiki namespaces?
Thanks in advance
Century dates
LysteriaBot V2 section logic does not work any more with user variables
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/77/lysteriabot-v2-section-logic-does-not-work
Geert Van Pamel
Since LysteriaBot V2 the section logic is broken when using "section=?city", but still works in the syntax "section=P131".
Example of broken logic:
https://nl.wikipedia.org/wiki/Wikipedia:Wikiproject/Erfgoed/Vlaanderen/Pajottenland-Zennevallei/ListeriaBot/Personen_geboren_in_het_Pajottenland
It worked with the previous Lysteria version until:
https://nl.wikipedia.org/w/index.php?title=Wikipedia:Wikiproject/Erfgoed/Vlaanderen/Pajottenland-Zennevallei/ListeriaBot/Personen_geboren_in_het_Pajottenland&oldid=56957275
Lists now including properties in addition to items, properties resolve to "page does not exist"
One of the lists in question is here
These lists previously only included wikidata items in their results. Now they are also including wikidata properties, but there is something going on with how the results are generated that gives me a "page does not exist" (screenshots below).
I think this is making it impossible to filter them out using SPARQL. I tried a number of queries today without success, and sometimes had trouble getting the bot to populate any results at all so I just put my original query back. Thanks for creating and maintaining this tool @magnusmanske !
Links in the bots toolforge page are pointing to old version
Links in the bots toolforge page are still pointing to old version in bitbucket and not to this github repo .
There could be also link to the listeria evolution blogpost in the toolforge summary
Bot is shown in RC changes
I recently noticed that in Czech Wikipedia, the bot's activity is shown in the recent changes, even that the bot has the bot flag. Can you fix that, please?
It should be possible to set the width of a column
Some columns are rendered too wide. This disturbs the table layout.
Example: The Voice recording column P990 is too wide, see https://nl.wikipedia.org/wiki/Wikipedia:Wikiproject/Erfgoed/Vlaanderen/Denderstreek/ListeriaBot/Personen_uit_de_Denderstreek/Query
A minium audio player icon should be enough.
Some browsers like Opera and Google Chrome are worse then Firefox or Microsoft Edge.
It should be possible to set the width of a column explicitly as a number of px just as it is possible to set the column title?
It appears that the width of the audio player (icon image) is set equal to the parameter thumb=90, which is OK for an image thumbnail but is much too wide for a small audio player icon.
(small extract from the above table)
| [[File:Wikimedia Conferentie 2016 - RONN - 22.jpg|center|90px|]]
| [[File:Geert Van Pamel - voice - nl.ogg|center|90px|]]
A possible workaround might be to just leave out the pixel width for the audio files? Or maybe we might need to introduce a CSS class? Or another Listeria configuration parameter like e.g. audio_icon=40?
Error on manual update
When trying to update manually, Listeria returns almost immediately with
error decoding response body: expected value at line 1 column 1
Query works on WDQS taking some 20-25s
Bot not updating some fields in the table
Some fields are not updated by the bot.
Data of Q13111511 is not updated at this page.
WGS84/GPS coordinate precision should be limited to 6 decimals after the comma
Often ListeriaBot displays geographical coördinates like e.g. 50°55′27″N 4°06′39″E / 50.924166666666665°N 4.110833333333334°E which has little sense. It Should rather be displayed like 50°55′27″N 4°06′39″E / 50.924167°N 4.110833°E.
Using 6 decimals after the comma allows for a precision up to 0,1 m which should be more than sufficient for all our applications.
1/100 of a latitude arc second corresponds to 1/360000 of an arc degree (111 km) which corresponds to 0,3 m.
Recent Deaths list
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/76/recent-deaths-list
I report ListeriaBot has not been able to update this page, which is very useful for some projects, for three days, despite numerous attempts. Thanks for considering the issue.
Not performing a manual update after SPARQL has been altered
afaics, based on playing with https://en.wikipedia.org/wiki/Wikipedia%3AWikiProject_Women_in_Red%2FMissing_articles_by_occupation%2FSculptors Listeria is not allowing a manual update to be performed, after the page's SPARQL has been altered, if the page was recently manually updated.
So the sequence should be:
- run manual update
- change SPARQL
- run manual update - update runs, page is refreshed based on changes SPARQL
What seems to be happening is
- run manual update
- change SPARQL
- run manual update - update returns a status screen, as below, immediately; page is not updated.
Trying to update Wikipedia:WikiProject_Women_in_Red/Missing_articles_by_occupation/Sculptors...
Done.
Return to Wikipedia:WikiProject_Women_in_Red/Missing_articles_by_occupation/Sculptors
Also, check out the current bot status!
Status: OK
Listeria is emptying some lists
Hi Magnus. Any idea why Listeria is emptying some lists please eg this one. Thanks! Llywelyn2000
Originally from https://www.wikidata.org/wiki/Topic:Vzibzru5ciwze2cr
Wrong link when updating
When I click the link for a manual update from {{Wikidata list}}, I get a link to https://wikidata.wikidata.org/wiki/$1, which doesn’t work at all (the right link would be https://www.wikidata.org/wiki/$1 or just https://wikidata.org/wiki/$1).
as non-empty expected list updated with no content
The list at https://www.wikidata.org/wiki/Special:PermanentLink/1308147407 was replaced with the empty list by ListeriaBot v2. An unusual aspect of the list might be the creation of XML-/HTML-like MediaWiki tags within the query.
Listeria fails to write output page
I think this is unconnected with the Rust update - was happening before, is still happening.
Example report having issue: https://en.wikipedia.org/wiki/Wikipedia%3AWikiProject_Women_in_Red%2FMissing_articles_by_occupation%2FPoliticians_-_country_unknown
Issue is, valid SPARQL, but an a manual update Listeria gets no further than saying:
Trying to update Wikipedia:WikiProject_Women_in_Red/Missing_articles_by_occupation/Politicians_-country_unknown...
Return to Wikipedia:WikiProject_Women_in_Red/Missing_articles_by_occupation/Politicians-_country_unknown
Also, check out the current bot status!
Status: OK
It does not actually write the output page - see https://en.wikipedia.org/w/index.php?title=Wikipedia:WikiProject_Women_in_Red/Missing_articles_by_occupation/Politicians_-_country_unknown&action=history
generated columns no longer always apply to ?item
https://www.wikidata.org/wiki/Wikidata:WikiProject_Parliaments/lists/national_legislatures produces a list of countries and their legislatures, and includes a column list of:
|columns=?country:Country,label,description,P31,P1342,P527,P18,P856
Previously, the label, description, and Pxxx calls all applied to the ?item (i.e. the legislature), but now they seem to apply to the ?country instead: https://www.wikidata.org/w/index.php?title=Wikidata%3AWikiProject_Parliaments%2Flists%2Fnational_legislatures&type=revision&diff=1309295158&oldid=1264791914
Broken lists on ptwiki
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/74/broken-lists-on-ptwiki
Éder Porto:
Hi, Magnus,
I think the version 2 has broken several listeria lists on the Portuguese Wikipedia.
For example: https://pt.wikipedia.org/wiki/Acervo_de_brasões_no_Museu_Paulista and https://pt.wikipedia.org/wiki/Gretchen_Andrew
Proposal: ListeriaBot to add an "alias" meta-column
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/82/proposal-listeriabot-to-add-an-alias-meta
Geert Van Pamel:
Problem: LysteriaBot currently only knows "label", and "description" as standard item columns; "alias" is not recognised yet as a valid item header variable.
Who would benefit: Everyone that automatically creates Wikipedia tables based on a Wikidata Query.
Proposed solution: Add a pseudo-column "alias" that is automatically and transparently available for any query.
More comments: Currently this can be simulated by explicitly adding a SPARQL variable ?alias as:
OPTIONAL {
?item skos:altLabel ?alias.
FILTER((LANG(?alias)) = "nl")
}
This makes the Wikidata Query unnecessary complex, and leads to redundant user code in all individual LysteriaBot queries.
See also: (original proposal)
https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2021/Bots_and_gadgets/ListeriaBot_to_add_alias_meta-column#Discussion
ListeriaBot V2 query does not produce output any more
IMPORTED FROM https://bitbucket.org/magnusmanske/listeria/issues/80/listeriabot-v2-query-does-not-produce
Geert Van Pamel:
A query that previously ran OK, does not produce output any more.
The Bot status still shows an OK, but no new version of the Wiki page is produced.
- Wikipedia:Wikiproject/Belgische podiumkunsten/Dans Vrouwen in rood/ListeriaBot/Blauwe linken (OK; 2020-11-21 01:08:15)
No other error is shown. What happens?
List not updating
This listeria list is not updating:
https://www.wikidata.org/wiki/Wikidata%3ALists%2Fcorona_virus_deaths#Detailed_list
After trying "Manually update list" the result is "Done." and "Status: OK", but the list itself is not updated, while there are (unfortunately) new items (see the results of underlying query - https://w.wiki/h6i).
Create double lists
Listeriabot unexpectedly started duplicating the lists, that's why it was banned from Hungarian Wikipedia :( There is a line of HTML code between the two tables.
Example:
- https://hu.wikipedia.org/w/index.php?title=Indiana_megy%C3%A9inek_list%C3%A1ja&oldid=23273420
- https://hu.wikipedia.org/w/index.php?title=TER_Alsace&oldid=23273403
3 https://hu.wikipedia.org/wiki/Kateg%C3%B3riavita:P%C3%A1rizsban_j%C3%A1tsz%C3%B3d%C3%B3_filmek
HTML code fragment (CTRL+F search): sparql=SELECT ?item WHERE...
Start (first error): 2020. november 20., 19:25
Property and qualifier both showing when it used to be just the qualifier
I used to just have the qualifier listed, now I get the qualifier value and the property it is qualifying
So in this table https://en.wikipedia.org/wiki/User:DrThneed/Listeria_for_Hokitika the "Date listed" column was just a date (value of P580, qualifier on P1435), now since the update it is showing the values of the P580 and the P1435.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.