London Fire Brigade demo breaks about datasette-app

[simonw]

Here's where the demos are pulled in: https://github.com/simonw/datasette-app-support/blob/ee8a05ba1dd55734d2b99c9bd774ebb8e9790d7c/datasette_app_support/templates/index.html#L70

From https://datasette.io/content/example_csvs.json?_shape=array

And the URL to the CSV in this is now a 404:

{
  "rowid": 2,
  "url": "https://data.london.gov.uk/download/animal-rescue-incidents-attended-by-lfb/8a7d91c2-9aec-4bde-937a-3998f4717cd8/Animal%20Rescue%20incidents%20attended%20by%20LFB%20from%20Jan%202009.csv",
  "name": "Animal rescue incidents attended by the London Fire Brigade",
  "table_name": "london_fire_brigade_animal_rescues",
  "source": "London Datastore",
  "source_url": "https://data.london.gov.uk/dataset/animal-rescue-incidents-attended-by-lfb",
  "about": null,
  "about_url": null,
  "description": "The London Fire Brigade attends a range of non-fire incidents, including assistance to animals that may be trapped or in distress. This data includes every such incident since January 2009, and is updated monthly."
}

https://data.london.gov.uk/download/animal-rescue-incidents-attended-by-lfb/8a7d91c2-9aec-4bde-937a-3998f4717cd8/Animal%20Rescue%20incidents%20attended%20by%20LFB%20from%20Jan%202009.csv 404s

[simonw]

The new URL is https://data.london.gov.uk/download/animal-rescue-incidents-attended-by-lfb/f43b485e-fb35-419c-aa7a-fa75676e5835/Animal%20Rescue%20incidents%20attended%20by%20LFB%20from%20Jan%202009.csv

[simonw]

I should set up a task to check that these don't 404 again in the future.

[simonw]

Fixing the URL didn't fix the feature, because the new URL 302 redirects but the datasette-app-support feature doesn't automatically follow redirects.

I'm going to replace this example with something else for the moment, until I can implement and ship redirects.

[simonw]

Looks like all links on the London Datastore are redirects now, e.g.

 % curl -i 'https://data.london.gov.uk/download/london-reservoir-levels/778eefb5-8cef-4d16-a4c8-77dee7ce7e81/london_reservoir_levels.csv'
HTTP/2 302 
content-type: text/html; charset=UTF-8
location: https://airdrive-secure.s3-eu-west-1.amazonaws.com/london/dataset/london-reservoir-levels/2022-07-05T14%3A24%3A58/london_reservoir_levels.csv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAJJDIMAIVZJDICKHA%2F20220713%2Feu-west-1%2Fs3%2Faws4_request&X-Amz-Date=20220713T043817Z&X-Amz-Expires=300&X-Amz-Signature=32be2950e6e9e9be065adfc2af5e9c3e13acf43ff8272092cc2e5ac6d085bfdf&X-Amz-SignedHeaders=host

They redirect to signed expiring URLs too.

[simonw]

I'll use Global Power Plants: https://github.com/wri/global-power-plant-database/raw/master/output_database/global_power_plant_database.csv

[simonw]

Fixed it.