dewey / feedbridge Goto Github PK

View Code? Open in Web Editor NEW

84.0 84.0 6.0 2.43 MB

Plugin based RSS feed generator for sites that don't offer any. Serves RSS, Atom and JSON Feeds.

Home Page: https://feedbridge.notmyhostna.me

License: MIT License

Go 84.40% Dockerfile 2.73% Makefile 1.87% CSS 10.19% Shell 0.82%

atom-feed jsonfeed-generator rss rss-generator scraping webscraping

feedbridge's People

Contributors

Stargazers

Watchers

Forkers

blindslug skyleet tecufanujacu eloisetwaine brighteyed ali2kan

feedbridge's Issues

Export metrics for number of items in cache

Find better solution / error page for feeds that are not scraped yet

Right now we just throw an error, this should probably be a "fetching in progress" message or page.

level=error ts=2018-08-23T22:33:58.515971321Z caller=service.go:40 msg="no value found for key 'rss_scmp'"
level=error ts=2018-08-23T22:34:12.749184206Z caller=service.go:40 msg="no value found for key 'json_scmp'"
level=error ts=2018-08-23T22:35:33.950560779Z caller=service.go:40 msg="no value found for key 'json_scmp'"

Fix problem where scrape dies and never recovers

ts=2018-08-19T11:07:01.240791032Z caller=main.go:80 msg="feedbridge listening on :8080"
level=error ts=2018-08-19T14:37:21.959144574Z caller=runner.go:82 err="Get https://www.scmp.com/topics/infographics-international: net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
level=error ts=2018-08-19T14:56:34.441824174Z caller=service.go:40 msg="no value found for key 'rss_scmp'"
level=error ts=2018-08-19T15:56:37.297747274Z caller=service.go:40 msg="no value found for key 'rss_scmp'"
level=error ts=2018-08-19T17:56:34.473583197Z caller=service.go:40 msg="no value found for key 'rss_scmp'"
level=error ts=2018-08-19T19:29:50.311532393Z caller=service.go:40 msg="no value found for key 'rss_scmp'"
level=error ts=2018-08-19T19:29:51.823058251Z caller=service.go:40 msg="no value found for key 'rss_scmp'"
level=error ts=2018-08-19T19:29:53.599538158Z caller=service.go:40 msg="no value found for key 'json_scmp'"
level=error ts=2018-08-19T19:29:57.568457341Z caller=service.go:40 msg="no value found for key 'json_smcp'"