Coder Social home page Coder Social logo

osmoscraft / osmosfeed Goto Github PK

View Code? Open in Web Editor NEW
927.0 11.0 60.0 2.64 MB

Turn GitHub into an RSS reader

Home Page: https://osmoscraft.org

License: MIT License

TypeScript 65.12% HTML 0.14% JavaScript 19.25% CSS 10.36% Handlebars 5.13%
rss feed rss-reader github-actions self-hosted reader typescript javascript feedly feedbin

osmosfeed's Introduction

image

中文

osmos::feed

An RSS reader running entirely from your GitHub repo.

  • Free hosting on GitHub Pages.
  • No need for backend. Content updates via GitHub Actions.
  • Customizable layouts and styles via templating and theming API. Just bring your HTML and CSS.
  • Free and open source. No ads. No third party tracking.

Want a host-free alternative? Check out the sister project: Fjord.

Demos

screely-1644817299264

More examples

Browse all sources and more examples

Get started

Create a repository

  1. Open Create a new repository from osmosfeed-template.
  2. Set visibility to "Public".
    image
  3. Click "Create repository from template" button.

Turn on GitHub Pages

  1. In the repository you just created, navigate to Settings tab > Pages section.

  2. In Source option, select gh-pages, click "Save" button. If gh-pages doesn't exist, wait for a couple of seconds and refresh the page. It will eventually show up.
    image

  3. Refresh the page until it shows Your site is published at https://<github_username>.github.io/<repo>. This may take up to a minute.
    image

Customize the feed

  1. In the repository root, open osmosfeed.yaml file, click the "Pencil (Edit this file)" button to edit.

  2. Remove # to uncommend the cacheUrl property, replace <github_username> with your GitHub username, and replace <repo> with your GitHub repo name.

  3. In the sources, update the items to the sources you want to follow. The final content of the file should look similar to this:

    cacheUrl: https://<github_username>.github.io/<repo>/cache.json
    sources:
      - href: https://my-rss-source-1/feed/
      - href: https://my-rss-source-2/rss/
      - href: https://my-rss-source-3/feed
      - href: https://my-rss-source-4/news/rss
      - href: https://my-rss-source-5/rss/
  4. Scroll to the bottom of the page, click "Commit changes" button.

  5. Once the rebuild finishes, your feed will be available at https://<github_username>.github.io/<repo>.

Guides and references

To contribute

FAQ

Can I update the content more frequently?

Yes, you can make it as frequent as you want. In the .github/workflows/update-feed.yaml file, change the cron schedule. But be aware that there is a limit to the free tier of GitHub Actions. My rough estimate shows that even with hourly update, you should still have plenty of unused time. You can monitor spending on Billing & plans page in Account settings.

Can I make the site private so only I can see it?

It is not possible with GitHub Pages. However, if you move the site to a different hosting service, you should be able to set up authorization on the host level. For example, if you deploy to Netlify, there is a paid plan for password protection.

Do I have to type index.html at the end of the URL?

No. There is a known issue with GitHub, so you might have to type it until it starts to work. See discussion from GitHub Community and some solutions from Stack Overflow

How to trigger a manual site update?

You can make some changes to the osmosfeed.yaml file to trigger an update. For example, add an empty comment like this # on a new line.

How to reset cache?

You can browse to the gh-pages branch on GitHub at https://github.com/<owner>/<repo>/tree/gh-pages. Manually delete the cache.json file. Then trigger a manual site update.

Ecosystem

Ecosystem

Browse other projects from the OsmosCraft ecosystem.

  • Read the web with Fjord
  • Manage bookmarks with Memo
  • Take notes with Tundra

osmosfeed's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

osmosfeed's Issues

RSS feed (combined) generation also in feed formats (RSS2/ATOM)

Hi and congratulations on your effort and idea!

I would like to ask for an idea/implementation regarding the combined list of RSS feeds. Is it possible to combine RSS feeds (the results of the generated html page maybe?) to a new "unified"-RSS-feed (in ATOM/RSS2), so that it can also be able to be used in other services (eg Feedburner, IFTTT, Ms Flow or others) or implementations? It can be optional via a set of configuration variables or something similar... (also built-in on the template page as a reference if it is configured as active)

I am not sure how easy it can be, or if that is even the scope of this set of scripts, it could be nice to suggest it, for a future work maybe...

Thank you!

Customizable lifespan for content cache

This is really awesome!!! Do you know what code I can edit to render more than a month of previous content on my website? The oldest seem to only be about a month old. Thanks so much!

Option to not shorten the feed articles

I would appreciate if there is an option, e.g. set in osmosfeed.yaml to display unmodified content:encoded if available (from the RSS feed itself). I am not sure if it's related but I will also appreciate showing the images, e.g. XKCD strips from https://xkcd.com/rss.xml, inline.

If link tag is relative, host is not prepended

Describe the bug
I'm not sure if its a feature or a bug.

If the value inside the link tag is relative like /posts/index.html then the url host is not prepended to form a valid url to request it.
I've seen pythons feedparser lib behave this way.
I don't know if that's very common for an rss reader lib.
At least the standard does not contain rules for handling relative links.
https://validator.w3.org/feed/docs/rss2.html

So I assume it would be a feature then, but I will let decide you.

Bug area (choose one)

  • Site builder: anything broken during in the GitHub action
  • Reader UI: anything broken while you are reading the feed

To reproduce the bug
Try to download this rss feed url:
https://www.osnabrueck.de/start?type=9818

Expected behavior
I expected from experience with other rss libs before, that osmosfeed also prepends the host from the url to the relative url inside the link tag.

Invalid character in entity name

Describe the bug
Osmosfeed has been running fine for about a month. Suddenly the build action started to fail. It seems one feed in particular causes the error. The feed is news from Sweden’s leading magazine about astronomy and space travel.

The error identifies as "Invalid character in entity name".

Could this be a UTF-8 thing?

Bug area (choose one)

  • Site builder: anything broken in the GitHub action
  • Reader UI: anything broken while you are reading the feed

To reproduce the bug
Run the build action with the news feed from "Populär Astronomi".
https://www.popularastronomi.se/feed/

##[debug]Evaluating condition for step: 'Build the feed'
##[debug]Evaluating: success()
##[debug]Evaluating success:
##[debug]=> true
##[debug]Result: true
##[debug]Starting: Build the feed
##[debug]Loading inputs
##[debug]Loading env
Run npm run build
##[debug]/usr/bin/bash -e /home/runner/work/_temp/5cea[2](https://github.com/seetee/osmosfeed/actions/runs/6444377118/job/17500138579#step:5:2)847-7787-4ace-890e-e8f5ba0b1[3](https://github.com/seetee/osmosfeed/actions/runs/6444377118/job/17500138579#step:5:3)3e.sh

> [email protected] build
> osmosfeed

[main] Starting build using cli version 1.15.1
[system-file] Config: /home/runner/work/osmosfeed/osmosfeed/osmosfeed.yaml
[system-file] Local cache: undefined
[system-file] Template: /home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/system-templates/index.hbs
[system-file] System static: /home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/system-static/favicon.ico
[system-file] System template static: /home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/system-static/index.css
[system-file] System template static: /home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/system-static/index.js
[load-config] Effective config:  {
  sources: [
    { href: 'https://github.com/osmoscraft/osmosfeed/releases.atom' },
    { href: 'https://inkscape.org/news/feed/' },
    { href: 'https://www.scribus.net/feed/' },
    { href: 'https://www.drupal.org/planet/rss.xml' },
    { href: 'https://www.drupal.org/section-blog/all/feed' },
    { href: 'https://www.smashingmagazine.com/feed/' },
    { href: 'https://developer.mozilla.org/en-US/blog/rss.xml' },
    {
      href: 'https://www.d.umn.edu/itss/training/online/webdesign/webdesign.xml'
    },
    { href: 'https://www.kryogenix.org/days/feed' },
    { href: 'http://www.thelins.se/johan/blog/feed/' },
    { href: 'https://feeds.feedburner.com/TroyHunt' },
    { href: 'https://rythian.tumblr.com/rss' },
    { href: 'https://www.helahisingen.se/feed/' },
    { href: 'https://nyhetersto.se/feed/' },
    { href: 'https://api.sr.se/rss/channel?id=10[4](https://github.com/seetee/osmosfeed/actions/runs/6444377118/job/17500138579#step:5:4)' },
    { href: 'https://api.sr.se/api/rss/program/83' },
    { href: 'https://www.gp.se/nyheter/g%C3%B6teborg?rss' },
    { href: 'https://noyb.eu/en/rss' },
    { href: 'https://www.popularastronomi.se/feed/' },
    { href: 'https://status.mangadex.org/history.rss' },
    { href: 'https://www.driftbloggen.se/feed/' }
  ],
  cacheUrl: 'https://seetee.github.io/osmosfeed/cache.json',
  cacheMaxDays: 30,
  siteTitle: 'osmos::feed',
  timezone: null,
  timezoneOffset: 0,
  githubServerUrl: 'https://github.com',
  githubRepository: 'seetee/osmosfeed',
  githubRunId: '6444377118'
}
[get-cache] Use remote cache: https://seetee.github.io/osmosfeed/cache.json
[discover-cache] Pre-build cache restored: https://seetee.github.io/osmosfeed/cache.json
[enrich] 0.91s |  14 cached | -11 new | https://www.d.umn.edu/itss/training/online/webdesign/webdesign.xml
[enrich] 2.86s |   0 cached |   0 new | https://github.com/osmoscraft/osmosfeed/releases.atom
[enrich] 3.18s |   6 cached |   0 new | https://www.driftbloggen.se/feed/
[enrich] 3.32s | 132 cached |  -[5](https://github.com/seetee/osmosfeed/actions/runs/6444377118/job/17500138579#step:5:5) new | https://www.drupal.org/planet/rss.xml
[enrich] 3.34s |   [6](https://github.com/seetee/osmosfeed/actions/runs/6444377118/job/17500138579#step:5:6) cached |   1 new | https://www.drupal.org/section-blog/all/feed
[enrich] Parse source failed https://www.popularastronomi.se/feed/
/home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/main.js:184[7](https://github.com/seetee/osmosfeed/actions/runs/6444377118/job/17500138579#step:5:7)[8](https://github.com/seetee/osmosfeed/actions/runs/6444377118/job/17500138579#step:5:8)
        er = new Error(er);
             ^

Error: Invalid character in entity name
Line: 0
Column: 2028
Char: @
    at error (/home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/main.js:18478:14)
    at strictFail (/home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/main.js:18501:11)
    at SAXParser.write (/home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/main.js:1[9](https://github.com/seetee/osmosfeed/actions/runs/6444377118/job/17500138579#step:5:9)209:17)
    at Parser4.parseString (/home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/main.js:25475:35)
    at Parser4.parseString (/home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/main.js:25[15](https://github.com/seetee/osmosfeed/actions/runs/6444377118/job/17500138579#step:5:16)5:21)
    at /home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/main.js:26035:26
    at new Promise (<anonymous>)
    at Parser4.parseString (/home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/main.js:26034:[20](https://github.com/seetee/osmosfeed/actions/runs/6444377118/job/17500138579#step:5:21))
    at enrichInternal (/home/runner/work/osmosfeed/osmosfeed/node_modules/@osmoscraft/osmosfeed/bin/main.js:4[26](https://github.com/seetee/osmosfeed/actions/runs/6444377118/job/17500138579#step:5:27)04:[32](https://github.com/seetee/osmosfeed/actions/runs/6444377118/job/17500138579#step:5:33))
    at runMicrotasks (<anonymous>)
Error: Process completed with exit code 1.
##[debug]Finishing: Build the feed

Scrollbar mismatching browser theme

Describe the bug
The light theme scrollbar is appearing when browser is using the dark theme by default

Bug area (choose one)

  • Site builder: anything broken during in the GitHub action
  • Reader UI: anything broken while you are reading the feed

To reproduce the bug

  • N/A

Expected behavior
The scrollbar should match the default browser theme

Screenshots
image

Additional context
Need to add css

:root {
  color-scheme: light dark;
}

`description` field shouldn't be truncated when it is a properly sized synopsis.

Describe the bug
Like #6 (comment), I would appreciate if there is an option, e.g. set in osmosfeed.yaml to display the feed description.
Actually, in my case, the feed description is an abstract of each paper. Now it will be truncated because the maximum length doesn't big enough.

Bug area (choose one)

  • Site builder: anything broken during in the GitHub action
  • Reader UI: anything broken while you are reading the feed

To reproduce the bug

Expected behavior
I can set the maximum length of the feed description in osmosfeed.yaml.

"TypeError: input.trim is not a function"

I have attempt to use your tool https://github.com/ad-m/feed-reader on with following configuration:

# cacheUrl: https://GITHUB_USERNAME.github.io/REPO_NAME/cache.json
sources:
  - href: https://github.com/osmoscraft/osmosfeed/releases.atom # Get new feature announcement via this feed
  - href: https://cloudblog.withgoogle.com/rss/
  - href: https://news.ycombinator.com/rss
  - href: https://aws.amazon.com/blogs/aws/feed/
  - href: https://lwn.net/headlines/newrss
  - href: http://feeds.feedburner.com/HighScalability
  - href: https://www.phoronix.com/rss.php

I received following failure build log:

2021-09-11T00:23:40.8850901Z Found online and idle hosted runner in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-09-11T00:23:40.9316674Z Waiting for a Hosted runner in the 'organization' to pick this job...
2021-09-11T00:23:41.2130944Z Job is waiting for a hosted runner to come online.
2021-09-11T00:23:44.2468374Z Job is about to start running on the hosted runner: GitHub Actions 2 (hosted)
2021-09-11T00:23:46.2853260Z Current runner version: '2.281.1'
2021-09-11T00:23:46.2879908Z ##[group]Operating System
2021-09-11T00:23:46.2881100Z Ubuntu
2021-09-11T00:23:46.2881640Z 20.04.3
2021-09-11T00:23:46.2882130Z LTS
2021-09-11T00:23:46.2882692Z ##[endgroup]
2021-09-11T00:23:46.2883336Z ##[group]Virtual Environment
2021-09-11T00:23:46.2884105Z Environment: ubuntu-20.04
2021-09-11T00:23:46.2884711Z Version: 20210906.1
2021-09-11T00:23:46.2886143Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210906.1/images/linux/Ubuntu2004-README.md
2021-09-11T00:23:46.2887715Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210906.1
2021-09-11T00:23:46.2888724Z ##[endgroup]
2021-09-11T00:23:46.2889458Z ##[group]Virtual Environment Provisioner
2021-09-11T00:23:46.2890176Z 1.0.0.0-master-20210816-1
2021-09-11T00:23:46.2890810Z ##[endgroup]
2021-09-11T00:23:46.2893073Z ##[group]GITHUB_TOKEN Permissions
2021-09-11T00:23:46.2894533Z Actions: write
2021-09-11T00:23:46.2895121Z Checks: write
2021-09-11T00:23:46.2895710Z Contents: write
2021-09-11T00:23:46.2896270Z Deployments: write
2021-09-11T00:23:46.2896909Z Discussions: write
2021-09-11T00:23:46.2897442Z Issues: write
2021-09-11T00:23:46.2898167Z Metadata: read
2021-09-11T00:23:46.2898756Z Packages: write
2021-09-11T00:23:46.2899427Z PullRequests: write
2021-09-11T00:23:46.2900189Z RepositoryProjects: write
2021-09-11T00:23:46.2900890Z SecurityEvents: write
2021-09-11T00:23:46.2901568Z Statuses: write
2021-09-11T00:23:46.2902216Z ##[endgroup]
2021-09-11T00:23:46.2905704Z Prepare workflow directory
2021-09-11T00:23:46.3530115Z Prepare all required actions
2021-09-11T00:23:46.3540277Z Getting action download info
2021-09-11T00:23:46.5605717Z Download action repository 'actions/checkout@v2' (SHA:5a4ac9002d0be2fb38bd78e4b4dbde5606d7042f)
2021-09-11T00:23:48.2931904Z Download action repository 'actions/[email protected]' (SHA:c46424eee26de4078d34105d3de3cc4992202b1e)
2021-09-11T00:23:48.5192327Z Download action repository 'peaceiris/actions-gh-pages@v3' (SHA:068dc23d9710f1ba62e86896f84735d869951305)
2021-09-11T00:23:48.8938672Z ##[group]Run actions/checkout@v2
2021-09-11T00:23:48.8939240Z with:
2021-09-11T00:23:48.8939642Z   repository: ad-m/feed-reader
2021-09-11T00:23:48.8940477Z   token: ***
2021-09-11T00:23:48.8940844Z   ssh-strict: true
2021-09-11T00:23:48.8941288Z   persist-credentials: true
2021-09-11T00:23:48.8941730Z   clean: true
2021-09-11T00:23:48.8942078Z   fetch-depth: 1
2021-09-11T00:23:48.8942436Z   lfs: false
2021-09-11T00:23:48.8942781Z   submodules: false
2021-09-11T00:23:48.8943154Z ##[endgroup]
2021-09-11T00:23:49.4990046Z Syncing repository: ad-m/feed-reader
2021-09-11T00:23:49.5022920Z ##[group]Getting Git version info
2021-09-11T00:23:49.5024396Z Working directory is '/home/runner/work/feed-reader/feed-reader'
2021-09-11T00:23:49.5032462Z [command]/usr/bin/git version
2021-09-11T00:23:49.5033055Z git version 2.33.0
2021-09-11T00:23:49.5035289Z ##[endgroup]
2021-09-11T00:23:49.5036141Z Deleting the contents of '/home/runner/work/feed-reader/feed-reader'
2021-09-11T00:23:49.5038396Z ##[group]Initializing the repository
2021-09-11T00:23:49.5039773Z [command]/usr/bin/git init /home/runner/work/feed-reader/feed-reader
2021-09-11T00:23:49.5041542Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-09-11T00:23:49.5055933Z hint: is subject to change. To configure the initial branch name to use in all
2021-09-11T00:23:49.5072225Z hint: of your new repositories, which will suppress this warning, call:
2021-09-11T00:23:49.5073102Z hint: 
2021-09-11T00:23:49.5074163Z hint: 	git config --global init.defaultBranch <name>
2021-09-11T00:23:49.5074925Z hint: 
2021-09-11T00:23:49.5075936Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-09-11T00:23:49.5077062Z hint: 'development'. The just-created branch can be renamed via this command:
2021-09-11T00:23:49.5077804Z hint: 
2021-09-11T00:23:49.5078516Z hint: 	git branch -m <name>
2021-09-11T00:23:49.5079575Z Initialized empty Git repository in /home/runner/work/feed-reader/feed-reader/.git/
2021-09-11T00:23:49.5081192Z [command]/usr/bin/git remote add origin https://github.com/ad-m/feed-reader
2021-09-11T00:23:49.5082607Z ##[endgroup]
2021-09-11T00:23:49.5083909Z ##[group]Disabling automatic garbage collection
2021-09-11T00:23:49.5085101Z [command]/usr/bin/git config --local gc.auto 0
2021-09-11T00:23:49.5086297Z ##[endgroup]
2021-09-11T00:23:49.5089185Z ##[group]Setting up auth
2021-09-11T00:23:49.5090222Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-09-11T00:23:49.5092011Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-09-11T00:23:49.5093803Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-09-11T00:23:49.5095875Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-09-11T00:23:49.5097882Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-09-11T00:23:49.5099425Z ##[endgroup]
2021-09-11T00:23:49.5100629Z ##[group]Fetching the repository
2021-09-11T00:23:49.5102796Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +76fe50020339cca181136b57965f229c648c9d32:refs/remotes/origin/main
2021-09-11T00:23:49.5104178Z remote: Enumerating objects: 9, done.        
2021-09-11T00:23:49.5104877Z remote: Counting objects:  11% (1/9)        
2021-09-11T00:23:49.5105571Z remote: Counting objects:  22% (2/9)        
2021-09-11T00:23:49.5106223Z remote: Counting objects:  33% (3/9)        
2021-09-11T00:23:49.5107636Z remote: Counting objects:  44% (4/9)        
2021-09-11T00:23:49.5108332Z remote: Counting objects:  55% (5/9)        
2021-09-11T00:23:49.5109265Z remote: Counting objects:  66% (6/9)        
2021-09-11T00:23:49.5110018Z remote: Counting objects:  77% (7/9)        
2021-09-11T00:23:49.5110699Z remote: Counting objects:  88% (8/9)        
2021-09-11T00:23:49.5111423Z remote: Counting objects: 100% (9/9)        
2021-09-11T00:23:49.5112133Z remote: Counting objects: 100% (9/9), done.        
2021-09-11T00:23:49.5112890Z remote: Compressing objects:  16% (1/6)        
2021-09-11T00:23:49.5113636Z remote: Compressing objects:  33% (2/6)        
2021-09-11T00:23:49.5114361Z remote: Compressing objects:  50% (3/6)        
2021-09-11T00:23:49.5115101Z remote: Compressing objects:  66% (4/6)        
2021-09-11T00:23:49.5115843Z remote: Compressing objects:  83% (5/6)        
2021-09-11T00:23:49.5116563Z remote: Compressing objects: 100% (6/6)        
2021-09-11T00:23:49.5117329Z remote: Compressing objects: 100% (6/6), done.        
2021-09-11T00:23:49.5118633Z remote: Total 9 (delta 0), reused 4 (delta 0), pack-reused 0        
2021-09-11T00:23:49.5119685Z From https://github.com/ad-m/feed-reader
2021-09-11T00:23:49.5120793Z  * [new ref]         76fe50020339cca181136b57965f229c648c9d32 -> origin/main
2021-09-11T00:23:49.5122076Z ##[endgroup]
2021-09-11T00:23:49.5123214Z ##[group]Determining the checkout info
2021-09-11T00:23:49.5124598Z ##[endgroup]
2021-09-11T00:23:49.5125892Z ##[group]Checking out the ref
2021-09-11T00:23:49.5126925Z [command]/usr/bin/git checkout --progress --force -B main refs/remotes/origin/main
2021-09-11T00:23:49.5127899Z Switched to a new branch 'main'
2021-09-11T00:23:49.5128812Z Branch 'main' set up to track remote branch 'main' from 'origin'.
2021-09-11T00:23:49.5129983Z ##[endgroup]
2021-09-11T00:23:49.5130747Z [command]/usr/bin/git log -1 --format='%H'
2021-09-11T00:23:49.5131662Z '76fe50020339cca181136b57965f229c648c9d32'
2021-09-11T00:23:49.5268462Z ##[group]Run actions/[email protected]
2021-09-11T00:23:49.5268961Z with:
2021-09-11T00:23:49.5269351Z   node-version: 16
2021-09-11T00:23:49.5269809Z   always-auth: false
2021-09-11T00:23:49.5270395Z   check-latest: false
2021-09-11T00:23:49.5271312Z   token: ***
2021-09-11T00:23:49.5271709Z ##[endgroup]
2021-09-11T00:23:50.2943322Z Attempting to download 16...
2021-09-11T00:23:50.2949518Z Acquiring 16.9.0 - x64 from https://github.com/actions/node-versions/releases/download/16.9.0-1212244385/node-16.9.0-linux-x64.tar.gz
2021-09-11T00:23:50.4882386Z Extracting ...
2021-09-11T00:23:50.5025705Z [command]/usr/bin/tar xz --strip 1 --warning=no-unknown-keyword -C /home/runner/work/_temp/9d19923f-26f9-47a8-a2b7-12b6fb4ec215 -f /home/runner/work/_temp/bb417eb5-f2c4-41cd-a351-f68a20c64d86
2021-09-11T00:23:51.4086368Z Adding to the cache ...
2021-09-11T00:23:52.3825450Z Done
2021-09-11T00:23:52.3970614Z ##[group]Run npm i
2021-09-11T00:23:52.3971116Z �[36;1mnpm i�[0m
2021-09-11T00:23:52.4014889Z shell: /usr/bin/bash -e {0}
2021-09-11T00:23:52.4015378Z ##[endgroup]
2021-09-11T00:23:54.7269530Z 
2021-09-11T00:23:54.7272518Z added 32 packages, and audited 33 packages in 2s
2021-09-11T00:23:54.7273750Z 
2021-09-11T00:23:54.7274818Z 12 packages are looking for funding
2021-09-11T00:23:54.7275984Z   run `npm fund` for details
2021-09-11T00:23:54.7278876Z 
2021-09-11T00:23:54.7279813Z found 0 vulnerabilities
2021-09-11T00:23:54.7412883Z ##[group]Run npm run build
2021-09-11T00:23:54.7413407Z �[36;1mnpm run build�[0m
2021-09-11T00:23:54.7452731Z shell: /usr/bin/bash -e {0}
2021-09-11T00:23:54.7453182Z ##[endgroup]
2021-09-11T00:23:55.0395132Z 
2021-09-11T00:23:55.0397393Z > [email protected] build
2021-09-11T00:23:55.0398566Z > osmosfeed
2021-09-11T00:23:55.0399099Z 
2021-09-11T00:23:55.1592967Z [main] Starting build using cli version 1.11.0
2021-09-11T00:23:55.1610660Z [system-file] Config: /home/runner/work/feed-reader/feed-reader/osmosfeed.yaml
2021-09-11T00:23:55.1619389Z [system-file] Local cache: undefined
2021-09-11T00:23:55.1624282Z [system-file] Template: /home/runner/work/feed-reader/feed-reader/node_modules/@osmoscraft/osmosfeed/bin/system-templates/index.hbs
2021-09-11T00:23:55.1641521Z [system-file] System static: /home/runner/work/feed-reader/feed-reader/node_modules/@osmoscraft/osmosfeed/bin/system-static/favicon.ico
2021-09-11T00:23:55.1647538Z [system-file] System template static: /home/runner/work/feed-reader/feed-reader/node_modules/@osmoscraft/osmosfeed/bin/system-static/index.css
2021-09-11T00:23:55.1650924Z [system-file] System template static: /home/runner/work/feed-reader/feed-reader/node_modules/@osmoscraft/osmosfeed/bin/system-static/index.js
2021-09-11T00:23:55.1719554Z [load-config] Effective config:  {
2021-09-11T00:23:55.1720413Z   sources: [
2021-09-11T00:23:55.1721613Z     { href: 'https://github.com/osmoscraft/osmosfeed/releases.atom' },
2021-09-11T00:23:55.1723023Z     { href: 'https://cloudblog.withgoogle.com/rss/' },
2021-09-11T00:23:55.1724352Z     { href: 'https://news.ycombinator.com/rss' },
2021-09-11T00:23:55.1725777Z     { href: 'https://aws.amazon.com/blogs/aws/feed/' },
2021-09-11T00:23:55.1726921Z     { href: 'https://lwn.net/headlines/newrss' },
2021-09-11T00:23:55.1727971Z     { href: 'http://feeds.feedburner.com/HighScalability' },
2021-09-11T00:23:55.1729111Z     { href: 'https://www.phoronix.com/rss.php' }
2021-09-11T00:23:55.1729744Z   ],
2021-09-11T00:23:55.1730194Z   cacheUrl: null,
2021-09-11T00:23:55.1730737Z   cacheMaxDays: 30,
2021-09-11T00:23:55.1731628Z   siteTitle: 'osmos::feed'
2021-09-11T00:23:55.1732185Z }
2021-09-11T00:23:55.1894024Z [get-cache] Use empty cache
2021-09-11T00:23:55.4504554Z [enrich] 0.27s |   0 cached |   1 new | http://feeds.feedburner.com/HighScalability
2021-09-11T00:23:55.7816607Z /home/runner/work/feed-reader/feed-reader/node_modules/@osmoscraft/osmosfeed/bin/main.js:31625
2021-09-11T00:23:55.7817697Z   const trimmed = input == null ? void 0 : input.trim();
2021-09-11T00:23:55.7818321Z                                                  ^
2021-09-11T00:23:55.7818629Z 
2021-09-11T00:23:55.7819240Z TypeError: input.trim is not a function
2021-09-11T00:23:55.7820745Z     at getNonEmptyStringOrNull (/home/runner/work/feed-reader/feed-reader/node_modules/@osmoscraft/osmosfeed/bin/main.js:31625:50)
2021-09-11T00:23:55.7822699Z     at /home/runner/work/feed-reader/feed-reader/node_modules/@osmoscraft/osmosfeed/bin/main.js:31756:16
2021-09-11T00:23:55.7823604Z     at Array.map (<anonymous>)
2021-09-11T00:23:55.7824846Z     at normalizeFeed (/home/runner/work/feed-reader/feed-reader/node_modules/@osmoscraft/osmosfeed/bin/main.js:31754:23)
2021-09-11T00:23:55.7826709Z     at enrichInternal (/home/runner/work/feed-reader/feed-reader/node_modules/@osmoscraft/osmosfeed/bin/main.js:31669:16)
2021-09-11T00:23:55.7828150Z     at processTicksAndRejections (node:internal/process/task_queues:96:5)
2021-09-11T00:23:55.7829080Z     at async Promise.all (index 1)
2021-09-11T00:23:55.7830419Z     at async run (/home/runner/work/feed-reader/feed-reader/node_modules/@osmoscraft/osmosfeed/bin/main.js:31875:27)
2021-09-11T00:23:55.8214108Z ##[error]Process completed with exit code 1.
2021-09-11T00:23:55.8321922Z Post job cleanup.
2021-09-11T00:23:55.9366195Z [command]/usr/bin/git version
2021-09-11T00:23:55.9411282Z git version 2.33.0
2021-09-11T00:23:55.9456090Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-09-11T00:23:55.9491890Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-09-11T00:23:55.9722201Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-09-11T00:23:55.9738000Z http.https://github.com/.extraheader
2021-09-11T00:23:55.9752634Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
2021-09-11T00:23:55.9777290Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-09-11T00:23:56.0222703Z Cleaning up orphan processes

Any idea why it fails?

Error handling for xml parse error

Describe the bug
Currently, there is no catch and handling for xml parsing error

Bug area (choose one)

  • Site builder: anything broken during in the GitHub action
  • Reader UI: anything broken while you are reading the feed

Expected behavior

  1. The GitHub action should have clear error output.
  2. When one source failed, other sources should still be cached correctly. The existing cache of the failing source be preserved (to avoid data loss). This requires smart cache merging logic.
  3. Ideally, the generated UI should alert the user if one or more of the sources have issues.

Allow users to change the theme

Really love this! Can't wait to see more development and features! I'm sorry if this is a bad question, but is there a way to choose templates/themes for the rss reader? Or is this theme the only one that's available now?

iTunes feed metadata is stripped

I want to retrieve other fields in the RSS XML, especially the itunes:duration. I am currently displaying a MP3 feed.
Maybe a mechanism to add any given fields would be wonderful.

build error aftermodified osmosfeed.yaml when Deploy to Github pages: Permission to <xxxx/xxx>.git denied to github-actions[bot]

Describe the bug

Build Error

build error aftermodified osmosfeed.yaml when Deploy to Github pages: Permission to <xxxx/xxx>.git denied to github-actions[bot]

Push the commit or tag
  /usr/bin/git push origin gh-pages
   remote: Permission to xxx/xxx.git denied to github-actions[bot].
  fatal: unable to access 'https://github.com/xxx/xxx.git/': The requested URL returned error: 403
  Error: Action failed with "The process '/usr/bin/git' failed with exit code 128"

Bug area (choose one)

  • [ x ] Site builder: anything broken during in the GitHub action
  • Reader UI: anything broken while you are reading the feed

To reproduce the bug

2022-05-12T09:00:12.3575030Z Requested labels: ubuntu-latest
2022-05-12T09:00:12.3575077Z Job defined at: hjb2722404/newsrss/.github/workflows/update-feed.yaml@refs/heads/main
2022-05-12T09:00:12.3575099Z Waiting for a runner to pick up this job...
2022-05-12T09:00:12.7981343Z Job is waiting for a hosted runner to come online.
2022-05-12T09:00:15.9436167Z Job is about to start running on the hosted runner: Hosted Agent (hosted)
2022-05-12T09:00:17.7277271Z Current runner version: '2.291.1'
2022-05-12T09:00:17.7303818Z ##[group]Operating System
2022-05-12T09:00:17.7304456Z Ubuntu
2022-05-12T09:00:17.7304780Z 20.04.4
2022-05-12T09:00:17.7305017Z LTS
2022-05-12T09:00:17.7305316Z ##[endgroup]
2022-05-12T09:00:17.7305691Z ##[group]Virtual Environment
2022-05-12T09:00:17.7306040Z Environment: ubuntu-20.04
2022-05-12T09:00:17.7306378Z Version: 20220503.1
2022-05-12T09:00:17.7306917Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20220503.1/images/linux/Ubuntu2004-Readme.md
2022-05-12T09:00:17.7307592Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20220503.1
2022-05-12T09:00:17.7308044Z ##[endgroup]
2022-05-12T09:00:17.7308416Z ##[group]Virtual Environment Provisioner
2022-05-12T09:00:17.7308799Z 1.0.0.0-main-20220421-1
2022-05-12T09:00:17.7309076Z ##[endgroup]
2022-05-12T09:00:17.7309763Z ##[group]GITHUB_TOKEN Permissions
2022-05-12T09:00:17.7310288Z Contents: read
2022-05-12T09:00:17.7310708Z Metadata: read
2022-05-12T09:00:17.7311118Z ##[endgroup]
2022-05-12T09:00:17.7314741Z Secret source: Actions
2022-05-12T09:00:17.7315200Z Prepare workflow directory
2022-05-12T09:00:17.8144184Z Prepare all required actions
2022-05-12T09:00:17.8328436Z Getting action download info
2022-05-12T09:00:18.0407697Z Download action repository 'actions/checkout@v2' (SHA:7884fcad6b5d53d10323aee724dc68d8b9096a2e)
2022-05-12T09:00:18.3762466Z Download action repository 'actions/[email protected]' (SHA:c46424eee26de4078d34105d3de3cc4992202b1e)
2022-05-12T09:00:18.6525402Z Download action repository 'peaceiris/actions-gh-pages@v3' (SHA:068dc23d9710f1ba62e86896f84735d869951305)
2022-05-12T09:00:19.1175150Z ##[group]Run actions/checkout@v2
2022-05-12T09:00:19.1175446Z with:
2022-05-12T09:00:19.1175795Z   repository: hjb2722404/newsrss
2022-05-12T09:00:19.1176260Z   token: ***
2022-05-12T09:00:19.1176459Z   ssh-strict: true
2022-05-12T09:00:19.1176712Z   persist-credentials: true
2022-05-12T09:00:19.1176949Z   clean: true
2022-05-12T09:00:19.1177160Z   fetch-depth: 1
2022-05-12T09:00:19.1177367Z   lfs: false
2022-05-12T09:00:19.1177569Z   submodules: false
2022-05-12T09:00:19.1177796Z   set-safe-directory: true
2022-05-12T09:00:19.1178030Z ##[endgroup]
2022-05-12T09:00:19.3499811Z Syncing repository: hjb2722404/newsrss
2022-05-12T09:00:19.3501504Z ##[group]Getting Git version info
2022-05-12T09:00:19.3502028Z Working directory is '/home/runner/work/newsrss/newsrss'
2022-05-12T09:00:19.3502560Z [command]/usr/bin/git version
2022-05-12T09:00:19.3620489Z git version 2.36.0
2022-05-12T09:00:19.3621878Z ##[endgroup]
2022-05-12T09:00:19.3655881Z Temporarily overriding HOME='/home/runner/work/_temp/7c258a8e-3408-4da2-9fbe-cfb2177d5cd6' before making global git config changes
2022-05-12T09:00:19.3656407Z Adding repository directory to the temporary git global config as a safe directory
2022-05-12T09:00:19.3656954Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/newsrss/newsrss
2022-05-12T09:00:19.3710479Z Deleting the contents of '/home/runner/work/newsrss/newsrss'
2022-05-12T09:00:19.3711339Z ##[group]Initializing the repository
2022-05-12T09:00:19.3711656Z [command]/usr/bin/git init /home/runner/work/newsrss/newsrss
2022-05-12T09:00:19.3753618Z hint: Using 'master' as the name for the initial branch. This default branch name
2022-05-12T09:00:19.3754207Z hint: is subject to change. To configure the initial branch name to use in all
2022-05-12T09:00:19.3754702Z hint: of your new repositories, which will suppress this warning, call:
2022-05-12T09:00:19.3755068Z hint: 
2022-05-12T09:00:19.3756659Z hint: 	git config --global init.defaultBranch <name>
2022-05-12T09:00:19.3757216Z hint: 
2022-05-12T09:00:19.3758499Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2022-05-12T09:00:19.3758975Z hint: 'development'. The just-created branch can be renamed via this command:
2022-05-12T09:00:19.3759269Z hint: 
2022-05-12T09:00:19.3759535Z hint: 	git branch -m <name>
2022-05-12T09:00:19.3762142Z Initialized empty Git repository in /home/runner/work/newsrss/newsrss/.git/
2022-05-12T09:00:19.3807352Z [command]/usr/bin/git remote add origin https://github.com/hjb2722404/newsrss
2022-05-12T09:00:19.3845693Z ##[endgroup]
2022-05-12T09:00:19.3846489Z ##[group]Disabling automatic garbage collection
2022-05-12T09:00:19.3850381Z [command]/usr/bin/git config --local gc.auto 0
2022-05-12T09:00:19.3880891Z ##[endgroup]
2022-05-12T09:00:19.3881685Z ##[group]Setting up auth
2022-05-12T09:00:19.3888833Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2022-05-12T09:00:19.3922512Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2022-05-12T09:00:19.4275908Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2022-05-12T09:00:19.4301049Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2022-05-12T09:00:19.4527739Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2022-05-12T09:00:19.4559326Z ##[endgroup]
2022-05-12T09:00:19.4559929Z ##[group]Fetching the repository
2022-05-12T09:00:19.4569700Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +b5836d1189c8ee562e091ebb5010362147dd67d2:refs/remotes/origin/main
2022-05-12T09:00:19.6442506Z remote: Enumerating objects: 9, done.        
2022-05-12T09:00:19.6454821Z remote: Counting objects:  11% (1/9)        
2022-05-12T09:00:19.6455542Z remote: Counting objects:  22% (2/9)        
2022-05-12T09:00:19.6456274Z remote: Counting objects:  33% (3/9)        
2022-05-12T09:00:19.6456734Z remote: Counting objects:  44% (4/9)        
2022-05-12T09:00:19.6457397Z remote: Counting objects:  55% (5/9)        
2022-05-12T09:00:19.6457855Z remote: Counting objects:  66% (6/9)        
2022-05-12T09:00:19.6458494Z remote: Counting objects:  77% (7/9)        
2022-05-12T09:00:19.6458945Z remote: Counting objects:  88% (8/9)        
2022-05-12T09:00:19.6459585Z remote: Counting objects: 100% (9/9)        
2022-05-12T09:00:19.6460039Z remote: Counting objects: 100% (9/9), done.        
2022-05-12T09:00:19.6460693Z remote: Compressing objects:  16% (1/6)        
2022-05-12T09:00:19.6461157Z remote: Compressing objects:  33% (2/6)        
2022-05-12T09:00:19.6461803Z remote: Compressing objects:  50% (3/6)        
2022-05-12T09:00:19.6462244Z remote: Compressing objects:  66% (4/6)        
2022-05-12T09:00:19.6462897Z remote: Compressing objects:  83% (5/6)        
2022-05-12T09:00:19.6463351Z remote: Compressing objects: 100% (6/6)        
2022-05-12T09:00:19.6464008Z remote: Compressing objects: 100% (6/6), done.        
2022-05-12T09:00:19.6464891Z remote: Total 9 (delta 0), reused 4 (delta 0), pack-reused 0        
2022-05-12T09:00:19.6533020Z From https://github.com/hjb2722404/newsrss
2022-05-12T09:00:19.6533885Z  * [new ref]         b5836d1189c8ee562e091ebb5010362147dd67d2 -> origin/main
2022-05-12T09:00:19.6558530Z ##[endgroup]
2022-05-12T09:00:19.6559344Z ##[group]Determining the checkout info
2022-05-12T09:00:19.6560999Z ##[endgroup]
2022-05-12T09:00:19.6561613Z ##[group]Checking out the ref
2022-05-12T09:00:19.6565853Z [command]/usr/bin/git checkout --progress --force -B main refs/remotes/origin/main
2022-05-12T09:00:19.6623713Z Switched to a new branch 'main'
2022-05-12T09:00:19.6627931Z branch 'main' set up to track 'origin/main'.
2022-05-12T09:00:19.6631525Z ##[endgroup]
2022-05-12T09:00:19.6674778Z [command]/usr/bin/git log -1 --format='%H'
2022-05-12T09:00:19.6704547Z 'b5836d1189c8ee562e091ebb5010362147dd67d2'
2022-05-12T09:00:19.7066924Z ##[group]Run actions/[email protected]
2022-05-12T09:00:19.7067197Z with:
2022-05-12T09:00:19.7067406Z   node-version: 16
2022-05-12T09:00:19.7067614Z   always-auth: false
2022-05-12T09:00:19.7067967Z   check-latest: false
2022-05-12T09:00:19.7068367Z   token: ***
2022-05-12T09:00:19.7068556Z ##[endgroup]
2022-05-12T09:00:19.7993157Z Found in cache @ /opt/hostedtoolcache/node/16.15.0/x64
2022-05-12T09:00:19.8121336Z ##[group]Run npm i
2022-05-12T09:00:19.8121636Z �[36;1mnpm i�[0m
2022-05-12T09:00:19.8177933Z shell: /usr/bin/bash -e {0}
2022-05-12T09:00:19.8178218Z ##[endgroup]
2022-05-12T09:00:22.1701587Z 
2022-05-12T09:00:22.1710220Z added 32 packages, and audited 33 packages in 2s
2022-05-12T09:00:22.1711069Z 
2022-05-12T09:00:22.1711452Z 12 packages are looking for funding
2022-05-12T09:00:22.1711840Z   run `npm fund` for details
2022-05-12T09:00:22.1712067Z 
2022-05-12T09:00:22.1712265Z found 0 vulnerabilities
2022-05-12T09:00:22.1817640Z ##[group]Run npm run build
2022-05-12T09:00:22.1817924Z �[36;1mnpm run build�[0m
2022-05-12T09:00:22.1869818Z shell: /usr/bin/bash -e {0}
2022-05-12T09:00:22.1870063Z ##[endgroup]
2022-05-12T09:00:22.4822630Z 
2022-05-12T09:00:22.4824188Z > [email protected] build
2022-05-12T09:00:22.4825362Z > osmosfeed
2022-05-12T09:00:22.4825654Z 
2022-05-12T09:00:22.5909370Z [main] Starting build using cli version 1.14.4
2022-05-12T09:00:22.5973576Z [system-file] Config: /home/runner/work/newsrss/newsrss/osmosfeed.yaml
2022-05-12T09:00:22.5974402Z [system-file] Local cache: undefined
2022-05-12T09:00:22.5983059Z [system-file] Template: /home/runner/work/newsrss/newsrss/node_modules/@osmoscraft/osmosfeed/bin/system-templates/index.hbs
2022-05-12T09:00:22.5993690Z [system-file] System static: /home/runner/work/newsrss/newsrss/node_modules/@osmoscraft/osmosfeed/bin/system-static/favicon.ico
2022-05-12T09:00:22.5994900Z [system-file] System template static: /home/runner/work/newsrss/newsrss/node_modules/@osmoscraft/osmosfeed/bin/system-static/index.css
2022-05-12T09:00:22.5996374Z [system-file] System template static: /home/runner/work/newsrss/newsrss/node_modules/@osmoscraft/osmosfeed/bin/system-static/index.js
2022-05-12T09:00:22.6044791Z [load-config] Effective config:  {
2022-05-12T09:00:22.6045264Z   sources: [
2022-05-12T09:00:22.6046338Z     { href: 'https://github.com/osmoscraft/osmosfeed/releases.atom' },
2022-05-12T09:00:22.6047046Z     { href: 'http://feeds.bbci.co.uk/news/world/rss.xml' },
2022-05-12T09:00:22.6047837Z     {
2022-05-12T09:00:22.6048608Z       href: 'https://www.nytimes.com/svc/collections/v1/publish/https://www.nytimes.com/section/world/rss.xml'
2022-05-12T09:00:22.6049479Z     }
2022-05-12T09:00:22.6049812Z   ],
2022-05-12T09:00:22.6050723Z   cacheUrl: 'https://hjb2722404.github.io/newsrss/cache.json',
2022-05-12T09:00:22.6051181Z   cacheMaxDays: 30,
2022-05-12T09:00:22.6052074Z   siteTitle: 'osmos::feed',
2022-05-12T09:00:22.6052462Z   timezone: null,
2022-05-12T09:00:22.6053172Z   timezoneOffset: 0,
2022-05-12T09:00:22.6053699Z   githubServerUrl: 'https://github.com',
2022-05-12T09:00:22.6054587Z   githubRepository: 'hjb2722404/newsrss',
2022-05-12T09:00:22.6055059Z   githubRunId: '2312329148'
2022-05-12T09:00:22.6055768Z }
2022-05-12T09:00:22.6056523Z [get-cache] Use remote cache: https://hjb2722404.github.io/newsrss/cache.json
2022-05-12T09:00:22.6930500Z [discover-cache] Pre-build cache restored: https://hjb2722404.github.io/newsrss/cache.json
2022-05-12T09:00:25.2871204Z [enrich] 2.59s |   0 cached |   0 new | https://github.com/osmoscraft/osmosfeed/releases.atom
2022-05-12T09:00:25.3462510Z [enrich] 2.65s |   0 cached |  10 new | https://www.nytimes.com/svc/collections/v1/publish/https://www.nytimes.com/section/world/rss.xml
2022-05-12T09:00:25.7199658Z [enrich] 3.02s |   0 cached |  28 new | http://feeds.bbci.co.uk/news/world/rss.xml
2022-05-12T09:00:25.7203497Z [register-template] Registered index: /home/runner/work/newsrss/newsrss/node_modules/@osmoscraft/osmosfeed/bin/system-templates/index.hbs
2022-05-12T09:00:25.7756749Z [write-file] Wrote: /home/runner/work/newsrss/newsrss/public/index.html
2022-05-12T09:00:25.7761619Z [write-file] Wrote: /home/runner/work/newsrss/newsrss/public/feed.atom
2022-05-12T09:00:25.7895423Z [copy-static] Copied: /home/runner/work/newsrss/newsrss/node_modules/@osmoscraft/osmosfeed/bin/system-static/index.css
2022-05-12T09:00:25.7899737Z [copy-static] Copied: /home/runner/work/newsrss/newsrss/node_modules/@osmoscraft/osmosfeed/bin/system-static/index.js
2022-05-12T09:00:25.7907716Z [copy-static] Copied: /home/runner/work/newsrss/newsrss/node_modules/@osmoscraft/osmosfeed/bin/system-static/favicon.ico
2022-05-12T09:00:25.7913258Z [cache] Post-build cache generated by cli 1.14.4
2022-05-12T09:00:25.7923932Z [cache] Post-build cache written: /home/runner/work/newsrss/newsrss/public/cache.json
2022-05-12T09:00:25.7945949Z [main] Finished build in 3.21 seconds
2022-05-12T09:00:25.8203475Z ##[group]Run peaceiris/actions-gh-pages@v3
2022-05-12T09:00:25.8203819Z with:
2022-05-12T09:00:25.8204596Z   github_token: ***
2022-05-12T09:00:25.8204919Z   publish_dir: ./public
2022-05-12T09:00:25.8205300Z   publish_branch: gh-pages
2022-05-12T09:00:25.8205770Z   allow_empty_commit: false
2022-05-12T09:00:25.8206111Z   keep_files: false
2022-05-12T09:00:25.8206347Z   force_orphan: false
2022-05-12T09:00:25.8206639Z   enable_jekyll: false
2022-05-12T09:00:25.8206975Z   disable_nojekyll: false
2022-05-12T09:00:25.8207223Z   exclude_assets: .github
2022-05-12T09:00:25.8207533Z ##[endgroup]
2022-05-12T09:00:25.8970932Z [INFO] Usage https://github.com/peaceiris/actions-gh-pages#readme
2022-05-12T09:00:25.8982026Z ##[group]Dump inputs
2022-05-12T09:00:25.8985829Z [INFO] GithubToken: true
2022-05-12T09:00:25.8986612Z [INFO] PublishBranch: gh-pages
2022-05-12T09:00:25.8987339Z [INFO] PublishDir: ./public
2022-05-12T09:00:25.8993771Z [INFO] DestinationDir: 
2022-05-12T09:00:25.8994298Z [INFO] ExternalRepository: 
2022-05-12T09:00:25.8994699Z [INFO] AllowEmptyCommit: false
2022-05-12T09:00:25.9084709Z [INFO] KeepFiles: false
2022-05-12T09:00:25.9087225Z [INFO] ForceOrphan: false
2022-05-12T09:00:25.9089517Z [INFO] UserName: 
2022-05-12T09:00:25.9091790Z [INFO] UserEmail: 
2022-05-12T09:00:25.9094076Z [INFO] CommitMessage: 
2022-05-12T09:00:25.9096324Z [INFO] FullCommitMessage: 
2022-05-12T09:00:25.9098632Z [INFO] TagName: 
2022-05-12T09:00:25.9100929Z [INFO] TagMessage: 
2022-05-12T09:00:25.9103294Z [INFO] EnableJekyll (DisableNoJekyll): false
2022-05-12T09:00:25.9105591Z [INFO] CNAME: 
2022-05-12T09:00:25.9107853Z [INFO] ExcludeAssets .github
2022-05-12T09:00:25.9109995Z 
2022-05-12T09:00:25.9112523Z ##[endgroup]
2022-05-12T09:00:25.9115009Z ##[group]Setup auth token
2022-05-12T09:00:25.9117253Z [INFO] setup GITHUB_TOKEN
2022-05-12T09:00:25.9147308Z ##[endgroup]
2022-05-12T09:00:25.9151069Z ##[group]Prepare publishing assets
2022-05-12T09:00:25.9158367Z [INFO] ForceOrphan: false
2022-05-12T09:00:25.9163218Z [command]/usr/bin/git clone --depth=1 --single-branch --branch gh-pages ***github.com/hjb2722404/newsrss.git /home/runner/actions_github_pages_1652346025900
2022-05-12T09:00:25.9210451Z Cloning into '/home/runner/actions_github_pages_1652346025900'...
2022-05-12T09:00:26.1465825Z [INFO] clean up /home/runner/actions_github_pages_1652346025900
2022-05-12T09:00:26.1468828Z [INFO] chdir /home/runner/actions_github_pages_1652346025900
2022-05-12T09:00:26.1486954Z [command]/usr/bin/git rm -r --ignore-unmatch *
2022-05-12T09:00:26.1541231Z rm '.nojekyll'
2022-05-12T09:00:26.1541864Z rm 'cache.json'
2022-05-12T09:00:26.1542431Z rm 'favicon.ico'
2022-05-12T09:00:26.1543169Z rm 'feed.atom'
2022-05-12T09:00:26.1543690Z rm 'index.css'
2022-05-12T09:00:26.1544198Z rm 'index.html'
2022-05-12T09:00:26.1544584Z rm 'index.js'
2022-05-12T09:00:26.1558876Z [INFO] chdir /home/runner/actions_github_pages_1652346025900
2022-05-12T09:00:26.1559555Z [INFO] prepare publishing assets
2022-05-12T09:00:26.1560323Z [INFO] copy /home/runner/work/newsrss/newsrss/public to /home/runner/actions_github_pages_1652346025900
2022-05-12T09:00:26.1648605Z cp: no such file or directory: /home/runner/work/newsrss/newsrss/public/.*
2022-05-12T09:00:26.1654643Z [INFO] delete excluded assets
2022-05-12T09:00:26.1713456Z rm: no paths given
2022-05-12T09:00:26.1718514Z [INFO] Created /home/runner/actions_github_pages_1652346025900/.nojekyll
2022-05-12T09:00:26.1722508Z ##[endgroup]
2022-05-12T09:00:26.1725365Z ##[group]Setup Git config
2022-05-12T09:00:26.1741029Z [command]/usr/bin/git remote rm origin
2022-05-12T09:00:26.1799680Z [command]/usr/bin/git remote add origin ***github.com/hjb2722404/newsrss.git
2022-05-12T09:00:26.1859201Z [command]/usr/bin/git add --all
2022-05-12T09:00:26.1958943Z [command]/usr/bin/git config user.name hjb2722404
2022-05-12T09:00:26.2015249Z [command]/usr/bin/git config user.email [email protected]
2022-05-12T09:00:26.2046043Z ##[endgroup]
2022-05-12T09:00:26.2047023Z ##[group]Create a commit
2022-05-12T09:00:26.2071176Z [command]/usr/bin/git commit -m deploy: b5836d1189c8ee562e091ebb5010362147dd67d2
2022-05-12T09:00:26.2157361Z [gh-pages 641f0d6] deploy: b5836d1189c8ee562e091ebb5010362147dd67d2
2022-05-12T09:00:26.2159456Z  5 files changed, 2027 insertions(+), 1940 deletions(-)
2022-05-12T09:00:26.2162094Z  rewrite cache.json (96%)
2022-05-12T09:00:26.2162602Z  rewrite feed.atom (92%)
2022-05-12T09:00:26.2163124Z  rewrite index.html (99%)
2022-05-12T09:00:26.2163966Z  rewrite index.js (97%)
2022-05-12T09:00:26.2177066Z ##[endgroup]
2022-05-12T09:00:26.2177780Z ##[group]Push the commit or tag
2022-05-12T09:00:26.2198820Z [command]/usr/bin/git push origin gh-pages
2022-05-12T09:00:26.3721125Z remote: Permission to hjb2722404/newsrss.git denied to github-actions[bot].
2022-05-12T09:00:26.3726847Z fatal: unable to access 'https://github.com/hjb2722404/newsrss.git/': The requested URL returned error: 403
2022-05-12T09:00:26.3786374Z ##[error]Action failed with "The process '/usr/bin/git' failed with exit code 128"
2022-05-12T09:00:26.4016272Z Post job cleanup.
2022-05-12T09:00:26.5305219Z [command]/usr/bin/git version
2022-05-12T09:00:26.5352879Z git version 2.36.0
2022-05-12T09:00:26.5391638Z Temporarily overriding HOME='/home/runner/work/_temp/ae4b4c65-174b-4a31-a343-30c13446342b' before making global git config changes
2022-05-12T09:00:26.5392389Z Adding repository directory to the temporary git global config as a safe directory
2022-05-12T09:00:26.5395861Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/newsrss/newsrss
2022-05-12T09:00:26.5437536Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2022-05-12T09:00:26.5472921Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2022-05-12T09:00:26.5740888Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2022-05-12T09:00:26.5771053Z http.https://github.com/.extraheader
2022-05-12T09:00:26.5779959Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
2022-05-12T09:00:26.5817557Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2022-05-12T09:00:26.6312320Z Cleaning up orphan processes

Expected behavior
build success

README url error

Describe the bug
404 url

Bug area (choose one)
here

For example, if you deploy to Netlify,

Scripts is not copying CNAME when generating gh-pages branch

Describe the bug
Github Pages with custom domains needs CNAME

Bug area (choose one)

  • Site builder: anything broken during in the GitHub action
  • Reader UI: anything broken while you are reading the feed

To reproduce the bug

Expected behavior
When running osmofeed, if CNAME is found, copy to gh-pages branch

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
Add any other context about the problem here.

"[download] Limit reached for max number of failed attempts`"

Hi,

I met a problem "[download] Limit reached for max number of failed attempts`" sometimes. I think it is because the RSS source is not stable enough. Is there any way to increase the max number of attempts? Or any other method to deal with this error?

Thank you very much,
Xilock

[get-cache] Use remote cache: https://molakirlee.github.io/feed/cache.json
[discover-cache] Pre-build cache restored: https://molakirlee.github.io/feed/cache.json
[enrich] 0.16s |  30 cached |   0 new | https://rsshub.app/geekpark/breakingnews
[enrich] 3.85s |  36 cached |   1 new | https://sspai.com/feed
[download] 2 attempts left, error download https://rsshub.app/wallstreetcn/news/global ECONNABORTED
[download] 2 attempts left, error download https://rsshub.app/bbc/world-asia ECONNABORTED
[download] 2 attempts left, error download https://rsshub.app/wallstreetcn/live ECONNABORTED
[download] 1 attempts left, error download https://rsshub.app/wallstreetcn/news/global ECONNABORTED
[download] 1 attempts left, error download https://rsshub.app/bbc/world-asia ECONNABORTED
[download] 1 attempts left, error download https://rsshub.app/wallstreetcn/live ECONNABORTED
[download] 0 attempts left, error download https://rsshub.app/wallstreetcn/news/global ECONNABORTED
/home/runner/work/feed/feed/node_modules/@osmoscraft/osmosfeed/bin/main.js:31614
      throw new Error(`[download] Limit reached for max number of failed attempts`);
            ^

Error: [download] Limit reached for max number of failed attempts
    at downloadHelper (/home/runner/work/feed/feed/node_modules/@osmoscraft/osmosfeed/bin/main.js:31614:13)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at runNextTicks (node:internal/process/task_queues:65:3)
    at listOnTimeout (node:internal/timers:526:9)
    at processTimers (node:internal/timers:500:7)
    at async enrichInternal (/home/runner/work/feed/feed/node_modules/@osmoscraft/osmosfeed/bin/main.js:31664:21)
    at async Promise.all (index 2)
    at async run (/home/runner/work/feed/feed/node_modules/@osmoscraft/osmosfeed/bin/main.js:31875:27)
Error: Process completed with exit code 1.

Cannot download RSS caused by "Limit reached for max number of failed attempts"

Discussed in #67

Originally posted by sokomin December 12, 2021
I'm using osmosfeed RSS, but it sometimes occur the following error.

[download] 0 attempts left, error download ...
      throw new Error(`[download] Limit reached for max number of failed attempts`);
            ^

Error: [download] Limit reached for max number of failed attempts
    at downloadHelper (/home/runner/work/RS-RSS/RS-RSS/node_modules/@osmoscraft/osmosfeed/bin/main.js:31974:13)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at async enrichInternal (/home/runner/work/RS-RSS/RS-RSS/node_modules/@osmoscraft/osmosfeed/bin/main.js:32023:21)
    at async Promise.all (index 6)
    at async run (/home/runner/work/RS-RSS/RS-RSS/node_modules/@osmoscraft/osmosfeed/bin/main.js:32229:27)
Error: Process completed with exit code 1.

we can access the RSS link, but the program can't recognize the rss feed.
Some website is OK, but a few site was not accessed.

Can you help me?
When some RSS acquisition stops, the whole build will stop.
If you don't know the cause of the error, I would like to resolve it so that I can get the RSS partially.

Here is the project.
https://github.com/sokomin/RS-RSS/actions

Thanks,

Machine readable output in RSS format

Love this, it would be great to generate a consolidated RSS feed that could be used elsewhere (like my newsletter app, etc, but maybe there’s a better tool to do that)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.