1000ch / reachable-urls

Check URLs are reachable in text 🕵️

reachable-urls

Check URLs are reachable in text.

Install

$ npm install --save reachable-urls

Usage

CLI

Usage
  $ reachable-urls [<file|glob> ...]

Options
  --compact       Show only not-reachable URLs
  --help          Show help
  --silent        Exit with success always
  --stdin         Check string from stdin
  --version       Show version

JavaScript

import assert from 'assert';
import reachableUrls from 'reachable-urls';

reachableUrls('https://foobarbaz.com https://github.com').then(result => {
  assert.deepEqual(result, {
    'https://github.com': true,
    'https://foobarbaz.com': false
  });
});

License

MIT © Shogo Sensui

reachable-urls's Issues

Recursion seems to not work

I tried to install your module on my blog but the recursion seems to not work as expected:

git clone [email protected]:nfroidure/blog.git
cd blog
npm i
npm run test:urls


> [email protected] test:urls /home/nfroidure/projects/blog
> reachable-urls contents/**/*.md contents/**/*.html


  /home/nfroidure/projects/blog/contents/pages/en/about.md

  /home/nfroidure/projects/blog/contents/pages/en/blog/index.md

  /home/nfroidure/projects/blog/contents/pages/en/index.md

    ✔ https://github.com/nfroidure/blog

  /home/nfroidure/projects/blog/contents/pages/en/projects.md

    ✔ https://www.npmjs.org/
    ✔ http://sumuray.insertafter.com/
    ✔ http://memory.insertafter.com/
    ✔ http://breakit.insertafter.com/
    ✔ http://tank.elitwork.com/
    ✖ http://tripstory.insertafter.com/
    ✔ http://karaoke.insertafter.com/
    ✔ http://hexa.insertafter.com/
    ✔ https://addons.mozilla.org/firefox/addon/kgen
    ✔ https://addons.mozilla.org/firefox/addon/bbcomposer
    ✔ https://github.com/nfroidure/BugMeBack
    ✔ https://addons.mozilla.org/firefox/addon/canimage/
    ✔ https://addons.mozilla.org/thunderbird/addon/caps-killer/
    ✔ https://github.com/nfroidure
    ✔ https://github.com/7Digital
    ✔ https://github.com/SimpliField

  /home/nfroidure/projects/blog/contents/pages/fr/a_propos.md

  /home/nfroidure/projects/blog/contents/pages/fr/blog/index.md

  /home/nfroidure/projects/blog/contents/pages/fr/index.md

    ✔ https://github.com/nfroidure/blog

  /home/nfroidure/projects/blog/contents/pages/fr/projets.md

    ✔ https://www.npmjs.org/
    ✔ http://sumuray.insertafter.com/
    ✔ http://memory.insertafter.com/
    ✔ http://breakit.insertafter.com/
    ✔ http://tank.elitwork.com/
    ✖ http://tripstory.insertafter.com/
    ✔ http://karaoke.insertafter.com/
    ✔ http://hexa.insertafter.com/
    ✔ https://addons.mozilla.org/firefox/addon/kgen
    ✔ https://addons.mozilla.org/firefox/addon/bbcomposer
    ✔ https://github.com/nfroidure/BugMeBack
    ✔ https://addons.mozilla.org/firefox/addon/canimage/
    ✔ https://addons.mozilla.org/thunderbird/addon/caps-killer/
    ✔ http://github.com/nfroidure
    ✔ https://github.com/7Digital
    ✔ https://github.com/SimpliField

  /home/nfroidure/projects/blog/contents/pages/404.html

    ✔ http://media.giphy.com/media/12mPcp41D9a1i0/giphy.gif

  /home/nfroidure/projects/blog/contents/pages/index.html

As you can see, my blog posts seems to not be parsed since they are in a deep directory.

Catch promise errors

You should catch promises errors here and exit with 1:
https://github.com/1000ch/reachable-urls/blob/master/cli.js#L117

Currently when an error happens the process runs indefinitely.

Avoid opening dirs as files

Doing this on my blog:

reachable-urls contents/**

⠋ Checking files(node:19427) UnhandledPromiseRejectionWarning: Unhandled promise rejection (rejection id: 1): Error: EISDIR: illegal operation on a directory, read
⠸ Checking files
⠧ Checking files^C

Fails since your program try to open dirs as files. You should use an option to not list dirs whith your glob dependency. Something like that: https://github.com/nfroidure/metapak/blob/master/src/assets.js#L54

The above errro led to: #1