danack / sitetool Goto Github PK

Currently the configuration is done as code, such as in this file https://github.com/Danack/SiteTool/blob/master/src/SiteTool/Command/Crawler.php

However that configuration would be much better off in a simple PHP file. The configuration needed to start with is:

• A list of relays, the set of things that process events, which for the crawler command are:
  FetchUrl::class,
  LogResponseIsOk::class,
  CheckResponseIsOk::class,
  CheckContentTypeIsHtml::class,
  ParseHtmlToFindLinks::class,
  ShouldUrlFoundBeFollowed::class,
  LogSkippedLink::class

• (optional) the initial domain.

• (Nice to have) The initial event to be triggered, which in the crawlers case is FoundUrlToFollow