for crawling website
@param $obj : object settings for crawling
base_url : url to use for concating | string
url : the url to crawl | string
keyword: keyword to find | array
tag : specific tag to find | array
downLoad_tag : specific download tag | array
page : no of page to crawl | int
depth : how deep to crawl | int
pagination : attr to get pagination | array
regexp : for filter strings | string
record: name of file to record which files have been downloaded | string
action: just get link or download(only torrent) | string
How to use
in console just type php example1.php
or
in browser path/webspider/example1.php