kaushalmeena / sarkari-scraper

A web scraper made to extract results from https://www.sarkariresult.com

[ Project : Sarkari Scrapper ]

[ Synopsis ]

A web scraper made to extract results from government job listing sites.

[ Prerequisities ]

• NodeJS
  • https://nodejs.org/en/download/

[ CLI Usage ]

Supported Domains

• freshersnow.com
• sarkariresult.com
• sarkariresults.info
• sarkariexam.com

Supported Formats

• json
• csv

For job-list

node scrap-job-list.js [flags]

• example

node scrap-job-list.js -d sarkariresult.com

Flags

Flag	Input	Description
-d	domain	Set domain of site from job list to be scrapped (default : sarkariresult.com)
-f	format	Set format of output (default : json)
-o	filename	Set filename of output file, if not used file will not be saved

For job-detail

node scrap-job-detail.js [flags]

• example

node scrap-job-detail.js -u https://www.sarkariresult.com/upsssc/01exam2018.php

Flags

Flag	Input	Description
-u	url	Set url of job detail page (required)
-f	format	Set format of output (default : json)
-o	filename	Set filename of output file, if not used file will not be saved

For scraping

node run-scrapper.js [flags]

• example

node run-scrapper.js -d freshersnow.com -f csv -o output.csv

Flags

Flag	Input	Description
-d	domain	Set domain of site from job list to be scrapped (default : sarkariresult.com)
-f	format	Set format of output (default : json)
-o	filename	Set filename of output file (required)

sarkari-scraper's Issues

Cant Scrape SarkariResult.com

My Command:- node run-scrapper.js -d sarkariresult.com -f json -o output.json

The error I am getting:-

----- null error occured!
TypeError [ERR_INVALID_ARG_TYPE]: The "url" argument must be of type string. Received null
at new NodeError (internal/errors.js:322:7)
at validateString (internal/validators.js:124:11)
at Url.parse (url.js:171:3)
at Object.urlParse [as parse] (url.js:158:13)
at dispatchHttpRequest (/Users/keshavsharma/Desktop/sarkari-scraper/node_modules/axios/lib/adapters/http.js:67:22)
at new Promise ()
at httpAdapter (/Users/keshavsharma/Desktop/sarkari-scraper/node_modules/axios/lib/adapters/http.js:20:10)
at dispatchRequest (/Users/keshavsharma/Desktop/sarkari-scraper/node_modules/axios/lib/core/dispatchRequest.js:59:10)
at processTicksAndRejections (internal/process/task_queues.js:95:5) {
code: 'ERR_INVALID_ARG_TYPE'