anshul1004 / countriessearchengine

A search engine built to retrieve geographical information of any country.

CountriesSearchEngine

A search engine built to retrieve geographical information of any country.

Crawling

Apache Nutch is used to crawl the relevant web pages from the 50 seed URLs given.

Indexing

Apache Solr is used to index the crawled web pages. The default page rank model of indexing using solr gives satisfactory results. The results are further improved by implementing and applying HITS algorithm.

User Interface

The results obtained using different indexing methods, different clustering methods and different query expansion methods are compared with the results obtained on the same query using Google and Bing.

Clustering

Both flat clustering (K-means) as well as hierarchical clustering (single-link) is used to group similar web pages together, and improve search results.

Query Expansion

Associative, metric and scalar clustering are used to get the new, modified, enhanced expanded query to improve search results.

For more information on the search engine, refer "Project Report.pdf".

countriessearchengine's Issues

regarding inlinks_webgraph

How did you create inlinks_webgraph?
Can you share the commands for creating inlinks_webgrapI have generated webgrapgh db in apache nutch using command 'bin/nutch webgraph -segmentDir crawl/segments -webgraphdb crawl/webgraphdb'.... It generated three folders in crawl/webgraphdb which are inlinks, outlinks and nodes. Each of those folders contained two binary files like data and index.