afcarl / url-summary

Show summary of a large number of URLs in a Jupyter Notebook

url-summary

Show summary of a large number of URLs in a Jupyter Notebook: analyze domains, paths, query keys and values. This is useful if you want to have a quick glance at URLs obtained by crawling.

Installation

Install from PyPI:

pip install url-summary

Usage

import url_summary

url_summary.get_summary(urls)

Will show as a summary for a given list (or iterable) of urls. top_items (20 by default) controls how many top-level items to show, and top_urls (3 by default) sets the number of random urls to show for each top-level item.

Returned object url_summary.UrlSummaryResult is a list subclass with a nice Jupyter Notebook display.

License

License is MIT.

---