arkel23 / literaturereview_arxivsemanticscholarmanual

Colab version for the one that searches only arXiv and SemanticScholar Colab version for the one with manual search

Supporting functions to query from arXiv database and then use that to extract metadata from Semantic Scholar, then possibly do multi-level search based on the references from semantic scholar. Finally, based on papers that were not part of the original search results, the search_manual.py allows to do a recursive SemanticScholar search with manually chosen paper IDs (from their website) to further look for more references not found in the original search. Also constructs some simple plots of papers and citations per year if run on a Jupyter-like environment.

To use just run query.py. Can manually edit the keywords (keyword_list_1 and keyword_list_2) depending on what you're looking for or the level of recursive search by changing max_level argument in semantic_recursive function.

Credit to the creators of the wrappers for the arXiv and Semantic Scholar APIs:

https://github.com/lukasschwab/arxiv.py

https://github.com/danielnsilva/semanticscholar