Skip to content

thu-pacman/gscholar-citations-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

65 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Google Scholar Citations

Want to know who/which journal has cited your work and compile a list?

This program allows you to retrieve all the citations an author has garnered from other scholars via Google Scholar, to store them in a bib file, and optionally, to download the publicly available PDF files associated with those citations.

Prerequisite

Download

To download, either directly download the zip file, or clone the git repository via command line with:

$ git clone https://github.com/shiqiezi/google-scholar-citations

Basic Usage

Basic command line operation is needed. A very basic usage with defaults will be:

$ python main.py https://scholar.google.com/citations?user=lqyGZpQAAAAJ

More Options

$ python main.py [-h] [--request-interval REQUEST_INTERVAL] [--should-download]
               [--download-dir DOWNLOAD_DIR] [--citation-name CITATION_NAME]
               google_scholar_uri

optional arguments explained:

  --request-interval REQUEST_INTERVAL
                        # Interval (in seconds) between requests to google scholar
  --should-download     # Download PS/PDF files of all citations iff True
  --download-dir DOWNLOAD_DIR
                        # Directory for downloaded citations PDF files
  --citation-name CITATION_NAME
                        # File name for all your citations in BibTex format

positional argument:

  google_scholar_uri    # Your google scholar homepage

###Example

$ python main.py --request-interval=50 --should-download https://scholar.google.com/citations?user=lqyGZpQAAAAJ

Getting Help

$ python main.py -h # show this help message and exit

Avoid Too Many Requests

Crawl the web resposibly. We suggest that users set a large number for the --request-interval. Requesting too frequently may result in a block from Google.

History

18-Sep-2016: Enabled a number of command line options, updated README