TransWikia.com

Is there any APIs for crawling abstract of paper?

Data Science Asked by Alex Gao on January 29, 2021

If I have a very long list of paper names, how could I get abstract of these papers from internet or any database?

The paper names are like “Assessment of Utility in Web Mining for the Domain of Public Health”.

Does any one know any API that can give me a solution? I tried to crawl google scholar, however, google blocked my crawler.

2 Answers

Look it up on:

If you get a single exact title match then you have probably found the right article, and can fill in the rest of the info from there. Both give you download links and bibtex-style output. What you would likely want to do though to get perfect metadata is download and parse the pdf (if any) and look for DOI-style identifier.

Please be nice and rate-limit your requests if you do this.

Answered by Alex I on January 29, 2021

arXiv has an API and bulk download but if you want something for paid journals it will be hard to come by without paying an indexer like pubmed or elsevier or the like.

Answered by cwharland on January 29, 2021

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP