Comments (2)
Hey, thanks for your interest! We actually just hammered out some details of this last night.
We're pre-generating a full index of open-access papers, starting with EuropePMC (should be done by tomorrow). This will be distributed with the app using dat.
The initial indexes will be generated by parsing full data dumps. For example, EuropePMC data is here: http://europepmc.org/FtpSite, and PubMed data is here: http://www.ncbi.nlm.nih.gov/pmc/tools/ftp/.
Later we will merge in other data sources (e.g. CrossRef, DOAJ, Academic Graph, etc.) and allow users to add their own.
More generally we've tackled these issues on the ContentMine project by using a combination of API access tools (see getpapers) and collections of declarative scrapers for providers that don't deposit their data anywhere useful (see quickscrape, scraperjson and journal-scrapers).
Ways to help right now include:
- watch the repo so you'll get notified when new issues are added
- take a look at the linked projects above which are more ready for contributors right now
And here's a small cactus 🌵 as a prize for creating the first issue.
from sciencefair.
@MMMalik also we were thinking of other data preprocessing we could to to make the paper metadata browsing/search more fun/valuable. One idea was to try to extract figures from the papers (using some pdf to png pipeline that was could intelligently create screenshots of the figures in the pdf, etc). If you have any ideas like that it could be a good way to start experimenting.
from sciencefair.
Related Issues (20)
- Cannot run git version: undefined symbols HOT 3
- Never ending search
- Author showing as 'undefined'
- Datasources do not load with current master (since move to IPC)
- Text search while tag filters applied is broken
- Drop natural as a dependency
- Search no longer streaming in realtime
- When no paper is selected, minimise the detail pane
- Science fair requires raven twice HOT 2
- Unclear on first glance what science fair is HOT 1
- Reference Management and Bibliography tools HOT 1
- I18N
- eLife paper archive dead HOT 4
- Snap package for sciencefair. HOT 4
- Package ScienceFair as a Flatpak and publish on Flathub
- Consider releasing a package for Arch-based systems HOT 3
- In-browser work? HOT 3
- There is a typo on http://sciencefair-app.com/
- Not syncing in Linux (.deb package) HOT 4
- Any future? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sciencefair.