H2020 compatible about cordis-projects-crawler

[juzraai]

Thank you for your interest in my project! Unfortunately, CORDIS website changed a lot in the past years, currently my application cannot parse any of the project pages.

CORDIS publishes project information also in downloadable datasets, you may try these: https://data.europa.eu/euodp/data/dataset/cordisH2020projects

If that doesn't fill your needs and updating my crawler would be useful for you and others, I can try to do it in the next days/weeks.

[davidpitl]

I think that is a very interesting tool for Cordis data harmonization. The two kinds of outputs proposed by your project (csv and MySQL tables) are perfect for common data explotation. Probably people must download cordis data to a local directory or specify resorce urls for automatic download. Database structure also must be reviewed because some fields have changed from your last version. Write me and we can share a drive with some ideas. Thanks in advance, David El 27/01/2018 a las 10:38, Zsolt Jurányi escribió:

…

Thank you for your interest in my project! Unfortunately, CORDIS website changed a lot in the past years, currently my application cannot parse any of the project pages. CORDIS publishes project information also in downloadable datasets, you may try these: https://data.europa.eu/euodp/data/dataset/cordisH2020projects If that doesn't fill your needs and updating my crawler would be useful for you and others, I can try to do it in the next days/weeks. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#1 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AdLR2N54Pugprr5JzPdbJAV1DIfzJHh4ks5tOu6OgaJpZM4RvK-9>.

[juzraai]

@davidpitl Ok, I'll upgrade the crawler, and I appreciate any idea of yours. :) I've just created issue #2 for planning v2.0 of the crawler. We can discuss in the comments here or there, or I'm open to use any other service (Trello, Slack, etc.) for sharing ideas.

[davidpitl]

El 29/01/18 a las 18:42, Zsolt Jurányi escribió:

@davidpitl <https://github.com/davidpitl> Ok, I'll upgrade the crawler, and I appreciate any idea of yours. :) I've just created issue #2 <#2> for planning v2.0 of the crawler. We can discuss in the comments here or there, or I'm open to use any other service (Trello, Slack, etc.) for sharing ideas. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#1 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AdLR2OMJxW4EnlGLe3uTtvoAdMRPvN-Wks5tPgMIgaJpZM4RvK-9>.

Main objectives are: - Automatic download of Cordis projects and organizations database - Normalize fields to have an unified view (fp4 have a little strange format and information is incomplete). - Different outputs: csv, xml or DB Other functionalities? David P.D: Why Kotlin?

[juzraai]

These objectives seem OK. I think I will need some help with the unified view, but let's see what I can do in the upgrade first.

Kotlin: I tried it about a year ago and I fell in love with it. :) It has a lot of cool features, I can work faster in Kotlin then in Java. (But it's still compatible with Java.)

[juzraai]

I've just released v2.0.0 which now can fetch and parse any project from CORDIS: old ones, new ones, including H2020 ones - so I'm closing this ticket.

Please try it out and if you still need an "unified view", please open a new ticket and give details about it.

[davidpitl]

Thanks ...I will try it. David El 28 de abril de 2018 23:32:32 CEST, "Zsolt Jurányi" <[email protected]> escribió:

…

Closed #1. -- You are receiving this because you were mentioned. Reply to this email directly or view it on GitHub: #1 (comment)

-- Enviado desde mi dispositivo Android con K-9 Mail. Por favor, disculpa mi brevedad.