kevinroitero Goto Github PK

agreement-phi

mirror of https://github.com/AlessandroChecco/agreement-phi

crowdsourcingrelevancescales

repository for the paper "On the Effect of Relevance Scales in Crowdsourcing Relevance Assessments for Information Retrieval Evaluation."

crowdsourcingtruthfulness

repository for the papers: "Crowdsourcing Truthfulness: The Impact of Judgment Scale and Assessor Bias" and "Can The Crowd Identify Misinformation Objectively? The Effects of Judgment Scale and Assessor's Background"

dilbert

repo for the paper "DiLBERT: Cheap Embeddings for Disease Related Medical NLP""

extended-hits

Implementation of an extended version of the HITS algorithm proposed by Kleinberg which allows to include negative values for links weights.

how-many-crowd-workers

repository for the TOIS paper "How Many Crowd Workers Do I Need? On Statistical Power when Crowdsourcing Relevance Judgments"

human-and-machine-confidence-in-truthfulness

repository for the JDIQ paper "Combining Human and Machine Confidence in Truthfulness Assessment"

irevaloo

mirror of https://github.com/IRevalOO/IRevalOO_Software

kevinroitero.github.io

website

letoe-code

code for the paper "Effectiveness Evaluation Without Human RelevanceJudgments: A Systematic Analysis of Existing Methodsand of their Combinations"

newbestsub

mirror of https://github.com/Miccighel/NewBestSub

pairwiseagreement

Pairwise Agreement Metric with tie management

predict-explain-truthfulness

preferences-on-a-budget

repository for the paper "Preferences on a Budget: Prioritizing Document Pairs when Crowdsourcing Relevance Judgments" accepted at TheWebConf 2022

reproducibility_si_evalnojudg

Repo for the paper: "Reproduce. Generalize. Extend. On Information Retrieval Evaluation without Relevance Judgments." by Kevin Roitero, Marco Passon, Giuseppe Serra, and Stefano Mizzaro.

set-size-estimation

python implementation of the tools from http://sakailab.com/download/