freddyheppell / crowdeval

A crowdsourced system for multiplatform rumour evaluation

Hey, I'm Freddy. You can have a look at my open and visible source projects here, and see more of what I've done on my website.

crowdeval's Issues

Implement multi-post weighted score calculation

Fix Elastic deprecation warning

DeprecationWarning: The 'body' parameter is deprecated for the 'index' API and will be removed in a future version. Instead use the 'document' parameter. See https://github.com/elastic/elasticsearch-py/issues/1698 for more information (raised from .../crowdeval/webapp/crowdeval/search/support/elasticsearch.py:25)

Implement single-post score calculation

Post->Ratings and Rating->Post relationships conflicts

SAWarning: relationship 'Rating.post' will copy column posts.id to column ratings.post_id, which conflicts with relationship(s): 'Post.ratings' (copies posts.id to ratings.post_id). If this is not the intention, consider if these relationships should be linked with back_populates, or if viewonly=True should be applied to one or more if they are read-only. For the less common case that foreign key constraints are partially overlapping, the orm.foreign() annotation can be used to isolate the columns that should be written towards. To silence this warning, add the parameter 'overlaps="ratings"' to the 'Rating.post' relationship. (Background on this error at: https://sqlalche.me/e/14/qzyx)

Score caching

Redis?

De-t.co links

Currently links stay in their t.co form. They should be changed to the original link.

https://developer.twitter.com/en/docs/tco

Latest page shows ratings when they should be unsure

Terms of Service & Privacy Policy

According to the OAuth settings for "Login via Twitter" the app should have both a "terms of service" and a "privacy policy" page. The deployed version currently uses the home page for both of these links but it would be nice to have specific pages for both.

Fix occasional BERT sentence length warning

UserWarning: some of your sentences have more tokens than "max_seq_len=25" set on the server, as consequence you may get less-accurate or truncated embeddings.
here is what you can do:
- disable the length-check by create a new "BertClient(check_length=False)" when you do not want to display this warning
- or, start a new server with a larger "max_seq_len"
  warnings.warn('some of your sentences have more tokens than "max_seq_len=%d" set on the server, '

Archive tweet media

The images (/videos?) attached to a tweet should be archived in Minio

Add 1 review/post/person limit

Similar post caching

Test pooling_layer with SBERT

Check if pooling layer of -1 or -2 is better

Implement review display

Finish implementing dummy platform

The dummy platform that generates random posts seeded by their url id implementation needs to be finished.