paulbricman / debategpt Goto Github PK
View Code? Open in Web Editor NEWImplementation of initial ArgRank and DebateGPT prototypes.
Home Page: https://paulbricman.com/defensibility/
License: MIT License
Implementation of initial ArgRank and DebateGPT prototypes.
Home Page: https://paulbricman.com/defensibility/
License: MIT License
In debategpt.inference.core
, the Debate class is designed for orchestrating the generation and study of a debate. For instance, there are the d.play()
and d.step()
methods which help run the debate forward.
However, we'll have fully fleshed out transcripts for comparing ArgRank outputs to other computational argumentation approaches and human verdicts.
The task is to create a utility method of the Debate
class which takes in a transcript and updates the object state accordingly (e.g. curr_round
), so that one can then call d.graph
and obtain the argument graph associated with the transcript. Might want to consult with Elfia about the structure of the transcripts, so as to facilitate their loading.
Given two model names (could be the same, e.g. distilgpt2
), load them and use them each to "power" one of two parties engaged in debate, using the Debate
object. It might require a bit of messing around with the Debate
object, though, becuase it has been designed with one model in mind. For instance, the new function could work with two such objects which are manually kept in sync, each powered by one of the model names.
The function should return a list of the party ratings for each of n_branches debates, something like [[0.4, 0.6], [0.7, 0.3]]
. It'll be straightforward to then interpret those in a more meaningful way. I think it'd be appropriate to also sanitize the scores, as described in the artifact (i.e. setting individual utterance ratings to zero if they fail to satisfy a few cosmetic constraints).
Relevant artifact sections: ArgRank, Obtaining DebateGPT
We should have a function which receives as arguments:
After every game, the winning player takes points from the losing one. (https://en.wikipedia.org/wiki/Elo_rating_system)
This part on the wiki page also seems relevant for implementation:
An example may help to clarify: Suppose player A has a rating of 1613...
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.