clp-research Goto Github PK

clembench

A Framework for the Systematic Evaluation of Chat-Optimized Language Models as Conversational Agents and an Extensible Benchmark

clp-vision

Our code for working with language and vision corpora.

cost-sharing-reference-game

Source code and documentation for the LREC-COLING'24 paper "Sharing the Cost of Success: A Game for Evaluating and Learning Collaborative Multi-Agent Instruction Giving and Following Policies"

deep_disfluency

Deep Learning systems for training and testing disfluency detection and related tasks on speech data.

diff-att-transformer

Code for the INLG paper "Generating Landmark-based Manipulation Instructions from Image Pairs"

different-follower-behaviors

Source code and documentation for the AAAI'24 CMASDL Workshop paper "Learning Communication Policies for Different Follower Behaviors in a Collaborative Reference Game"

duel

Derived data from the DUEL project experiments annotated with disfluency and laughter

golmi

golmi-matthew

image-description-sequences

A corpus of 5 turn image descriptions

image_wac

Code for "Resolving References to Objects in Photographs", ACL 2016

installments

intra-episodic-feedback

Source code and documentation for the ACL 2023 Findings paper "Yes, this Way! Learning to Ground Referring Expressions into Actions with Inter-episodic Feedback from Supportive Teachers"

komodis-dataset

A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Models

language-models-multimodal-tasks

Official Git repository for "Hakimov, S., and Schlangen, D., (2023). Images in Language Space: Exploring the Suitability of Large Language Models for Vision & Language Tasks. Findings of the Association for Computational Linguistics (ACL 2023 Findings)"

meetup

Data for the Language & Vision / Visual Dialogue task "MeetUp!"

modular_form_filling_with_llm

This is the repository for the paper with the title "Evaluating Modular Dialogue System for Form Filling Using Large Language Models"

mouse-tracking-experiment

mouse tracking experiment with Slurk

multimodal-spatial-description

mumodo

MUltiMOdal DOcument - import, analyze, plot and manage multimodal data

new-old-discourse-entities

Code for the COLING22 paper about probing pre_trained LMs with discourse status entity knowledge.

pento-diaref

Source code and documentation for the EACL 2023 paper "Pento-DIARef: A Diagnostic Dataset for Learning the Incremental Algorithm for Referring Expression Generation from Examples"

pentomino-js

A pentomino framework with jQuery and HTML5 canvas

pentoref

A collection of Pentomino puzzle playing dialogue corpora annotated for reference to objects and disfluency.

pytorch-expresso

High-level framework for PyTorch to quickly setup training using configurable experiments

sempix

Semantics with Pictures: Image Corpora as Semantic Annotation of Natural Language Expressions

slurk

Slurk (think “slack for mechanical turk”…) is a lightweight and easily extensible chat server built especially for conducting multimodal dialogue experiments or data collections.

slurk-audio-pilot

Pilot experiment on audio recording based on slurk

slurk-bots

Bots for the Slurk project

space-efficient-context-encoding-acl21

to be done.