backsunyoung / sodaverse

🥤🧑🏻‍🚀Code and dataset for our paper - "SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization"

Welcome to SODAverse 🪐🌟

This is the official repository for our paper:
SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization

@article{kim2022soda,
    title={SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization},
    author={Hyunwoo Kim and Jack Hessel and Liwei Jiang and Peter West and Ximing Lu and Youngjae Yu and Pei Zhou and Ronan Le Bras and Malihe Alikhani and Gunhee Kim and Maarten Sap and Yejin Choi},
    journal={ArXiv},
    year={2022},
    volume={abs/2212.10465}
}

For a brief summary of our paper, please see this tweet.

🥤SODA

You can now load SODA from the HuggingFace hub as the following:

from datasets import load_dataset

dataset = load_dataset("allenai/soda")

🧑🏻‍🚀COSMO

You can now load COSMO-3B from the HuggingFace hub.

Have a chat with Cosmo!

🚨 Disclaimer: We would like to emphasize that COSMO is trained on SODA and ProsocialDialog mainly for academic/research purposes. We discourage using COSMO in real-world applications or services as is. Model outputs should not be used for advice for humans, and could be potentially offensive, problematic, or harmful. The model’s output does not necessarily reflect the views and opinions of the authors and their associated affiliations.

Environment setup

We recommend you create a conda environment as follows:

conda env create -f environment.yml

and activate it with

conda activate sodaverse

Running Cosmo

By running the command below, Cosmo will be automatically downloaded and you can have a chat!

python chat_with_cosmo.py

Limitations

Cosmo is mostly trained on social chitchat. Therefore, we do not encourage having knowledge-intensive conversations (e.g., science, medical issues, law). For detailed limitations, please refer to our paper.

Other

We will also be releasing our 🫧CO₃! Stay tuned!