law-ai / summarization

Implementation of different summarization algorithms applied to legal case judgements.

Introduction

This repository contains implementations and datasets made available in the following papers :

• Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluation accepted at AACL-IJCNLP 2022.
• A Comparative Study of Summarization Algorithms Applied to Legal Case Judgments accepted at ECIR 2019.

We provide the code base of various Extractive and Abstractive summarization algorithms applied to legal case documents. We also provide three summarization datasets from the Indian and UK Supreme Court case documents.

Dataset

We make available 3 legal document summarization datasets. Please refer to the dataset folder for more details :

• IN-Abs : Indian Supreme Court case documents & their abstractive summaries, obtained from http://www.liiofindia.org/in/cases/cen/INSC/
• IN-Ext : Indian Supreme Court case documents & their extractive summaries, written by two law experts (A1, A2).
• UK-Abs : United Kingdom (U.K.) Supreme Court case documents & their abstractive summaries, obtained from https://www.supremecourt.uk/decided-cases/

Extractive Summarization methods

We provide the implementations of the following methods in the extractive folder of the repository :

• Improving Legal Document Summarization Using Graphical Models, JURIX 2006
• LetSum, a Text Summarization system in Law field, JURIX 2004
• CaseSummarizer, COLING 2016
• Automatic Summarization of Legal Decisions using Iterative Masking of Predictive Sentences, ICAIL 2019
• Extracting the Gist of Chinese Judgments of the Supreme Court, ICAIL 2019
• Extractive Summarization using Deep Learning, arXiv preprint, 2017
• We also provide the script to convert an abstractive gold standard summary to extractive, for training supervised extractive summarization methods.

Abstractive Summarization methods

• Scripts to generate fine tuning data using following techniques
  • CLS
  • SIF
  • MCS
  • MCS_RR
• Scripts to fine-tune following models
  • BART
  • legal-Pegasus
  • Legal-LED
• Scripts to generate summaries using following models/methods
  • BART(CLS, MCS, SIF)
  • BART_RR
  • BERT-BART
  • Legal-LED
  • Pegasus
• Helper chunking and combiner scripts for BertSum-Abs and Pointer Generator methods

Availability of Trained Models

The following models trained on the IN-Abs & UK-Abs datasets are publicly available at https://zenodo.org/record/7234359#.Y2tShdJByC1

• Extractive : SummaRuNNer, Gist

• Abstractive : Legal-Pegasus, Legal-LED

Citation

If you are using the implementations / datasets / trained models, please refer to the following papers:

@inproceedings{shukla2022,
  title={Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluation},
  author={Shukla, Abhay and Bhattacharya, Paheli and Poddar, Soham and Mukherjee, Rajdeep and Ghosh, Kripabandhu and Goyal, Pawan and Ghosh, Saptarshi},
  booktitle={The 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing},
  year={2022}
}

@inproceedings{bhattacharya2019comparative,
  title={A comparative study of summarization algorithms applied to legal case judgments},
  author={Bhattacharya, Paheli and Hiware, Kaustubh and Rajgaria, Subham and Pochhi, Nilay and Ghosh, Kripabandhu and Ghosh, Saptarshi},
  booktitle={European Conference on Information Retrieval},
  pages={413--428},
  year={2019},
  organization={Springer}
}

summarization's Issues

Code structure

Can you upload the description and code structure as soon as possible?

LetSum input_sample_test.html not opening

Hello
The input_sample_test.html link in the LetSum README leads to a blank 404 page, kindly have a look

How to install graphicalModel?

list index out of range issue when trying with different sentence

Hi @kaustubhhiware @paheli @npochhi @SubhamRajgaria ,

I am trying to use a different sentence for my own case but this issue appeared. Do you know why it happened? And is there any way to fix that?

RBM theano error

I am trying to run the "RBM" code, I did the theano installation as well. But, I am little confused as it is giving me some mysterious error everytime I run it. I am unable to find the right solution. Probably, you know what I am doing wrong. I have attached the relevant screenshots of the error and the theanorc file.