ruofeidu / dubibtex

This script merges duplicated bibtex items from a list of .bib files, capitalize the titles, and more importantly, resolve missing DOIs, years.

DuBibtex

This script merges duplicated bibtex items from a list of .bib files, capitalize the titles, and more importantly, resolve missing DOIs, years.

Sources of DOI:

• Google
• ACM
• IEEE
• Springer
• Caltech
• Wiley
• arxiv

Please feel free to make any pull requests!

Another useful tool for LaTeX writing is extracting the abstract: http://tool.duruofei.com/abstract, whose source code is added as a submodule here.

Known issues:

• It assumes the first line of each bibtex item contains its bib ID. This is typically true if the bibtex item is from Google Scholar or DBLP

Run

First, edit config.ini and modify your list of input bib files. For example:

inputFileList       =   input.bib,test.bib

Next, run

python Dubibtex

The new bib file will be generated as output.bib by default.

Dependencies

• Python 3.6
• pip install -r requirements.txt

License

Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)

Author

Ruofei Du

References

BibTeX Format Description

dubibtex's Issues

smaller case for Title, Author etc

Auto symbol conversion

e.g.
author={Lenartowicz, Małgorzata and Wieczerzak, Krzysztof and Krzeptowski, Wojciech and Dobosz, Paulina and Grzmil, Paweł and Starzyński, Rafał and Lipiński, Paweł},

author={Lenartowicz, Ma{\l}gorzata and Wieczerzak, Krzysztof and Krzeptowski, Wojciech and Dobosz, Paulina and Grzmil, Pawe{\l} and Starzy{'n}ski, Rafa{\l} and Lipi{'n}ski, Pawe{\l}},

Authors removed

I put this as input

@inproceedings{attal2020matryodshka,
    author    = "Benjamin Attal and Selena Ling and Aaron Gokaslan and
                 Christian Richardt and James Tompkin",
    title     = "{MatryODShka}: Real-time {6DoF} Video View Synthesis
		 using Multi-Sphere Images",
    booktitle = "European Conference on Computer Vision (ECCV)",
    month     = aug,
    year      = "2020",
    url       = "https://visual.cs.brown.edu/matryodshka"
}

and got this as output

% Automatically generated by DuBibTeX.
% https://github.com/ruofeidu/DuBibtex
@inproceedings{attal2020matryodshka,
  title={{{MatryODShka}: Real-Time {6DoF}},
  booktitle={European Conference on Computer Vision (ECCV)},
  year={2020},
  url={https://visual.cs.brown.edu/matryodshka},
  doi={10.1007/978}
}

I'd expect it to add the DOI (10.1007/978-3-030-58452-8_26) and keep the authors.

’ to '

Non-working doi

Not sure if this is an real issue or not.
The doi https://doi.org/10.5555/3045118.3045358 doesn't actually work
I think all the 10.5555 are not real DOIs, just some doi-looking ID assigned by ACM

Input:

@InProceedings{pmlr-v37-sohl-dickstein15,
  title = 	 {Deep Unsupervised Learning using Nonequilibrium Thermodynamics},
  author = 	 {Sohl-Dickstein, Jascha and Weiss, Eric and Maheswaranathan, Niru and Ganguli, Surya},
  booktitle = 	 {Proceedings of the 32nd International Conference on Machine Learning},
  pages = 	 {2256--2265},
  year = 	 {2015},
  editor = 	 {Bach, Francis and Blei, David},
  volume = 	 {37},
  series = 	 {Proceedings of Machine Learning Research},
  address = 	 {Lille, France},
  month = 	 {07--09 Jul},
  publisher =    {PMLR},
  pdf = 	 {http://proceedings.mlr.press/v37/sohl-dickstein15.pdf},
  url = 	 {https://proceedings.mlr.press/v37/sohl-dickstein15.html},
}

Output:

@inproceedings{pmlr-v37-sohl-dickstein15,
  title={{Deep Unsupervised Learning Using Nonequilibrium Thermodynamics}},
  author={Sohl-Dickstein, Jascha and Weiss, Eric and Maheswaranathan, Niru and Ganguli, Surya},
  booktitle={Proceedings of the 32nd International Conference on Machine Learning},
  pages={2256--2265},
  year={2015},
  editor={Bach, Francis and Blei, David},
  volume={37},
  series={Proceedings of Machine Learning Research},
  address={Lille, France},
  month={07--09 Jul},
  publisher={PMLR},
  pdf={http://proceedings.mlr.press/v37/sohl-dickstein15.pdf},
  url={https://proceedings.mlr.press/v37/sohl-dickstein15.html},
  doi={10.5555/3045118.3045358}
}

bibtex entry disappears

Input:

@INPROCEEDINGS{ulicny2021reordering,
  author={Ulicny, Matej and Krylov, Vladimir A. and Dahyot, Rozenn},
  booktitle={ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)}, 
  title={Tensor Reordering for CNN Compression}, 
  year={2021},
  volume={},
  number={},
  pages={3930-3934},
  keywords={Image coding;Tensors;Quantization (signal);Redundancy;Memory management;Transforms;Task analysis;Compression;Pruning;Reordering;DCT;CNN},
  doi={10.1109/ICASSP39728.2021.9413944}}

Output:

% Automatically generated by DuBibTeX.
% https://github.com/ruofeidu/DuBibtex

Wrong doi for denoising diffusion probablistic models

Input:

@inproceedings{NEURIPS2020_4c5bcfec,
 author = {Ho, Jonathan and Jain, Ajay and Abbeel, Pieter},
 booktitle = {Advances in Neural Information Processing Systems},
 editor = {H. Larochelle and M. Ranzato and R. Hadsell and M.F. Balcan and H. Lin},
 pages = {6840--6851},
 publisher = {Curran Associates, Inc.},
 title = {Denoising Diffusion Probabilistic Models},
 url = {https://proceedings.neurips.cc/paper_files/paper/2020/file/4c5bcfec8584af0d967f1ab10179ca4b-Paper.pdf},
 volume = {33},
 year = {2020}
}

Output:

% Automatically generated by DuBibTeX.
% https://github.com/ruofeidu/DuBibtex
@inproceedings{NEURIPS2020_4c5bcfec,
  author={Ho, Jonathan and Jain, Ajay and Abbeel, Pieter},
  booktitle={Advances in Neural Information Processing Systems},
  editor={H. Larochelle and M. Ranzato and R. Hadsell and M.F. Balcan and H. Lin},
  pages={6840--6851},
  publisher={Curran Associates, Inc.},
  title={{Denoising Diffusion Probabilistic Models}},
  url={https://proceedings.neurips.cc/paper_files/paper/2020/file/4c5bcfec8584af0d967f1ab10179ca4b-Paper.pdf},
  volume={33},
  year={2020},
  doi={10.1109/CVPR52688.2022.01117}
}

Fix bib ids with H{\"u}ttemann.

EOM.