Open-source code for our CVPR19 paper "Meta-learning Convolutional Neural Architectures for Multi-target Concrete Defect Classification with the COncrete DEfect BRidge IMage Dataset".
License: Other
Hi all,
I was facing problems extracting the dataset available on https://zenodo.org/record/2620293. @MrtnMndt helped me resolve it. I will describe the problem here followed by the solution that worked.
md5 of the downloaded zip files is correct, but upon extraction I got the following problems:
unzip CODEBRIM_classification_balanced_dataset.zip, I gotArchive: CODEBRIM_classification_balanced_dataset.zip
warning [CODEBRIM_classification_balanced_dataset.zip]: 8589934592 extra bytes at beginning or within zipfile
(attempting to process anyway)
file #1: bad zipfile offset (local header sig): 8589934592
(attempting to re-compensate)
creating: classification_dataset_balanced/
error: invalid zip file with overlapped components (possible zip bomb)7z x CODEBRIM_classification_balanced_dataset.zip, I got...
Extracting classification_dataset_balanced/val/defects/image_0001304_crop_0000004.png
Extracting classification_dataset_balanced/val/defects/image_0001129_crop_0000002.png
Extracting classification_dataset_balanced/val/defects/image_0001126_crop_0000005.png
Extracting __MACOSX/classification_dataset_balanced/val/defects/._image_0001126_crop_0000005.png
Extracting classification_dataset_balanced/val/defects/image_0000300_crop_0000001.png
Sub items Errors: 7575A closer observation showed the following for some files:
...
Extracting classification_dataset_balanced/train/background/image_0000531_crop_0000005.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0000324_crop_0000003.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0001311_crop_0000001.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0000334_crop_0000005.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0000030_crop_0000005.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0000233_crop_0000005.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0000020_crop_0000003.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0000429_crop_0000004.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0000969_crop_0000001.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0000439_crop_0000002.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0000001_crop_0000002.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0000011_crop_0000004.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0000202_crop_0000002.png Unsupported Method
Extracting classification_dataset_balanced/train/background/image_0000399_crop_0000003.png Unsupported Method
...file-roller I could extract only a part of the data (~3GB) and some file were not readable.
@MrtnMndt pointed out that the operating system probably did not handle large zip file automatically (zip files beyond 4GB). He tried it on his Mac/window and the extraction was just fine and suggested I use a different extractor tool following https://askubuntu.com/questions/959256/cant-extract-a-large-zip-file.
sudo apt-get install fastjar
jar xvf CODEBRIM_classification_balanced_dataset.zip✔️ This is also the accepted solution on: https://unix.stackexchange.com/questions/438368/unix-unzip-is-failing-but-mac-archive-utility-works
❌ We also tried the following which did not work.
sudo apt-get install dtrx
dtrx CODEBRIM_classification_balanced_dataset.zipHi, the download link for the Bridge Damage Dataset is not available.
Hi @MrtnMndt,
Thanks for this work!
I wanted to know the window size and stride used to obtain the semantic segmentation results as shown in the poster https://github.com/MrtnMndt/meta-learning-CODEBRIM/blob/master/imgs/CVPR19_CODEBRIM_poster.jpg.
hello, I download a part of dataset.The zip file "CODEBRIM_crop_dataset" only includes images, but no labels.How can I download data which has been labeled?
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.
