Comments (3)
also the image loading process seems not adapting to the path defined in lavis/configs/default.yaml, the provided annotation json file for visual genome uses image location of '/export/xxxx', which will cause error when loading images
from lavis.
Hi @happywu , thanks for raising the issue.
We have now updated the SBU annotation URL, see commit for information.
For conceptual captions, there are usually a missing portion of data during downloading. Therefore, our annotations will not be universally applicable to users' local copies. You may instead use the following scripts to generate your annotations and modify the configuration files with the annotation path accordingly.
lavis/datasets/download_scripts/DownloadConceptualCaptions/create_annotation_3m.ipynb
lavis/datasets/download_scripts/DownloadConceptualCaptions/create_annotation_12m.ipynb
Let us know how it works.
Thanks.
from lavis.
Thanks for updating the url and guidance for generating CC annotations!
from lavis.
Related Issues (20)
- cache_version Value Error
- How can I change cache_root?
- generated output error HOT 2
- A question for BLIP2 Q-Former HOT 1
- BLIP-2 paper finetune replicate low performance: BLEU_4 score is 0.15 for finetuning COCO_caption HOT 8
- KeyError: 'image_id'
- FileNotFoundError: Package has no location <module 'imageio_ffmpeg.binaries' (namespace)> HOT 1
- Video question answering?
- about the implement of my dataset
- BLIP2 generate short repeat caption
- Question about ITG
- BEATs pretrained model download link cannot be opened
- Image-text Retrieval Task is reproduced incorrectly
- which checkpoint to use in first stage pretrain
- Why would you overload the load_state_dict() function in blip2_vicuna_xinstruct.py?
- Reproducing InstructBLIP on Flickr30K
- Evaluation issues encountered while fine-tuning blip2
- Differences between pretrain stage2 and finetuning for BLIP2 COCO Captioning
- KeyError: "Name 'captioning' already registered for <class 'lavis.tasks.captioning.CaptionTask'>." How to fix this error?
- AttributeError: 'NoneType' object has no attribute 'from_pretrained'
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lavis.