Comments (7)
whnwwwhhhnnn
commented on June 2, 2024
1
May I ask how you resolved this issue？
from patch-netvlad.
Tobias-Fischer
commented on June 2, 2024
Could you please provide the full stack trace?
from patch-netvlad.
DonMuv
commented on June 2, 2024
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>6 [00:00<?, ?it/s]
Traceback (most recent call last):
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Searching for hard negatives...
Allocated: 170.45 MB
Cached: 4.72 GB
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>6 [00:32<?, ?it/s]
Traceback (most recent call last): | 0/123 [00:00<?, ?it/s]
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.del at 0x7f4faf115ca0>
Traceback (most recent call last):
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1324, in del
self._shutdown_workers()
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1316, in _shutdown_workers
if w.is_alive():
File "/home/donmuv/anaconda3/envs/NetVlad/lib/python3.8/multiprocessing/process.py", line 160, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
from patch-netvlad.
whu-lyh
commented on June 2, 2024
@Tobias-Fischer , @DonMuv , @whnwwwhhhnnn . I also met this error when I set the num_worker > 0, the training is stuck, and this error occurs:
Exception ignored in: <function _MultiProcessingDataLoaderIter.__del__ at 0x7f81c5877c20>
Traceback (most recent call last):
File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 1328, in __del__
self._shutdown_workers()
File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 1320, in _shutdown_workers
if w.is_alive():
File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 151, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
AssertionError: can only test a child process
Exception ignored in: <function _MultiProcessingDataLoaderIter.__del__ at 0x7f81c5877c20>
Traceback (most recent call last):
File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 1328, in __del__
self._shutdown_workers()
File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 1320, in _shutdown_workers
if w.is_alive():
File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 151, in is_alive
assert self._parent_pid == os.getpid(), 'can only test a child process'
The program succeeds when the num_works==0, however, the training process is slow, and the GPU usage rate is also low.
Any ideas to solve this error?
from patch-netvlad.
whnwwwhhhnnn
commented on June 2, 2024
I set (persistent_workers=True) in (train_loader, val_loader) respectively, and the problem was solved.
…------------------ 原始邮件 ------------------
发件人: "QVPR/Patch-NetVLAD" ***@***.***>;
发送时间: 2023年8月6日(星期天) 上午9:42
***@***.***>;
***@***.******@***.***>;
主题: Re: [QVPR/Patch-NetVLAD] 'can only test a child process' (#34)
@Tobias-Fischer , @DonMuv , @whnwwwhhhnnn . I also met this error when I set the num_worker > 0, the training is stuck, and this error occurs:
Exception ignored in: <function _MultiProcessingDataLoaderIter.__del__ at 0x7f81c5877c20> Traceback (most recent call last): File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 1328, in __del__ self._shutdown_workers() File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 1320, in _shutdown_workers if w.is_alive(): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 151, in is_alive assert self._parent_pid == os.getpid(), 'can only test a child process' AssertionError: can only test a child process Exception ignored in: <function _MultiProcessingDataLoaderIter.__del__ at 0x7f81c5877c20> Traceback (most recent call last): File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 1328, in __del__ self._shutdown_workers() File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 1320, in _shutdown_workers if w.is_alive(): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 151, in is_alive assert self._parent_pid == os.getpid(), 'can only test a child process'
The program succeeds when the num_works==0, however, the training process is slow, and the GPU usage rate is also low.
Any ideas to solve this error?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: ***@***.***>
from patch-netvlad.
whu-lyh
commented on June 2, 2024
Well, thanks!
from patch-netvlad.
Tobias-Fischer
commented on June 2, 2024
Hi @whu-lyh @whnwwwhhhnnn - could you please open a pull request so we can fix this here? I am not sure which exact DataLoader you are referring to.
from patch-netvlad.
Related Issues (20)
- cannot find the datasets... HOT 3
- How to arrange the mapillary dataset when training the code HOT 6
- How to get the value of Extended CMU Seasons? HOT 5
- Small issue on feature_match HOT 1
- Loss function HOT 1
- problem on training HOT 6
- Remove the WPCA layer before train HOT 4
- Support MPS
- How about the training time-consuming of hard samples mining module? HOT 3
- how to make a custom dataset? HOT 1
- Qustion about the function get_integral_feature(feat_in) HOT 2
- Cross-match between patches HOT 2
- questions about grouth.npz HOT 2
- How recalls on MSLS, Robotcar seasons, and CMU seasons are produced? HOT 6
- Ambiguity in the reported results
- patchnetvlad recall HOT 1
- pittsburgh_WPCA4096 HOT 1
- Tokyo24/7 HOT 1
- Large time taken for feature matching between query and database images for pitts30k HOT 5
- Unable to download pretrained models HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from patch-netvlad.