Comments (5)
Update: It seems to work when creating the OpenVINOInferencer
with device="CPU"
.
Does it not work with Nvidia GPUs?
from anomalib.
Hey guys, any news on this?
Or can you suggest any other way to run an exported anomlib model in ONNX format on the Nvidia GPU?
from anomalib.
Hey @haimat, the team is quite busy at this moment, so we didn't have time to look into it. We will return to is as soon as possible. Meanwhile, you can take a look at the OpenVINO documentation to get an idea of the supported hardware, https://docs.openvino.ai/2024/home.html.
from anomalib.
@ashwinvaidya17 Thanks for your response. I can see that Nvidia GPUs are not (fully) supported by OpenVINO, so I guess the best (= fastest) approach would be to convert the ONNX model into a TensorRT model. I guess that should be doable. But how can I read the output of the ONNX model, can I follow 1:1 what happens in the OpenVINOInferencer
?
from anomalib.
It seems the problem is related to Nvidia GPUs being not fully supported in OpenVINO.
After I exported the model to ONNX / TensorRT format, everything works fine now.
from anomalib.
Related Issues (20)
- [Bug]: Can't download efficientAD pretrained weights HOT 9
- [Bug]: How to solve this problem self.image_threshold = AnomalyScoreThreshold().cpu() HOT 2
- [Bug]: EfficientAd is slower than other models in anomalib HOT 5
- [Task]: Missing modules may fail silently
- [Bug]: Error installing with pip version 24.1 HOT 1
- [Bug]: Issue with `self.model_size` Initialization in `EfficientAD` Class HOT 5
- [Bug]: RuntimeError: vstack expects a non-empty TensorList
- [Bug]: Training Fails on DataBricks Due to symlink not supported in DBFS HOT 2
- [Bug]: Why is training slow to start, about efficientAD? HOT 4
- `AnomalibDataset` is not `ABC` anymore. HOT 8
- [Bug]: train_batch_size for EfficientAd should be 1. HOT 3
- [Bug]: Whether different ways of writing can be unified
- [Task]: Grayscale / Singlechannel Image Support HOT 1
- Does `_setup_transform()` in `Engine.fit` use the train transforms properly? HOT 3
- Empty prediction mask and heatmap using WinCLIP in CLASSIFICATION task HOT 4
- [Bug]: No module named setuptools for Python 3.8.10 HOT 2
- [Task]: Config file hyperparameters HOT 1
- [Bug]: ValueError: Not possible to determine the import path for object typing.Iterable[pytorch_lightning.loggers.logger.Logger]. HOT 4
- [Bug]: Question about PaDiM model validation and testing HOT 1
- [Bug]: WinCLIP export pytorch model issue
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from anomalib.