Comments (5)
Also is it possible to add TTA?
from animesr.
I would add to this topic, if the AnimeSR team is serious about creating a model for restoring Animation, the current degradation pipeline is insufficient, because it does not accurately model the real issues in low quality video.
Most of the animated content that people want to upscale and restore is older content from DVD, VHS, NTSC broadcast, etc. The video contains issues like Dot Crawl, Rainbows, Color Bleed/Chroma noise, Edge Enhancement/Halo, MPEG-2 compression, among others. I have trained effective Real-ESRGAN models on several of these issues so I know they are possible to fix. I kindly recommend that you focus on these types of analog video degradations in order to make the model more effective for real world use.
from animesr.
I would add to this topic, if the AnimeSR team is serious about creating a model for restoring Animation, the current degradation pipeline is insufficient, because it does not accurately model the real issues in low quality video.
Most of the animated content that people want to upscale and restore is older content from DVD, VHS, NTSC broadcast, etc. The video contains issues like Dot Crawl, Rainbows, Color Bleed/Chroma noise, Edge Enhancement/Halo, MPEG-2 compression, among others. I have trained effective Real-ESRGAN models on several of these issues so I know they are possible to fix. I kindly recommend that you focus on these types of analog video degradations in order to make the model more effective for real world use.
Your right to this about all the things that need to be done in Order to fix it my current problems are the following:
Without TTA i get weird artefacts between each Frame that look not only weird but are so annoying especially on high End Models like Anime_B6 from RealESRGAN that it kills me without.
Now comes the big Problem, as example Anime_B6 i very very slow especially with TTA, but the quality after it is just Mindblowing good.
Thats why i always search for new tech that can either have a Model with the Same Quality as Anime_B6 but lower Size or uses things like TensorRT to accelerate the use. Because rendering it in the Normel way with TTA Anime_B6 takes for a 24min Anime around 10Hours for me (RTX 3070). Cutting it by a factor of 2-4x and it will be doable.
Thats why i'am so persistent for new Updates because i know, that we can achiev that with our current tech aviable.
I'am also trying to use TensorRT right now for myself but i have Problem after Problem, but still going strong.
Thanks for reading that ultra long text and for your tips. (I'am German so sorry for the grammar)
from animesr.
I forgot to add that i saw a Project named enhancr, they use TensorRT, but building it yourself is the biggest headache i ever had because you need to set all your Paths yourself and the code is not that clean.
Would really love to talk about it with you if you want and have some spare Time. You can writte me here: Jumaron#0509
from animesr.
I forgot to add that i saw a Project named enhancr, they use TensorRT, but building it yourself is the biggest headache i ever had because you need to set all your Paths yourself and the code is not that clean.
from animesr.
Related Issues (15)
- code & dataset release HOT 1
- keyError: 'params' HOT 3
- On fine-tuning with other models HOT 1
- Can not repeat the performance HOT 4
- Training config of realesr-animevideov3
- SR in real videos
- Is there any weight available for the fine-tuned Real-ESRGAN, BSRGAN, and Real-BasicVSR in the paper?
- Question about ffmpeg compression degradation HOT 1
- No NVIDIA driver on system
- New Super-Resolution Benchmarks
- dataset file corrupted HOT 4
- Code question HOT 2
- changing degradation settings HOT 1
- [BUG] Model not found, but is in the weight folder. HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from animesr.