Coder Social home page Coder Social logo

Comments (5)

Jumaron avatar Jumaron commented on May 30, 2024

Also is it possible to add TTA?

from animesr.

Zarxrax avatar Zarxrax commented on May 30, 2024

I would add to this topic, if the AnimeSR team is serious about creating a model for restoring Animation, the current degradation pipeline is insufficient, because it does not accurately model the real issues in low quality video.

Most of the animated content that people want to upscale and restore is older content from DVD, VHS, NTSC broadcast, etc. The video contains issues like Dot Crawl, Rainbows, Color Bleed/Chroma noise, Edge Enhancement/Halo, MPEG-2 compression, among others. I have trained effective Real-ESRGAN models on several of these issues so I know they are possible to fix. I kindly recommend that you focus on these types of analog video degradations in order to make the model more effective for real world use.

from animesr.

Jumaron avatar Jumaron commented on May 30, 2024

I would add to this topic, if the AnimeSR team is serious about creating a model for restoring Animation, the current degradation pipeline is insufficient, because it does not accurately model the real issues in low quality video.

Most of the animated content that people want to upscale and restore is older content from DVD, VHS, NTSC broadcast, etc. The video contains issues like Dot Crawl, Rainbows, Color Bleed/Chroma noise, Edge Enhancement/Halo, MPEG-2 compression, among others. I have trained effective Real-ESRGAN models on several of these issues so I know they are possible to fix. I kindly recommend that you focus on these types of analog video degradations in order to make the model more effective for real world use.

Your right to this about all the things that need to be done in Order to fix it my current problems are the following:

Without TTA i get weird artefacts between each Frame that look not only weird but are so annoying especially on high End Models like Anime_B6 from RealESRGAN that it kills me without.

Now comes the big Problem, as example Anime_B6 i very very slow especially with TTA, but the quality after it is just Mindblowing good.

Thats why i always search for new tech that can either have a Model with the Same Quality as Anime_B6 but lower Size or uses things like TensorRT to accelerate the use. Because rendering it in the Normel way with TTA Anime_B6 takes for a 24min Anime around 10Hours for me (RTX 3070). Cutting it by a factor of 2-4x and it will be doable.

Thats why i'am so persistent for new Updates because i know, that we can achiev that with our current tech aviable.
I'am also trying to use TensorRT right now for myself but i have Problem after Problem, but still going strong.

Thanks for reading that ultra long text and for your tips. (I'am German so sorry for the grammar)

from animesr.

Jumaron avatar Jumaron commented on May 30, 2024

I forgot to add that i saw a Project named enhancr, they use TensorRT, but building it yourself is the biggest headache i ever had because you need to set all your Paths yourself and the code is not that clean.

Would really love to talk about it with you if you want and have some spare Time. You can writte me here: Jumaron#0509

from animesr.

manik563A avatar manik563A commented on May 30, 2024

I forgot to add that i saw a Project named enhancr, they use TensorRT, but building it yourself is the biggest headache i ever had because you need to set all your Paths yourself and the code is not that clean.

from animesr.

Related Issues (15)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.