Coder Social home page Coder Social logo

Comments (6)

hagenw avatar hagenw commented on August 23, 2024

So I wonder if we should give the user the option to skip the test for altered media.

I think that would be an easy and good solution. In the long run it could also help that you don't have to download all media files with audb.load_to() if you just want to fix the header or tables.

from audb.

hagenw avatar hagenw commented on August 23, 2024

But of course it's not exactly the same, as you might not alter existing media files, but add new ones.

from audb.

hagenw avatar hagenw commented on August 23, 2024

The "Find media" part seems indeed to be the slowest part of publishing a database. We cannot easily avoid this with new data (besides maybe providing the opportunity to provide pre-calculated values?).

But for updating large databases we should definitely provide an option to skip it.

from audb.

hagenw avatar hagenw commented on August 23, 2024

Speed of checking existing media has increased, but it might still be a problem when you have a large number of files. On the other hand when adding the argument to skip checking, we introduce a possible source of error during publication.

from audb.

frankenjoe avatar frankenjoe commented on August 23, 2024

The worst use-case is if you neither upload or alter media, but only change the metadata.

On the other hand when adding the argument to skip checking, we introduce a possible source of error during publication.

I would say we could take that risk given the extreme speed up we would gain.

from audb.

frankenjoe avatar frankenjoe commented on August 23, 2024

#216 now implements a solution without adding a new argument. Media files that are referenced in the tables and are part of the previous version, must no longer exist in the build folder since for those files, we can safely assume they remain unchanged.

from audb.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.