Coder Social home page Coder Social logo

Comments (2)

jchoude avatar jchoude commented on August 11, 2024

I personally don't recommend hardlinks, because it sometimes makes things hard to follow, in the event you delete some parts of the work directory.

If you delete the work directory and use hardlinks, you will still use the same space as before deleting. The only change is that you might save some space if unused files were still present in the work directory, but this shouldn't represent a large part of your space use. If work directory space use is a concern, you should try the nextflow clean command, to remove everything that is unneeded.

Also, a note: normally, only files that are kept in the published results are also kept in the work directory. Intermediate files are deleted from the work directory once the process has finished running.

Deleting the work directory is normally not recommended if you intend on rerunning the pipeline with -resume (for example, to adjust some parameters). The caching mechanism is entirely dependent on the work directory content.

So, all in all, I wouldn't recommend it. If the issue is that a run of the pipeline uses lots of space, it might be inevitable, since dMRI processing is quite space intensive.

from tractoflow.

cbedetti avatar cbedetti commented on August 11, 2024

That makes a lot of sense.
Also, I was not aware of nextflow clean, thanks.

I'm closing this issue.

from tractoflow.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.