how to accerlate git add when using git lfs about git-lfs

[bk2204]

Hey,

I'm not sure what your goal is. git add will in fact write multiple files if you specify them on the command line, but I don't believe it's multithreaded. If you want a multithreaded approach and you just need the files in the LFS storage (and not the Git index), you can pipe each file to git lfs clean and you can run several threads of that. However, if you run git add on the file again, then it will be cleaned again, because without git add you haven't recorded the large files in the index.

If you tell us a bit more about what your goal is, we'd be able to better help you achieve it.

[lucashaha]

when I use git add，.git/lfs/ increase just one at one time,is it possible to add multiple file in .git/lfs/tmp and .git/lfs/objects?

[bk2204]

As I mentioned above, it is possible to add them to the Git LFS storage by doing something like so (assuming the list of files is in the file FILES and you want to run 8 at a time):

$ cat FILES | xargs -P8 -L1 sh -c 'git lfs clean < "$0"'

However, that won't add them to the index, so if you want to actually commit those objects, you'll need to use git add, which isn't multithreaded. You're welcome to request that parallel git add be implemented on the Git mailing list or send a patch yourself.

It is possible to combine git lfs clean, git hash-object -t blob, and then a single git update-index call to do it in parallel, but you'll need to do a decent amount of scripting to do that.

[bk2204]

Here's another way you could do things in parallel that might be easier:

$ cat FILES | xargs -P8 -L1 sh -c 'printf '\''100644 %s\t%s\0'\'' $(git hash-object -t blob "$0") "$0"' | git update-index -z --add --index-info

This would work just like git add in that it would add the files to the index, which might be what you want. It would also run in parallel.