mhisoft / fastcopy

The fastest mass copy and sync, backup tool for Windows, Mac and Linux/Unix

FastCopy

• A very handy tool for copying or backup a large set of directories and files, recursively, i.e. all the sub directories under will be copied over to the target. Support all the hidden and system files, long file names, file names of all languages.
• Fast! Use multiple workers to copy from/to the SSD drives.
• Support mounted external drives on Mac.
• A Drive speed tester/Benchmark tool.
  The fastcopy reports real life file copying speed for various file size groups. You will notice the transfering speed of large files and smaller files are quite different. Used in combination with the synthetic drive benchmark tools such as the CrystalDiskMark and Anvil's Storage Utilities, you'll have a better picture of your system's performance.
• Cross platform support: Windows, MacOS, Unix/Linux where JRE is supported.

Download

• Downlod the latest release: https://github.com/mhisoft/fastcopy/releases

Instructions

• Requires java JDK. If not already availabe on your system, download and install the JDK 1.8+ from Oracle. https://www.oracle.com/technetwork/java/javase/overview/index.html

• Windows: Exploded the downloaded zip into a c:\bin\fastcopy and add the directory to the system path.
  Run the fc.bat, fc.exe or fastcopy-console.exe for the UI version.
  Also see below on how to integrate with the windows explorer.
  

• Mac OS: Exploded the downloaded zip to ~/bin/fastcopy
  The "Fastcopy(1.2).app" is the MacOS app, copy it to the ~/Applications and run.
  For the first time, it might alert saying the app can't be opened because it is from a untrusted source. Go to the Finder, right click to bring up the context menu and click "Open" from there. You will have the option to open it there after.
  Also see below on how to add as service to the context menu in the Finder.
  

• Unix/linux, Mac command line : run the ./fc.sh

ex:

    
$ ./fc.sh -help
MHISoft FastCopy (v1.3, build Dec 2018)
(https://github.com/mhisoft/fastcopy)
Usages:
         fc [option] -from source_dir -to target_dir
         source-dir: The source files and directories delimited with semicolon.
         target-dir: The target directory.
         Options:
                 -v      verbose mode.
                 -verify verify each file copy by comparing the file content hash.
                 -m      use multiple threads, best for copying across the SSD drives.
                 -w      number of worker threads in the multi threads mode, default:2.
                 -o      always override.
                 -n      override only when the source file newer or different in size.
                 -f      flat copy, copy everything to the same target directory.
                 -pack   Package the small files first to speed up the copy, requires write access on the source folder or drive.
                 -k      Keep the original file timestamp.
                 -sf     Create the same source folder under the target and copies to it.
Examples:
                 copy from current dir to the backup directory: fastcopy t:\backup
                 fastcopy -from s:\projects\dir1;s:\projects\dir2 -to t:\backup
   

GUI version:

• The source can be a combination of multiple directories and files delimited by the semicolon ";". You can either use the browse button to choose directories or copy paste directly into the input box. The file choose supports multiple directories selections.
• The target should always be one directory or drive.
• Check the muti workers for SSD drives for copying files simuteneously. Usually it should speed things up if there no other bottlenecks on such as the network or cable, ports. * The "override only if newer or a size difference is detected" is handy to when you need to stop and resume a copy task. say you stop a copying task in the middle , when you resume it by running again , it will skip the already copied files on the target directory and copies only the not yet copied over files.
• "Create the same source folder..." option, for example: source is "/Users/myhome/Repository", target is "/Volumes/externaldrive/backup", with this option checked, a "Repository" diorectory will be created under /Volumes/externaldrive/backup and the contents under the source will be copied to /Volumes/externaldrive/backup/Repository
• Package the small files first -- will sppeed up the overal copying if you plan to copy lots of small files in some directories. Those small filess files will be zipped up first and copied over to the target as one package. This will greatly help copying large amount small files over the network , or to external attached USB drives, because copying small files one by one to such external devies are the slowest no matter what software you use.

Hook to the Windows Explorer Context menu

• Edit the fastcopy_reg.reg file change the path to point to where your rdpro is exploded. double click to import into windows registry

Add to the Mac Finder's Context menu

• Since this approach launches the java fromt he shell scripts, it will require the full java SDK to be installed on the Mac.
• Open Automator, Files menu --> "new"
• On the "Choose a type for your document" prompt, select "Service"; "quick actions" for moJave.
• On the left in the search bar, type in "Run Shell Scripts" and select it.
• For "Services receives selected", choose "Folders", in "Finder". Edit the path to where you installed the jar if needed.
• for the "Pass input", select "as arguments"
• Save as "Fast Copy"

Disclaimer

The author is not responsible for any loss of files or damage incurred by running this utility.

License

Apache License 2.0, January 2004 http://www.apache.org/licenses/

fastcopy's Issues

v1.2.8 copy multiple source folder to under one target dir

add multiple directories to source
copy under one target and specify creating the same source folder under target.

it does not create those multiple dirs under the target, but creates under the first dir name.

Help with NAS / Network Drives

Hi, wondering if you can assist here.... trying to copy between two NAS drives on my Mac

Cant seem to get the connections to work

Do you have any samples / advice here?

Do not stop the copy when can not access file

Do not stop the copy when can not access file

MacOS requires Java SDK to run

Hi, just maybe need to include the requirements to run the .sh script on MacOs. User will need to install full Java SDK to run action from context menu in MacOS. Tested on MacOS Mojave 10.14 .

Thanks.

still taking 1hour 20 minutes for 3gb , 8000 small files

iam copying 3gb , 8000 small files, from f drive to pendrive , i check mutithreading but it takes 1 hour 20 minutes for 8000 small files (total size 3gb)

Sync operation terminates before destination files are deleted

I am using Veeam Backup and Replication software. My backup job runs a post job batch script. The script runs FastCopy command line Sync to mirror backups to another local storage location. When VBR retention runs, it deletes older backups. This means that FC will delete backups from the destination that no longer exist in the source. The full backups are quite large resulting in very large file deletions.

What happens is that FC and the script terminate before the all destination files are deleted. The files are eventually deleted but can take 7-10 minutes after the script has terminated. This gives a false sense of completion.

I am guessing you are using an API call to do the deletions. I suspect that your code does not wait until the file is actually deleted but just checks the request to delete was successful.

Is there a way that your code can wait for all files to be deleted before FC terminates?

Auto created zip files are left in the source directories when use cancelling the copy in the middle.

Don't leave behind the auto created zip files when use cancels the copying in the middle.
affect : v1.3

handle when can't package files

handle when can't package files, need to fall back to copy files one by one.
right now it interrupts the whole copy process.

or allow user to check off package files for transfer

provide option to follow symbolic or junction links or not

provide option to follow symbolic or junction links or not .
such as don't follow the symbolic links and copy all the contents within that link.

Can't Access MTP Devices

I was hoping to use this for copying files to my Android phone, which connects through USB as an MTP device.

When I open FastCopy GUI and browse for locations I can see C and D which are my physical hard drives. It also sees an E drive which I don't have, so maybe that's supposed to be the phone, but when I try to browse it nothing shows up.