Name

gfpcopy — copy Gfarm files in parallel

Synopsis

gfpcopy [-nqvdpPU] [-f] [-S source-domainname] [-h source-hostfile] [-D destination-domainname] [-H destination-hostfile] [-j num-of-processes] [-J num-of-processes] [-M limit-byte] [-w way-of-scheduling] [-W kilobytes-for-threshold] [-s KB/s-to-simulate] [-F num-for-readahead] [-b bufsize] source-path destination-path

DESCRIPTION

gfpcopy copies files and directries in parallel.

A set of source/destination hosts can be specified by a domain name and/or a hostlist file. When both a domain name and a hostlist file are specified, a set of hosts is determined by both conditions. When a set of source hosts is specified, only files stored on the source hosts are replicated. When a set of source hosts are specified, only files stored on the set of source hosts are copied. A set of hosts can be specified by a domain name and/or a host file. When both a domain name and a host file are specified, a set of hosts is determined by both conditions.

If the source-url parameter is a directory, files under the directory will be copied recursively.

gfpcopy can also read the directory and get informations of the entries in parallel.

GFPCOPY OPTIONS

These are the options only for gfpcopy.

-b bufsize

Specifies the buffer size to copy. This option is obsolete in Gfarm version 2.6 or later.

The default value is 64KiB (64 * 1024).

-f

With -f option, existing destination files will be overwritten when the size is different or the modification time (mtime) is different from the source file.

Without -f option, existing destination files will be overwritten when that they are older than the corresponding source files in the modification time.

COMMON OPTIONS

gfpcopy has the same options with gfprep. (see man gfprep)

EXAMPLES

To copy files under the directory recursively.


$ gfpcopy gfarm:///dir file:///tmp/dir


$ gfpcopy file:///tmp/dir gfarm:///dir


$ gfpcopy gfarm:///dir1 gfarm:///dir2


$ cd /mnt/gfarm2fs
$ gfpcopy dir /tmp/dir

To copy a file.


$ gfpcopy gfarm:///dir/file file:///dir


$ cd /mnt/gfarm2fs
$ gfpcopy file /tmp/dir

NOTES

If the gfmd and gfpcopy are far apart, the gfpcopy operation is slow. Specifying a large value by -j or -J options may be effective in such a case.

SEE ALSO

gfprep(1), gfreg(1), gfexport(1), gfarm2.conf(5)