Child pages
  • Data Transfers using globus online user guide, Globus Connect Multi User (GCMU)
Skip to end of metadata
Go to start of metadata

Data Transfer documentation has been moved here: https://www.chpc.utah.edu/documentation/data_services.php

3 Comments

  1. transferred 5.176 TB in ~60 hours at an average rate of 188.4 MBits/sec.

  2.  

    administrative notes:

    #GCMU ports (globus connect multi user) 1/29 -wb

    -A INPUT -p tcp --dport 2811 -j ACCEPT

    -A INPUT -p tcp --sport 2811 -j ACCEPT

    #

    -A INPUT -p tcp --dport 7512 -j ACCEPT

    -A INPUT -p tcp --sport 7512 -j ACCEPT

    #

    -A INPUT -p tcp --dport 50000:51000 -j ACCEPT

    -A INPUT -p tcp --sport 50000:51000 -j ACCEPT

     

    GridFTP server log information will be saved in /var/log/gridftp-go.log

     

    [root@dtn01 std]# pwd
    /uufs/chpc.utah.edu/sys/pkg/gcmu/std

    [root@dtn01 std]# more config.20130130_1653
    VERSION="1.1.0"
    INSTALLATION="1"
    HOSTNAME="dtn01.chpc.utah.edu"
    GO_USER="uofuchpc"
    ENDPOINT="dtn01"
    PUBLIC="Y"
    RESTRICT_PATHS="/"
    DATA_INTERFACE=
    MYPROXY=""
    GRIDFTP_PORT="2811"
    GRIDFTP_INBOUND="50000,51000"
    GRIDFTP_OUTBOUND="50000,51000"
    MYPROXY_PORT="7512"
    SSHKEY="/root/.ssh/id_rsa"
    XINETD="Y"

     

    Nameuofuchpc#dtn01
      
    Server Address 
    Server Port 
    Server Addressgsiftp://dtn01.chpc.utah.edu:2811
    Subject DN/C=US/O=Globus Consortium/OU=Globus Connect Service/CN=04efa158-6b22-11e2-b74b-12313906b091
    Visible Toprivate

    Identity Provider

    Set the Identity Provider to be used with this endpoint.
    MyProxy Hostnamedtn01.chpc.utah.edu:7512
    MyProxy DN/C=US/O=Globus Consortium/OU=Globus Connect Service/CN=04efa158-6b22-11e2-b74b-12313906b091 

     

    maybe helpful reference URL

    https://www.icts.uiowa.edu/confluence/pages/viewpage.action?pageId=67307525

     

     

     

     

  3. posting some transfer #'s for reference

    NOTE: dtn01 had a load of 9 at the time of this test

    Task 1 is moving one 10G file from dtn01 (via nfs mount homedir) to xsede#trestles - the gist is it went 812 Mbps, it took about 3minutes to upload the 10G file from dtn01 to trestles

    Task 2 is  moving one 10G file from xsede#trestles to dtn01 (via nfs mount homedir) - the gist is it went 53.8 Mbps, it took about 30minutes to upload the 10G file from trestles to dtn01

    === Task 1 Details ===

    Task ID                 : 650247ac-4fb6-11e3-9a00-12313d2005b7

    Task Type               : TRANSFER

    Status                  : SUCCEEDED

    Request Time            : 2013-11-17 18:30:54Z

    Deadline                : 2013-11-18 18:30:54Z

    Completion Time         : 2013-11-17 18:33:08Z

    Total Tasks             : 1

    Tasks Successful        : 1

    Tasks Expired           : 0

    Tasks Canceled          : 0

    Tasks Failed            : 0

    Tasks Pending           : 0

    Tasks Retrying          : 0

    Command                 : API 0.10 go

    Label                   : n/a

    Source Endpoint         : uofuchpc#dtn01

    Destination Endpoint    : xsede#trestles

    Sync Level              : n/a

    Data Encryption         : No

    Checksum Verification   : Yes

    Delete                  : No

    Files                   : 1

    Files Skipped           : 0

    Directories             : 0

    Expansions              : 0

    Bytes Transferred       : 10485760000

    Bytes Checksummed (Sync): 0

    MBits/sec               : 630.722

    Faults                  : 0

    <SNIP>

     

    === Task 2 Details ===

    Task ID                 : 45e622de-4fb7-11e3-9a00-12313d2005b7

    Task Type               : TRANSFER

    Status                  : SUCCEEDED

    Request Time            : 2013-11-17 18:37:12Z

    Deadline                : 2013-11-18 18:37:12Z

    Completion Time         : 2013-11-17 19:03:10Z

    Total Tasks             : 1

    Tasks Successful        : 1

    Tasks Expired           : 0

    Tasks Canceled          : 0

    Tasks Failed            : 0

    Tasks Pending           : 0

    Tasks Retrying          : 0

    Command                 : API 0.10 go

    Label                   : n/a

    Source Endpoint         : xsede#trestles

    Destination Endpoint    : uofuchpc#dtn01

    Sync Level              : n/a

    Data Encryption         : No

    Checksum Verification   : Yes

    Delete                  : No

    Files                   : 1

    Files Skipped           : 0

    Directories             : 0

    Expansions              : 0

    Bytes Transferred       : 10485760000

    Bytes Checksummed (Sync): 0

    MBits/sec               : 53.877

    Faults                  : 0