Setting Up Globus Upload

Owned by Mikah Pinegar
Last updated: Oct 30, 2024 by Priya Jakhar
1 min read

Steps on the mini computer

  1. https://docs.globus.org/globus-connect-personal/install/linux/

  2. sudo apt-get install tk tcllib

  3. wget https://downloads.globus.org/globus-connect-personal/linux/stable/globusconnectpersonal-latest.tgz

  4. tar xzf globusconnectpersonal-latest.tgz

  5. cd globusconnectpersonal-x.y.z

  6. ./globusconnectpersonal

  7. Click the link from the cli to login

  8. Enter in auth code

  9. Add name for the endpoint. When successfully logged in, note down the UUID that has been generated.

  10. Run pip install globus-cli and globus login for root user

  11. Enter auth code

  12. Create a timer with: globus timer create transfer --notify failed --interval 10m --recursive --sync-level mtime 4af299cc-2f37-11ef-9620-453c3ae125a5:/home/benchbot/benchbot-brain-app/mini_computer_api/images/ "ea8aff4a-274e-4c48-bc23-5b93da0cc941:/semifield-upload/".The UUID for local system being used here is generated when globusconnectpersonal is setup.

  13. Create a cronjob for deleting uploaded data by running crontab -e and append */10 * * * * /home/benchbot/benchbot-brain-app/mini_computer_api/delete_uploaded_images.sh >> /home/benchbot/benchbot-brain-app/mini_computer_api/logs/file_deletion_output.log 2>&1


For further investigation (Setting up a Globus application and using app id + secret)

  1. Globus

  2. Register a service account

  3. Name project

  4. Name app

  5. Add secret, copy somewhere safe

  6. Add permissions to destination: paste in the client identity (<CLIENTID>@clients.auth.globus.org) as the Username or Email when adding the permission.