Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 10 Next »

List of things we want to include

TODOs

  1. Adding steps about the tools and installing those tools ( rawtherapee, mobaxterm)

  2. Steps in rawtherapee

  3. Command line instructions

  4. Pics or screenshots will be very helpful

    1. Provide video overview

  5. Requirements

    1. How to get requirements

  6. Additional requirements and instructions

    1. Azure

    2. SUNNY

    3. NFS Locker Access

1. Download Batch

Description of this step

code snippet here

2. Color Profiling

Description of step

2.1 Sub heading step

Setting up a new user

Step 1

Establishing VPN:

ciscosecureclient.mp4

  1. Be sure Cisco Secure Client is downloaded

  2. Launch program

  3. Be sure the NCSU VPN is chosen - “vpn.ncsu.edu”

  4. Click “Connect”

  5. Enter username, password, and “push”, “sms” or “passcode” to authenticate via Duo

  6. Once authenticated, we can log into the SUNNY server via MobaXTerm

Log into MobaXTerm (MXT):

logging_into_MXT.mp4

  1. Open program

  2. Choose Light/Dark mode

  3. Click Start local terminal

  4. ssh <user>@SUNNY.ece.ncsu.edu

  5. Enter password if prompted (will not see password being typed, if incorrect, MXT will reprompt to enter password)

  6. cd ..
  7. cd psa_images

  8. We’ve navigated to the PSA images location. From here - for our purposes - we will choose either the “semifield_tools” folder or “field_tools” folder.

    1. If choosing Semifield

      1. cd semifield_tools

    2. If choosing Field

      1. cd field_tools

  9. Now we have navigated to where we work with our batches. From here we will:

    1. “download” field batches

    2. Open new screens

    3. “copy” semifield batches

    4. Launch RawTherapee to adjust images

    5. Send batches into the respective pipeline

    6. Check available batches

    7. Check/Crosscheck # of images, jpgs, arws, pp3s, etc.

Backlog Spreadsheet:

Using the Backlog Spreadsheet

video1420686139.mp4

  • Must obtain view/edit permission to spreadsheet

  • Filling out each column respectively is important

  • Hiding Developed batches' rows helps keep organized

  • Color coded format also helps keep organized

    • Downloaded - Field batch has been brought over to local user

    • Downloading - field batch is in the process of being brought to local user

    • Copied - Semifield batch has been brought over to local user

    • Copying - Semifield batch is in the process of being brought to local user

    • Processed* - Batch has been opened within RawTherapee and settings have been toggled appropriately

    • Processing* - Batch has been sent into it’s respective pipeline

    • Redo - Must redownload/copy batch again, adjust profile again, then send back into pipeline

    • Revisit - Something seems to have gone wrong in the pipeline. Errors have been given. Must investigate. Image count does not match up, no storage remains, etc.

    • Developed - Batch has been sent through pipeline successfully. Image count matches

*Processed refers to settings changed, while Processing refers to sending into pipeline. Yes, it is a bit counterintuitive.

Common & Useful Commands

Available batches:

ls /mnt/research-projects/s/screberg/longterm_images2/semifield-upload/ -lh

# of images in batch:

ls /mnt/research-projects/s/screberg/longterm_images2/semifield-upload/<batch>/*.ARW | wc -l

# of jpgs processed:

ls /mnt/research-projects/s/screberg/longterm_images2/semifield-developed-images/<batch>/images/*.jpg | wc -l

# of pp3 files created:

ls /mnt/research-projects/s/screberg/longterm_images2/semifield-developed-images/<batch>/images/*.pp3 | wc -l

Blob Analyzer

Installing conda (miniconda) 

Use these commands below from the command line in the SUNNY server:

  1. mkdir -p ~/miniconda3

  2. wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh -O ~/miniconda3/miniconda.sh

  3. bash ~/miniconda3/miniconda.sh -b -u -p ~/miniconda3

  4. rm ~/miniconda3/miniconda.sh

  5. ~/miniconda3/bin/conda init bash

  6. Close the remote connection then ssh back in

Setting up a conda environment

Still in the command line inside of SUNNY:

  1. conda create -n <your env name> python=3.10

  2. conda activate <your env name>

  3. cd /home/psa_images/analyze_blobs

  4. pip install -r requirements.txt

Running the code 

Your conda environment must be activated to run the code. Run these in the command line.

  1. conda activate <your env name>

  2. cd /home/psa_images/analyze_blobs

  3. python ANALYZE_BLOB.py

    1. Creates 2 time stamped files in the “results” folder in the main project directory. 

      1. A text files that provides a general summary of missing batches

      2. A csv file that can be viewed in excel or google docs

  • No labels