List of things we want to include
TODOs
Adding steps about the tools and installing those tools ( rawtherapee, mobaxterm)
Steps in rawtherapee
Command line instructions
Pics or screenshots will be very helpful
Provide video overview
Requirements
How to get requirements
Additional requirements and instructions
Azure
SUNNY
NFS Locker Access
1. Download Batch
Description of this step
code snippet here
2. Color Profiling
Description of step
2.1 Sub heading step
Setting up a new user
Download MobaXTerm (MXT)
https://mobaxterm.mobatek.net/download-home-edition.html
Portable Edition is sufficient
Download RawTherapee within MXT (?cant' remember how to do this)
Download Cisco Secure Client
Obtain access to SUNNY
who to contact
Obtain Read/Write privileges
Obtain access to NCSU Storage Lockers
who to contact
Obtain access to Azure Storage Explorer
who to contact
Obtain access to the Divided backlog Google Sheets
Step 1
Establishing VPN:
Be sure Cisco Secure Client is downloaded
Launch program
Be sure the NCSU VPN is chosen - “vpn.ncsu.edu”
Click “Connect”
Enter username, password, and “push”, “sms” or “passcode” to authenticate via Duo
Once authenticated, we can log into the SUNNY server via MobaXTerm
Log into MobaXTerm (MXT):
Open program
Choose Light/Dark mode
Click Start local terminal
ssh <user>@SUNNY.ece.ncsu.edu
Enter password if prompted (will not see password being typed, if incorrect, MXT will reprompt to enter password)
cd ..
cd psa_images
We’ve navigated to the PSA images location. From here - for our purposes - we will choose either the “semifield_tools” folder or “field_tools” folder.
If choosing Semifield
cd semifield_tools
If choosing Field
cd field_tools
Now we have navigated to where we work with our batches. From here we will:
“download” field batches
Open new screens
“copy” semifield batches
Launch RawTherapee to adjust images
Send batches into the respective pipeline
Check available batches
Check/Crosscheck # of images, jpgs, arws, pp3s, etc.
Backlog Spreadsheet:
Using the Backlog Spreadsheet
Must obtain view/edit permission to spreadsheet
Filling out each column respectively is important
Hiding Developed batches' rows helps keep organized
Color coded format also helps keep organized
Downloaded - Field batch has been brought over to local user
Downloading - field batch is in the process of being brought to local user
Copied - Semifield batch has been brought over to local user
Copying - Semifield batch is in the process of being brought to local user
Processed* - Batch has been opened within RawTherapee and settings have been toggled appropriately
Processing* - Batch has been sent into it’s respective pipeline
Redo - Must redownload/copy batch again, adjust profile again, then send back into pipeline
Revisit - Something seems to have gone wrong in the pipeline. Errors have been given. Must investigate. Image count does not match up, no storage remains, etc.
Developed - Batch has been sent through pipeline successfully. Image count matches
*Processed refers to settings changed, while Processing refers to sending into pipeline. Yes, it is a bit counterintuitive.
Common & Useful Commands
Available batches:
ls /mnt/research-projects/s/screberg/longterm_images2/semifield-upload/ -lh
# of images in batch:
ls /mnt/research-projects/s/screberg/longterm_images2/semifield-upload/<batch>/*.ARW | wc -l
# of jpgs processed:
ls /mnt/research-projects/s/screberg/longterm_images2/semifield-developed-images/<batch>/images/*.jpg | wc -l
# of pp3 files created:
ls /mnt/research-projects/s/screberg/longterm_images2/semifield-developed-images/<batch>/images/*.pp3 | wc -l
Blob Analyzer
Installing conda (miniconda)
Use these commands below from the command line in the SUNNY server:
mkdir -p ~/miniconda3
wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh -O ~/miniconda3/miniconda.sh
bash ~/miniconda3/miniconda.sh -b -u -p ~/miniconda3
rm ~/miniconda3/miniconda.sh
~/miniconda3/bin/conda init bash
Close the remote connection then ssh back in
Setting up a conda environment
Still in the command line inside of SUNNY:
conda create -n <your env name> python=3.10
conda activate <your env name>
cd /home/psa_images/analyze_blobs
pip install -r requirements.txt
Running the code
Your conda environment must be activated to run the code. Run these in the command line.
conda activate <your env name>
cd /home/psa_images/analyze_blobs
python ANALYZE_BLOB.py
Creates 2 time stamped files in the “results” folder in the main project directory.
A text files that provides a general summary of missing batches
A csv file that can be viewed in excel or google docs
0 Comments