Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

To exit the screen, use CTRL+A D

...

1.1 Checking if the batch was completely copied

...

Example: MD_2024-07-02

Code Block
 ls /mnt/research-projects/s/screberg/longterm_images2/semifield-upload/MD_2024-07-02/*.ARW | wc -l

output: 560

Code Block
ls /home/psa_images/temp_data/semifield-upload/MD_2024-07-02/*.ARW | wc -l

output (before running the pipeline): 560

output (after running the pipeline): 0

Code Block
ls /mnt/research-projects/s/screberg/longterm_images2/semifield-developed-images/MD_2024-07-02/images/*.jpg | wc -l

output (after running the pipeline): 560

1.12 Trouble shooting:

If developed jpgs are not in the longterm storage, check to see if they’re still in the local temp_data outputs folder:

...

When entire batch is fully completed, the row can be hidden by right clicking on the row #, then click hide.

5

...

4.1 Installing conda (miniconda) 

Use these commands below from the command line in the SUNNY server:

Code Block
mkdir -p ~/miniconda3
wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh -O ~/miniconda3/miniconda.sh
bash ~/miniconda3/miniconda.sh -b -u -p ~/miniconda3
rm  ~/miniconda3/miniconda.sh
~/miniconda3/bin/conda init bash

Close the remote connection, then SSH back in

4.2 Setting up a conda environment

Still in the command line inside of SUNNY:

Code Block
conda create -n <your env name> python=3.10
conda activate <your env name>
cd /home/psa_images/analyze_blobs
pip install -r requirements.txt

4.3 Running the code 

Your conda environment must be activated to run the code.

Run these in the command line:

Code Block
conda activate <your env name>
cd /home/psa_images/analyze_blobs
python ANALYZE_BLOB.py
  1. Creates 2 time stamped files in the “results” folder in the main project directory. 

    1. A text files that provides a general summary of missing batches

    2. A csv file that can be viewed in excel or google docs

...

. Common & Useful Commands

Available batches:

Code Block
ls /mnt/research-projects/s/screberg/longterm_images2/semifield-upload/ -lh

...