List of things we want to include
Adding steps about the tools and installing those tools ( rawtherapee, mobaxterm)
Backlog Spreadsheet:
1. Download Batch
When downloading a Field batch, we must be navigated to the correct location. We can use this string of commands:
cd .. cd psa _images/field_tools/ python3 field_SUNNY_pipeline.py <batch_name>
2. Color Profiling in RawTherapee
Launch RawTherapee:
./RawTherapee_5.8.AppImage
Be sure we are located within the field_tools folder.
RawTherapee will launch in an separate window and open to the most recent profile that has been worked on. Select the appropriate batch and allow it to load. Scroll through and make a mental note if some images are out of the ordinary (i.e. too bright, too dark, out of focus, etc.).
2.1 Creating a color profile
Our goal when creating a color profile is to have every image look similarly to the rest of the batch. When RawTherapee launches, it will bring us to the last batch we worked on by default. Be sure to navigate to the intended batch. Note when there is more than one folder within the batch. We must adjust every image in each folder before sending the batch into the pipeline.
It is good practice to scan through all images to get an idea of what they are looking like, if there are any outliers, or anything to make note of.
2.2 Look for a Color Checker
We want to use an image with a color checker, if one is available within the batch. Choose the most average looking picture (lighting and color-wise). If they all look reasonably similar, we can choose whichever we want.
*In Field applications, we typically use a large Color Checker. The Semifield Color Checker may be used instead, but the larger one is preferred for this application. Either is acceptable.
2.21 Bring in a recent profile
To bring in a recent profile, we use the folder icon towards the top right of the screen, located to the left of the save button. This will open a window containing a list of saved profiles within the local user. We want to choose the most recent date in relation to the one we are working on now. The toggle tool is helpful for name and date modified, making it easier to find most recent profiles.
2.22 Color Picker
Once a previous profile is loaded in and applied, we want to use the color picker tool. The Color Picker tool is accessible by the tool bar above the working image or on “Pick” within the White Balance tab on the panel to the right.
We are only interested in using a specific gray with the color picker tool. In the image above, the gray we want is two squares above the black. Use this gray for every profile you make.
When finished, be sure to choose the hand icon to return to normal cursor mode.
2.23 Adjust exposure & saturation
Now, we navigate into the Exposure tab. This is the only tab we will work in, aside from the tab to access the Color Picker. There are only a few helpful settings to toggle here.
Our goal is to create an image that looks most closely like a real-life view of these plants. Our eyes are the most accurate check, but it can be helpful to keep an eye on the color graph in the top left that shifts when settings are changed. A good rule of thumb is for the peak of the three curves to land near this region of the graph.
*Laptop screens and Monitor settings will impact what we are working on. Try to always use the same screen when creating color profiles.
Exposure Compensation & Highlight Compression
These two go hand-in-hand. Exposure compensation should always be set to slightly more than Highlight Compression
Lightness
Has a similar effect to Exposure Compensation
Saturation
Toggle keeping in mind the intensity of colors on the color checker.
2.24 Apply, Adjust, Exit
Before exiting the program, we must apply our profile to the rest of the images within the batch. This can easily be done by:
CRTL+A
Right click
Hovering over Processing profile Operations
Hovering over Apply
Scrolling/Hovering to the desired profile
Selecting profile
Wait for profile to apply to all images
Sometimes applying to all images takes a bit of time to complete. RawTherapee will not allow clicking out of the selected images or scrolling unless it has finished applying to the selected images. We will know what images have had a new profile applied to them by looking for the gray check icon in the upper left corner of the individual image.
If most images look acceptable and a handful do not, we can choose select images by holding the CTRL key and clicking each image. Once all are selected, find the tab labeled “Batch Edit” on the right-side panel. Stick with toggling the same sliders we changed earlier. Do this until satisfied with the results. No need to re-save anything. As long as every imaged within the folders of our batch have the grey check mark, we are ready to exit RawTherapee and send into the pipeline.
3. Running the pipeline
When the color profile has been saved, we must send it through the pipeline. Be sure to be navigated to the Field folder and make a new screen, use uppercase r (-R). If returning to an already existing screen, use lowercase r (-r) with the appropriate screen name.
cd .. cd psa_images/field_tools/ screen -R <batch_name> python3 field_SUNNY_pipeline.py <batch_name>
To exit the screen, use CTRL+A D
Check on a batch sent into the pipeline by using this string of commands:
cd psa_images/field_tools/ screen -r <batch_name>
If the pipeline has either been completed running or there has been an error running it, there will be an input line. If there is no input line, the process has not completed.
To exit the screen, use CTRL+A D
3.1 Checking the success of the pipeline
If there is an indication the pipeline is finished running, we want to crosscheck the # of images within the original batch with the # of JPGs and PP3s created.
We can use both of these lines respectively:
ls /mnt/research-projects/r/raatwell/longterm_images3/field-batches/<batch>/developed-images/*.jpg | wc -l
ls /mnt/research-projects/r/raatwell/longterm_images3/field-batches/<batch>/developed-images/*.pp3 | wc -l
And compare to # of ARWs
ls /mnt/research-projects/s/screberg/longterm_images/field-batches/<batch>/*.ARW | wc -l
As long as the output # we get from each of these commands are equivalent, we know we have successfully applied the color profile to every image in the batch.
If the # of JPGs and PP3s are not equivalent to the original # of images, try running the pipeline again within the screen. Double check the name of the batch that was typed in, this is where errors are likely to happen. Also, be sure to be navigated to the Field folder. If we are within the Semifield folder, the pipeline will run successfully.
Common & Useful Commands
Available batches:
ls /mnt/research-projects/r/raatwell/longterm_images3/field-batches/ -lh
# of ARW:
ls /mnt/research-projects/s/screberg/longterm_images/field-batches/<batch>/*.ARW | wc -l
# of PP3 created:
ls /mnt/research-projects/r/raatwell/longterm_images3/field-batches/<batch>/developed-images/*.pp3 | wc -l
# of JPG files processed:
ls /mnt/research-projects/r/raatwell/longterm_images3/field-batches/<batch>/developed-images/*.jpg | wc -l
Add Comment