Backlog Spreadsheet:
| Lref gdrive file | ||
|---|---|---|
|
| Table of Contents | ||
|---|---|---|
|
1. Download Batch
When downloading a Field batch, navigate to the correct location. Use this string of commands:
| Code Block |
|---|
cd .. cd psa _images/field_tools/ python3 fielddownload_SUNNYraw_pipelinebatch.py <batch_name> |
2. Color Profiling in RawTherapee
...
We want to use an image with a color checker, if one is available within the batch. Choose the most average looking picture (lighting and color-wise). If they all look reasonably similar, we can choose whichever we want.
...
*In Field applications, a large Color Checker is typically used. The Semifield Color Checker might be used instead, but the larger one is preferred for this application. Either is acceptable.
...
Exposure Compensation & Highlight Compression
These two go hand-in-hand. Exposure compensation should always be set to slightly more than Highlight Compression
Lightness
Has a similar effect to Exposure Compensation
Saturation
Toggle keeping in mind the intensity of colors on the color checker.
2.24
...
Save, apply,
...
adjust,
...
exit
...
Before exiting the program, we must apply our the new profile to the rest of the images within in the batch. This can easily be done by:
CRTL+A
Right click
Hovering over Processing profile Operations
Hovering over Apply
Scrolling/Hovering to the desired profile
Selecting profile
Wait for profile to apply to all images
Sometimes, applying to all images takes a bit of time to complete. RawTherapee will not allow clicking out of the selected images or scrolling unless it has finished applying to the selected images. We will know what images have had a new profile applied to them by looking for the There will be a gray check icon in the upper left corner of the individual imagethe images, the new profile has been applied.
...
If most images look acceptable and a handful , but some do not, we can choose select images by holding the CTRL key and clicking each image. Once all are selected, find the tab labeled “Batch Edit” on the right-side panel. Stick with toggling Toggling the same sliders we changed from earlier. Do this until satisfied with the results. No need to re-save anything. As long as every imaged image within the batch’s folders of our batch have the grey check mark, we are ready it is okay to exit RawTherapee and send the batch into the pipeline.
3. Running the pipeline
When the color profile has been saved, we must send it through it is time to send the batch into the pipeline. Be sure Navigate to be navigated to the Field folder and make if not already there. Make a new screen, use . Use uppercase r (-R) to create a new screen. If returning to an already existing screen, use lowercase r (-r) with the appropriate screen name.
...
To exit the screen, use CTRL+A D
...
4.
...
Checking the success of the pipeline
If there is an indication the pipeline is finished running, we want to crosscheck the # of images within the original batch with the # of JPGs and PP3s created.
We can use both of these lines respectively:
| Code Block | ||
|---|---|---|
| ||
ls /mnt/research-projects/r/raatwell/longterm_images3/field-batches/<batch>/developed-images/*.jpg | wc -l |
| Code Block | ||
|---|---|---|
| ||
ls /mnt/research-projects/r/raatwell/longterm_images3/field-batches/<batch>/developed-images/*.pp3 | wc -l |
And compare to The # of ARWs should be 0. Check using:
| Code Block | |
|---|---|
| wide | ls /mnt/research-projects/s/screberg/longterm_images/field-batches/<batch>/*.ARW | wc -l |
As long as the output # we get from each of these of the first two commands are equivalent , we know we have successfully applied to each other the color profile has successfully been applied to every image in the batch.
If the # of JPGs and PP3s are not equivalent to the original # of images, try running the pipeline again within the same screen. Double check the name of the batch that was typed in, this is where errors are likely to happen. Also, be sure to be navigated to the Field Semifield folder. If we are within the Semifield navigated to the Field folder, the pipeline will run successfully.
not be successful.
Example: TX_2023-09-29
Step 1 : Cross-check the original image count to the Backlog spreadsheet
| Code Block |
|---|
ls /mnt/research-projects/r/raatwell/longterm_images3/field-batches/<batch>/developed-images/*.pp3 | wc -l |
The output number should equal the sum of the batch (if applicable: add 01+02+02, etc.)
Common & Useful Commands
Available batches:
| Code Block | |
|---|---|
| wide | ls /mnt/research-projects/r/raatwell/longterm_images3/field-batches/ -lh |
# of ARW:
| Code Block | breakoutMode | wide
|---|
ls /mnt/research-projects/s/screberg/longterm_images/field-batches/<batch>/*.ARW | wc -l |
# of PP3 created:
| Code Block | breakoutMode | wide
|---|
ls /mnt/research-projects/r/raatwell/longterm_images3/field-batches/<batch>/developed-images/*.pp3 | wc -l |
# of JPG files processed:
| Code Block | breakoutMode | wide
|---|
ls /mnt/research-projects/r/raatwell/longterm_images3/field-batches/<batch>/developed-images/*.jpg | wc -l |