Table of Contents | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Supplies
Batteries
1x Camera Battery
1x Flash Battery
4x Amiga Batteries with 4x Keys
Camera with Attached Lens (handle with care)
Flash
USB-A to USB-C Cable
Measuring Tape
Color Checker
Stool
1. Setup Bench Bot and Camera
...
Attach the camera and lens if separated.
...
Replace the battery in the camera if low. I have found that
...
Attach camera to the flash bracket. It is held in place by a screw and two washers. Try to align camera lens to parallel with the ground as best you can, and tighten as much as is reasonable. If the camera is too loose, it does not have a risk of falling but the BBot’s movement can jostle it and cause it to be pointed at an angle, which can lead to the amiga being in frame, pot edges being cut-off, etc. if this was not anticipated.
...
Checklist of these steps can be found here
1. Prior Day Preparations
Charge flash battery
Charge Amiga batteries
Prepare supplies
Color checkers (x2)
Measuring tape
Small step ladder
2. Supplies
BB V3.1 - SVCam NC, TX | BBV 3.0 - Sony Camera MD |
---|---|
Power:
| Power:
|
Flash:
| Flash:
|
USB:
| USB:
|
|
|
|
|
|
|
Other: Small Step Ladder Grease Gun | Other: Small Step Ladder Grease Gun |
3. Potting area maintenance
Note |
---|
Time should be allocated and scheduled in advance to ensure daily and thorough potting maintenance. |
3.1 Debris removal
Before image collection begins, ensure that the potting area is free of debris. Follow these steps to maintain a clean workspace:
Use a leaf blower to clear debris from the surface of the landscape fabric.
Be cautious to avoid blowing directly into the pots, as this may displace soil or damage plants.
Inspect the area for any remaining loose material or obstructions and remove them manually if necessary.
A clean potting area is essential for accurate image collection and preventing unwanted elements from interfering with data quality.
3.2 Individual plant spacing
Note |
---|
Do NOT move pots unless otherwise directed to/confirmed by Matthew Kutugata. It is, however, permissible to rotate individual pots to avoid overlapping of plants. |
Proper plant spacing is critical to ensure accurate image collection and minimize occlusions. Follow these guidelines:
Avoid plant overlap—thin out plants wherever overlap occurs. Be generous when thinning to maintain clear separation.
Prepare the first species groups (8–10 rows) before starting the BBot imaging process.
These initial rows must be fully cleaned and spaced properly before imaging begins.
Continue spacing adjustments while the BBot is running.
Once the first group is set, you may clean and adjust the remaining rows as imaging progresses.
Maintaining proper plant spacing reduces errors and ensures high-quality, usable images.
3.3 Weed Potting Area
Note |
---|
The first species groups ( 8-10 rows) need to be cleaned before the BBot begins it’s run. The remaining pots can be weeded while the BBot is imaging. |
Discard non-target weeds or plants with overlapping leaves by uprooting, shaking off soil, and placing into a bucket or bag.
Do not leave removed weeds or plants on pots or on the landscape fabric. Anything green will be detected, therefore everything that should not be imaged must be removed.
Eliminate non-target weeds from both the pots and the surrounding landscape fabric:
Inside the pots – Check for and remove any non-target weeds.
Underneath the pots – Lift pots if necessary to remove any hidden weeds.
On the landscape fabric – Remove any weeds growing in or around the area.
Proper disposal – Uproot unwanted plants, shake off excess soil, and place them in a designated disposal bucket or bag. Do not leave removed plants on pots or the landscape fabric, as anything green may be detected in the images.
Note |
---|
Attention to detail is crucial! Take care to remove all non-target weeds without rushing, and avoid being in the images during the process. |
3.4 More examples of non-target weeds and dirty potting areas
Expand | ||
---|---|---|
| ||
4. Camera/Flash/BBot Setup
4.1 Attaching the Camera & Flash
BB V3.1 - SVCam NC, TX | BBV 3.0 - Sony Camera MD |
---|---|
|
...
|
...
|
...
Unscrew the cap on the BBot box USB port. At this point, you may attach the camera to the box via the USB-C to USB-A cable. If using a long cable, make sure it does not hang below the camera so that it does not get in any of the photos.
...
If there is a risk of rain or if it is a hot, sunny day, it is advisable to put a cover over the camera.
...
Place the four amiga batteries into the BBot. There is a battery slot above each wheel that they will slide into. Make sure it slides into the bench bot’s internal track, it can be easy to slide one of the sides on top the track instead of in it.
...
Once all batteries are inserted, you may put the keys into the battery. When turning from “Unlocked” to “Off”, a little peg will push out of the battery (on it’s bottom side) to enter a hole in the frame of the Amiga. If you cannot change the battery from “Unlocked,” then it is likely the peg cannot extend down into the hole due to a misalignment. You may just have to wiggle the battery around a little bit, or the battery may not be in the tracks and you may have to slide it out and slide it back in properly.
...
Plug the dangling power cables into their batteries. Each battery has its own power cable.
...
Turn on the batteries with the key.
...
At this point BBot will begin booting up. The Amiga interface will be immediately available to use, while the BBot app interface will take a minute or two to boot. Remove the cover from the amiga interface, and press start. Reduce the motor speed to 4 bars (a value of 80). We do not want to BBot moving too fast.
...
Adjust the BBot alignment if needed using the joystick. At MD, the bench itself is a little curved so it can be difficult to get a straight alignment. Try your best to get the BBot wheels to be as parallel as you can with the left and right edges of the pots. It is okay to pause the BBot when it is running to make quick alignment adjustments later when you are conducting the batch collection. When choosing a starting place, make sure the camera is above the first row.
...
On the Amiga interface, click the “Auto” tab on the left (it is an A surrounded by a circle). On this page, turn auto-control on. The light on the joystick should be orange or blue. When this is on, the BBot will be able to control itself (so the Y-axis is now controlled), but the joystick will be unresponsive. To make further BBot adjustments with the joystick, you may turn this off when needed. Make sure to turn back on after making your adjustments, however, because if BBot is started with this “off,” then it will be unable to move forward and will continuously take images of the same row.
2. Thin and Weed Potting Area
Discard non-target weeds or overlapping plants by pulling them, shaking off their soil, and placing them into a bucket or bag. Do not leave removed weeds or plants on pots or on the landscape fabric. This is to avoid detecting them in the images that we collect.
Remove overlapping target weeds in all pots
Remove non-target weeds from pots and from the background area
Check inside the pots for non-target weeds
Check and remove weeds growing from underneath the pots
Check for and remove weeds growing on the landscape fabric
...
1.66 m
4. Check and Adjust BBot App Settings
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
|
4.2 Configuring the SVCam
Note |
---|
The SVCam must be plugged in prior to the BBot being powered on. If not done properly, we risk the camera being fried with the sudden power surge. |
4.21 Check Camera and Flash Settings
Make sure that the camera settings match what is listed in the camera settings table
Check aperture is correct
Check that the focus is correct
Check the flash power
Check height of the lens from the potting soil surface using a measuring tape
Place the color checker in frame of the starting position
Open the BBot app on the BBot interface and press the “take image” button to take a test image.
4.22 Camera and Flash Settings Table
...
Lens height above potting soil surface
...
Aperture
...
Focus
...
Flash Power
To avoid the Amiga
...
frame being in
...
images,
...
the starting camera
...
position
...
must be further away from its right/leftmost position,
...
“0 cm”.
Beginning in the “0 cm” position, move it the
...
appropriate distance relevant to the site location (refer to the “X-axis starting” column in the Settings Table ).
If
...
changing your species map
...
,
...
use the “Species Map” tab to build it.
...
Enter the information in the table corresponding to your site to build the species map.
...
Currently, the selected species is unimportant, as we do not use
...
those metadata. Be sure to
...
have a species
...
selected. If
...
it is left as “none”, the BBot will not take images there.
After
...
inputting the settings, click
...
“Add Rows” and
...
a map will appear on the right side of the screen.
...
If looking accurate, press “Save.” If
...
not
...
saved,
...
a map will not appear in the “Traversal” tab and
...
it will
...
need to
...
be rebuilt.
BenchBot App
...
Settings Table
Site | Semi-Field Potting Area Dimensions | Semi-Field Physical Pot Layout | BB App Programmed Settings | Camera Settings | Notes |
---|
...
Width |
...
length
...
(m) | Length (m) | Pots/Row | Number of Rows | On-Center pot spacing (in) | Programmed Number of Rows | Pots |
...
/Row | Pot Spacing (cm) | Row spacing (cm) | X-axis starting (cm) | Z-axis height |
...
NC
...
7.0m
...
33.5m
...
15
...
1.5 ft
...
(cm) | Y-axis starting (cm) | Aperture | Flash power | Focus | Exposure | |||
NC | 15 | 43 |
...
...
MD (BARC)
...
6.1m
...
40 |
...
58 cm
...
1.7 m
...
updated 11/12/2024
+58 | 170 | 12-13 | 1/1 | 20.75 | 300 | Updated 1/15/2025 | |||||||||||
TX | |||||||||||||||||
MD | 6.1 | 39.0 | 80 | 11 |
...
45 |
...
30 | 40 |
...
NCSU Test 2 7/11/24
...
40
...
17
...
39
...
25
...
Start with 54cm offset
Amiga should not appear in pics
...
NCSU 7/15/24 to Present
...
Variable
...
15
...
45 cm
...
30 cm
...
Start with 73cm offset
Amiga should not appear in pics (but will if the camera is tilted).
...
NCSU
10/30/24
...
15
...
21
...
46cm
25
...
15
...
46 cm
...
46 cm
...
this is the start of the collection season. this is the first setting to try
...
TX
...
Updated 10/19/2024 |
...
NCSU
...
7.0m
...
33.5m
...
79
...
8
...
53 cm
...
38 cm
...
NCSU Test 1 7/9/24
...
7.0m
...
33.5m
...
40
...
19
...
39
...
25
...
Start with 3cm offset from home on X axis. Failed reconstruction, however significant improvement. Amiga not removed from FOV
4.3 BBot Setup
4.31 Gantry setup
|
Slides into internal track as it is easy to miss.
|
When turning from “Unlocked” to “Off”, gentle pressure must be applied towards the battery.
A peg will push out of the underside of the battery, entering a hole in the metal panel of the Amiga.
If not unlocking, the battery is likely misaligned. Try reinserting the battery.
|
|
Boot up will commence.
|
Note |
---|
Reduce motor speed to 4 bars (value of 80) By default, motor speed is set to half power. Adverse conditions can occur if left at default setting. |
|
When choosing a starting place, make sure the camera is above the first row.
Pausing the BBot during batch collection to adjust alignment is okay.
|
The light on the joystick will be orange or blue. When on, the BBot can control itself (Y-axis), but the joystick will be unresponsive.
To use the joystick, turn this off.
Note |
---|
|
5. Test Image Collection
Place color checkers in appropriate starting position.
Take test image and validate everything is in order.
Make sure flash is triggering
Make sure there are not obvious signs of poor quality in the images using the interface
Make sure the BBot wheels base is not in the image frame.
6. Begin the Batch
Place 2 Color Checkers in the potting area. Place one ~15cm above the pot surface using something to prop it up. Place the other at the height of the pot surface. Shown below.
Enter number of species, pots, pot spacing, etc.
Start BBot collection via the “run” button on the “Traversal” tab
Stick around for at least the first two rows to ensure everything is working properly.
If the BBot is not
...
moving forward after a row,
...
check the
...
Auto button on the Amiga interface. It is likely
...
turned off (the joystick light should be blue or orange, not white).
Move the color checker
...
when the BBot has passed over it. Bring it to a new are that has yet be imaged. It is good practice to put it at the start of every species
...
.
When BBot reaches the ends of a row, check these outermost photos
...
Depending on site, you may have to replace the flash battery every once and a while.
At MD, our BBot does not charge the flash as it goes along, so the battery is not gaining any charge. I find that the Battery lasts about 2.5 species normally, so I like to change it out at the end of the second species and the end of the fourth species. Make sure to pause the BBot traversal before doing so, and also when you slip the new battery in, turn the flash on. The flash does not automatically turn on (even if it was still on when your removed the old battery), so you will have to manually turn it on again. Always have your flash batteries charging in case you are ready at any moment.
...
for the Amiga. If the wheels or frame are in the image, you will need to readjust the camera angle or starting point on the X-axis.
7. Packing-Up
Return BBot to its starting position.
...
Turn off the BBot and remove batteries, then unplug the camera
...
and other cords.
Leave the BBot on for sometime to allow images to transfer
Be sure to replace the protective covers on plugs and cords.
Note |
---|
Not replacing protective covers leave them vulnerable to corrosion, potentially damaging equipment. |
Take the camera off the BBot
...
by disengaging the triangle mounting
...
, paying mind to the weight of the camera.
Pack away any accessories
...
(Color Checker,
...
measuring tapes, etc.)
...
.
Bring everything inside, and charge all batteries so that they are ready for the next batch collection.
...
8.
...
Troubleshooting
8.1 Basic Troubleshooting Tips:
...
Check
...
the emergency breaks
...
. Make sure they aren’t active. They should be lifted so that you can see a strip of black below them, indicating the brakes are not on.
Check
...
wi-fi connection. On the
...
top right corner of the
...
BBot interface. If no signal, Advanced wi-fi settings can be
...
assessed in settings if there is no signal.
Check Amiga settings. Make sure they are properly set.
Check
...
camera
...
& flash. Make sure they are turned on
...
and plugged
...
in.
Reboot the system. Remember to turn off BBot before unplugging camera.
8.2 “Missing JPG/RAW” , “Missing JPG” ,
...
Image loading indefinitely
It is believed this is caused by an issue with the camera having a proper connection to BBot.
...
Try to remedy this by:
Unplugging the camera cable from both ports several times. Try to image after each attempt.
Dismounting the camera and moving it a little bit.
...
Remove & replace the battery. Doing anything to maybe jostle something back into place.
Rebooting BBot.
...
8.3 BBot
...
taking images in
...
same spot
...
, unable to move (
...
X
...
& Y axis motors)
Restart the BBot app
...
.
...
Simply close
...
and reopen
...
Examples of Plant Spacing and Non-Target Weeds
Non-target weeds
...
Plant spacing
Avoid overlapping plants. Thin plants when they do overlap. Be liberal when thinning plants. We don’t need to worry about having enough plants. It’s more important to have no overlap than it is to have more plants per plot.
Prioritize no-overlap for plant within a pot and no-overlap of plants from different pots. View below for examples of good plant spacing.
Within-Pot Plant Spacing
...
Between-Pot Plant Spacing
...
.
8.4 “No images taken”
In the mini-computer (via piKVM)
While in the mini-computer, execute localhost:5000/image in the address bar. This message is returned:
Code Block |
---|
{“text”: “RAW BMP missing”, “imageTaken”: 0} |
on the screen it says “Raw BMP missing”
Cabling - Step by step
Power cable → Camera
Data cable → Camera
Flash cables and Camera
Power Cable → Camera
Camera → Flash
Data ethernet (from camera) → Power Box
Note |
---|
Make sure to plug in the camera in before turning on the BBot. Make sure to turn off the BBot before removing power cable from camera. |
Check cables. Make sure they are plugged in securely.
Check Minicomputer. Make sure it is properly communicating with the camera.