Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
minLevel1
maxLevel3
outlinefalse
stylenone
typelist
printabletrue

Supplies

  1. Batteries

    1. 1x Camera Battery

      1. For SVCam: there should be a power cable that connects the Bench Bot to the camera (this cable will stay with the bench bot)

    2. 1x Flash Battery

      1. For SVCam: make sure the battery is charged before deployment

    3. 4x Amiga Li-ion Batteries with 4x Keys

  2. Camera with Attached Lens (handle with care)

  3. Flash

    1. For SVCam flash system (Godox AD1200 Pro) includes flash bulb and flash box

  4. USB-A to USB-C Cable

    1. For SVCam: this should be an ethernet trailing cable

  5. Measuring Tape

  6. Color Checker

  7. Stool

  8. Grease gun/lubrication

1. Setup Bench Bot Flash

  1. Jack needs to be plugged into flash

  2. cable from camera to flash

1. Setup Bench Bot and Camera

...

Attach the camera and lens if separated.

...

Replace the battery in the camera if low.

...

Attach camera to the flash bracket. It is held in place by a screw and two washers. Try to align camera lens to parallel with the ground as best you can, and tighten as much as is reasonable. If the camera is too loose, it does not have a risk of falling but the BBot’s movement can jostle it and cause it to be pointed at an angle, which can lead to the amiga being in frame, pot edges being cut-off, etc. if this was not anticipated.

...

Checklist of these steps can be found here

1. Prior Day Preparations

  1. Charge flash battery

  2. Charge Amiga batteries

  3. Prepare supplies

    1. Color checkers (x2)

    2. Measuring tape

    3. Small step ladder

2. Supplies

BB V3.1 - SVCam

NC, TX

BBV 3.0 - Sony Camera

MD

Power:

  •  Charged flash battery
  •  BB camera power cable
  •  4 charged Amiga Lithium Ion Batteries
  •  4 Battery Keys

Power:

  •  Charged flash battery
  •  Charged camera battery
  •  4 Amiga Lithium Ion Batteries
  •  4 Battery Keys

Flash:

  •  Godox AD1200 Pro (charged flash bulb & flash box)

Flash:

  •  Flash

USB:

  •  Ethernet cable

USB:

  •  Fan setup
  •  Color Checkers - Large and passport
  •  Color Checker
  •  UI Protective Cover
  •  UI Protective Cover
  •  Measuring Tape
  •  Measuring Tape

Other:

Small Step Ladder

Grease Gun

Other:

Small Step Ladder

Grease Gun

3. Potting area maintenance

Note

Time should be allocated and scheduled in advance to ensure daily and thorough potting maintenance.

3.1 Debris removal

Before image collection begins, ensure that the potting area is free of debris. Follow these steps to maintain a clean workspace:

  • Use a leaf blower to clear debris from the surface of the landscape fabric.

    • Be cautious to avoid blowing directly into the pots, as this may displace soil or damage plants.

  • Inspect the area for any remaining loose material or obstructions and remove them manually if necessary.

A clean potting area is essential for accurate image collection and preventing unwanted elements from interfering with data quality.

image-20250129-164157.pngImage Added
image-20250129-164035.pngImage Added

3.2 Individual plant spacing

Note

Do NOT move pots unless otherwise directed to/confirmed by Matthew Kutugata.

It is, however, permissible to rotate individual pots to avoid overlapping of plants.

Proper plant spacing is critical to ensure accurate image collection and minimize occlusions. Follow these guidelines:

  1. Avoid plant overlap—thin out plants wherever overlap occurs. Be generous when thinning to maintain clear separation.

  2. Prepare the first species groups (8–10 rows) before starting the BBot imaging process.

    1. These initial rows must be fully cleaned and spaced properly before imaging begins.

  3. Continue spacing adjustments while the BBot is running.

    1. Once the first group is set, you may clean and adjust the remaining rows as imaging progresses.

Maintaining proper plant spacing reduces errors and ensures high-quality, usable images.

Image Added
Image Added
SemiField Image Acquisition.jpgImage Added

3.3 Weed Potting Area

Note

The first species groups ( 8-10 rows) need to be cleaned before the BBot begins it’s run. The remaining pots can be weeded while the BBot is imaging.

Discard non-target weeds or plants with overlapping leaves by uprooting, shaking off soil, and placing into a bucket or bag.

Do not leave removed weeds or plants on pots or on the landscape fabric. Anything green will be detected, therefore everything that should not be imaged must be removed.

  1. Eliminate non-target weeds from both the pots and the surrounding landscape fabric:

    1. Inside the pots – Check for and remove any non-target weeds.

    2. Underneath the pots – Lift pots if necessary to remove any hidden weeds.

    3. On the landscape fabric – Remove any weeds growing in or around the area.

  2. Proper disposal – Uproot unwanted plants, shake off excess soil, and place them in a designated disposal bucket or bag. Do not leave removed plants on pots or the landscape fabric, as anything green may be detected in the images.

Note

Attention to detail is crucial! Take care to remove all non-target weeds without rushing, and avoid being in the images during the process.

Image Added

image-20250129-165953.pngImage Added

3.4 More examples of non-target weeds and dirty potting areas

Expand
titleDropdown to see examples
image-20250129-170311.pngImage Addedimage-20250129-170528.pngImage Addedimage-20250129-170443.pngImage Addedimage-20250129-170420.pngImage Addedimage-20250129-170327.pngImage Addedimage-20250129-170235.pngImage Addedimage-20250129-170247.pngImage Added

4. Camera/Flash/BBot Setup

4.1 Attaching the Camera & Flash

BB V3.1 - SVCam

NC, TX

BBV 3.0 - Sony Camera

MD

  1. Attach camera to bracket on BBot

    1. Slide the black triangle piece on camera bracket into the piece toward the bottom of the

...

    1. Z-axis.

    2. Make sure to have a strong grip on the flash/camera and

...

    1. have a hand below the camera

...

  1. remove lens cap if needed, and keep handy as it will need to be replaced during pack-up stage

...

Unscrew the cap (keep handy as it will need to be replaced during pack-up stage) on the BBot box USB port. At this point, you may attach the camera to the box via the USB-C to USB-A cable (ethernet trailing cable for NC site). If using a long cable, make sure it does not hang below the camera so that it does not get in any of the photos.

...

If there is a risk of rain or if it is a hot, sunny day, it is advisable to put a cover over the camera.

...

Place the four amiga batteries into the BBot. There is a battery slot above each wheel that they will slide into. Make sure it slides into the bench bot’s internal track, it can be easy to slide one of the sides on top the track instead of in it.

...

Once all batteries are inserted, you may put the keys into the battery. When turning from “Unlocked” to “Off”, a little peg will push out of the battery (on it’s bottom side) to enter a hole in the frame of the Amiga. If you cannot change the battery from “Unlocked,” then it is likely the peg cannot extend down into the hole due to a misalignment. You may just have to wiggle the battery around a little bit, or the battery may not be in the tracks and you may have to slide it out and slide it back in properly.

...

Plug the dangling power cables into their batteries. Each battery has its own power cable.

...

Turn on the batteries with the key.

...

At this point BBot will begin booting up. The Amiga interface will be immediately available to use, while the BBot app interface will take a minute or two to boot. Remove the cover from the amiga interface, and press start. Reduce the motor speed to 4 bars (a value of 80). We do not want to BBot moving too fast.

...

Adjust the BBot alignment if needed using the joystick. At MD, the bench itself is a little curved so it can be difficult to get a straight alignment. Try your best to get the BBot wheels to be as parallel as you can with the left and right edges of the pots. It is okay to pause the BBot when it is running to make quick alignment adjustments later when you are conducting the batch collection. When choosing a starting place, make sure the camera is above the first row.

...

On the Amiga interface, click the “Auto” tab on the left (it is an A surrounded by a circle). On this page, turn auto-control on. The light on the joystick should be orange or blue. When this is on, the BBot will be able to control itself (so the Y-axis is now controlled), but the joystick will be unresponsive. To make further BBot adjustments with the joystick, you may turn this off when needed. Make sure to turn back on after making your adjustments, however, because if BBot is started with this “off,” then it will be unable to move forward and will continuously take images of the same row.

2. Thin and Weed Potting Area

Discard non-target weeds or overlapping plants by pulling them, shaking off their soil, and placing them into a bucket or bag. Do not leave removed weeds or plants on pots or on the landscape fabric. This is to avoid detecting them in the images that we collect.

  1. Remove overlapping target weeds in all pots

  2. Remove non-target weeds from pots and from the background area

    1. Check inside the pots for non-target weeds

    2. Check and remove weeds growing from underneath the pots

    3. Check for and remove weeds growing on the landscape fabric

...

    1. , ensuring it does not drop to the ground.

  1. Set up Flash

    1. Plug jack into flash.

    2. Run camera cable to flash.

  1. Check camera’s Focus, Aperture, and Height - Settings Table

    1. Height: Confirm the distance from camera lens to top of pot.

  1. Attach camera to flash bracket.

  1. Plug in green cable to brain of camera

  1. Align camera lens parallel with the ground.

  1. Plug in ethernet training cable from camera to BBot power box

  1. Tighten screw & two washers until sturdy.

  1. Attach “audio jack” to the flash box

  1. Attach camera to BBot bracket.

  1. Check for battery in flash box

  1. Attach camera to bracket on BBot

    1. Slide the black triangle piece on camera bracket into the piece toward the bottom of the Z-axis.

    2. Make sure to have a strong grip on the flash/camera and have a hand below the camera, ensuring it does not drop to the ground.

  1. Plug in flash bulb power cable to flash box

  1. Remove lens cap.

  1. Power on flash and check settings on flash box

  1. Unscrew the protective cap on the BBot power box. Inside is a USB port.

  1. Set Flash box on top of camera mount (safely)

  1. Plug USB-A to USB-C cable into USB port and camera respectively.

  1. If cable has extra slack, make sure it is not dangling in view of lens.

  1. It is advisable to put a sunshade over the camera.

4.2 Configuring the SVCam

Note

The SVCam must be plugged in prior to the BBot being powered on.

If not done properly, we risk the camera being fried with the sudden power surge.

img_1442_720.jpgImage Added

IMG_1432.jpgImage Added

image-20250122-152246.pngImage Added
IMG_1433.jpgImage Added
IMG_1440.jpgImage Added
IMG_1439.jpgImage Added

4.21 Check Camera and Flash Settings

Make sure that the camera settings match what is listed in the camera settings table

  1. Check aperture is correct

  2. Check that the focus is correct

  3. Check the flash power

  4. Check height of the lens from the potting soil surface using a measuring tape

  5. Place the color checker in frame of the starting position

  6. Open the BBot app on the BBot interface and press the “take image” button to take a test image.

4.22 Camera and Flash Settings

...

Table

  1. To avoid the Amiga

...

  1. frame being in

...

  1. images,

...

  1. the starting camera

...

  1. position

...

  1. must be further away from its right/leftmost position,

...

  1. “0 cm”.

  2. Beginning in the “0 cm” position, move it the

...

  1. appropriate distance relevant to the site location (refer to the “X-axis starting” column in the Settings Table ).

  2. If

...

  1. changing your species map

...

  1. ,

...

  1. use the “Species Map” tab to build it.

...

  1. Enter the information in the table corresponding to your site to build the species map.

...

    1. Currently, the selected species is unimportant, as we do not use

...

    1. those metadata. Be sure to

...

    1. have a species

...

    1. selected. If

...

    1. it is left as “none”, the BBot will not take images there.

    2. After

...

    1. inputting the settings, click

...

    1. “Add Rows” and

...

    1. a map will appear on the right side of the screen.

...

    1. If looking accurate, press “Save.” If

...

    1. not

...

    1. saved,

...

    1. a map will not appear in the “Traversal” tab and

...

    1. it will

...

    1. need to

...

    1. be rebuilt.

BenchBot App

...

Settings Table

Site

Semi-Field Potting Area Dimensions

Semi-Field Physical Pot Layout

BB App Programmed Settings

...

Camera Settings

Notes

...

Site

Width

...

length

...

(m)

Length (m)

Pots/Row

Number of Rows

On-Center pot spacing (in)

Programmed Number of Rows

Pots

...

/Row

Pot Spacing (cm)

Row spacing (cm)

X-axis starting (cm)

Z-axis height

...

Height of lens over pot surface

...

aperture

...

flash power

...

(cm)

Y-axis starting (cm)

Aperture

Flash power

Focus

Exposure

NC

15

43

40

+

...

58

...

170

12-13

...

MD (BARC)

...

6.1m

...

1/1

...

21

...

updated 12/04/2024

...

NC

...

7.0m

...

33.5m

...

15

...

50

...

1.5 ft

...

15

...

15

...

43 cm

...

43 cm

...

58 cm

...

1.7 m

...

updated 11/12/2024

20.75

300

Updated 1/15/2025

TX

MD

6.1

39.0

80

11

...

45

...

30

40

...

NCSU Test 2 7/11/24

...

40

...

17

...

39

...

25

...

Start with 54cm offset

Amiga should not appear in pics

...

NCSU 7/15/24 to Present

...

Variable

...

15

...

45 cm

...

30 cm

...

Start with 73cm offset

Amiga should not appear in pics (but will if the camera is tilted).

...

NCSU

10/30/24

...

15

...

21

...

46cm

25

...

15

...

46 cm

...

46 cm

...

this is the start of the collection season. this is the first setting to try

...

TX

...

Updated 10/19/2024

...

NCSU

...

7.0m

...

33.5m

...

79

...

8

...

53 cm

...

38 cm

...

NCSU Test 1 7/9/24

...

7.0m

...

33.5m

...

40

...

19

...

39

...

25

...

Start with 3cm offset from home on X axis. Failed reconstruction, however significant improvement. Amiga not removed from FOV

4.3 BBot Setup

4.31 Gantry setup

  •  Place the 4 Amiga batteries into their slot above each wheel.
  • Slides into internal track as it is easy to miss.

  •  Insert key into each battery.
  • When turning from “Unlocked” to “Off”, gentle pressure must be applied towards the battery.

  • A peg will push out of the underside of the battery, entering a hole in the metal panel of the Amiga.

  • If not unlocking, the battery is likely misaligned. Try reinserting the battery.

  •  Plug the dangling power cable into each respective battery.
  •  Turn the key to the “On” position.
  • Boot up will commence.

  •  Remove cover from Amiga interface if applicable and press “Start”.
Note

Reduce motor speed to 4 bars (value of 80)

By default, motor speed is set to half power. Adverse conditions can occur if left at default setting.

  •  Adjust alignment using the joystick. Get the wheels parallel to the pot edges, as best as possible.
  • When choosing a starting place, make sure the camera is above the first row.

  • Pausing the BBot during batch collection to adjust alignment is okay.

  •  Click the “Auto” tab on the left of interface (“A” surrounded by a circle) and turn on Auto-Control.
  1. The light on the joystick will be orange or blue. When on, the BBot can control itself (Y-axis), but the joystick will be unresponsive.

  2. To use the joystick, turn this off.

Note
  1. Turn back on after making your adjustments. If BBot runs with this “off,” it will not move forward, continuously taking images of the same row.

5. Test Image Collection

Place color checkers in appropriate starting position.

Take test image and validate everything is in order.

  1. Make sure flash is triggering

  2. Make sure there are not obvious signs of poor quality in the images using the interface

  3. Make sure the BBot wheels base is not in the image frame.

6. Begin the Batch

  1. Place 2 Color Checkers in the potting area. Place one ~15cm above the pot surface using something to prop it up. Place the other at the height of the pot surface. Shown below.

image-20250122-153158.pngImage Added

IMG_1444.jpgImage Added
  1. Enter number of species, pots, pot spacing, etc.

  2. Start BBot collection via the “run” button on the “Traversal” tab

  3. Stick around for at least the first two rows to ensure everything is working properly.

    1. If the BBot is not

...

    1. moving forward after a row,

...

    1. check the

...

    1. Auto button on the Amiga interface. It is likely

...

    1. turned off (the joystick light should be blue or orange, not white).

  1. Move the color checker

...

  1. when the BBot has passed over it. Bring it to a new are that has yet be imaged. It is good practice to put it at the start of every species

...

  1. .

  2. When BBot reaches the ends of a row, check these outermost photos

...

Depending on site, you may have to replace the flash battery every once and a while.

  1. At MD, our BBot does not charge the flash as it goes along, so the battery is not gaining any charge. I find that the Battery lasts about 2.5 species normally, so I like to change it out at the end of the second species and the end of the fourth species. Make sure to pause the BBot traversal before doing so, and also when you slip the new battery in, turn the flash on. The flash does not automatically turn on (even if it was still on when your removed the old battery), so you will have to manually turn it on again. Always have your flash batteries charging in case you are ready at any moment.

...

  1. for the Amiga. If the wheels or frame are in the image, you will need to readjust the camera angle or starting point on the X-axis.

7. Packing-Up

  1. Return BBot to its starting position.

...

Reapply lens cap to camera lens if needed

  1. Turn off the BBot and remove batteries, then unplug the camera and other cords.

  2. Leave the BBot on for sometime to allow images to transfer

  3. Be sure to replace the protective covers on plugs and cords.

Note

Not replacing protective covers leave them vulnerable to corrosion, potentially damaging equipment.

20250128_163124 (1).jpgImage Added
20250128_163131.jpgImage Added
  1. Take the camera off the BBot

...

  1. by disengaging the triangle mounting

...

  1. , paying mind to the weight of the camera.

  2. Pack away any accessories

...

  1. (Color Checker,

...

  1. measuring tapes, etc.).

...

Turn off Amiga batteries and unplug them.

  1. Bring everything inside, and charge all batteries so that they are ready for the next batch collection.

...

8.

...

No images taken

In the mini-computer (via piKVM)

While in the mini-computer, you execute localhost:5000/image in the address bar, and this message is returned:

Code Block
{“text”: “RAW BMP missing”, “imageTaken”: 0}

on the screen it says “Raw BMP missing”

Order of operations

power to camera

data to camera

flash to camera

  1. power cable to the camera

  2. flash camera from the camera (camera to flash)

  3. data ethernet cable from the camera to the box

torubleshooting

...

check that cable are securely in place (unplug and re-plug)

  • flash to camera cable

  • data cable

  • power cable (make sure to properly turn off the bbot before removing power cable)

check that the mini computer is and camera are communicating

Basic Troubleshooting Tips:

...

Reboot BBot

...

Troubleshooting

8.1 Basic Troubleshooting Tips:

  • Check the emergency breaks. Make sure they aren’t active. They should be lifted so that you can see a strip of black below them, indicating the brakes are not on.

  • Check

...

  • wi-fi connection. On the

...

  • top right corner of the

...

  • BBot interface. If no signal, Advanced wi-fi settings can be

...

  • assessed in settings if there is no signal.

  • Check Amiga settings. Make sure they are properly set.

  • Check

...

  • camera

...

  • & flash. Make sure they are turned on

...

  • and plugged

...

  • in.

  • Reboot the system. Remember to turn off BBot before unplugging camera.

8.2 “Missing JPG/RAW” , “Missing JPG” ,

...

Image loading indefinitely

It is believed this is caused by an issue with the camera having a proper connection to BBot.

...

Try to remedy this by:

  • Unplugging the camera cable from both ports several times. Try to image after each attempt.

  • Dismounting the camera and moving it a little bit.

...

  • Remove & replace the battery. Doing anything to maybe jostle something back into place.

  • Rebooting BBot.

...

8.3 BBot

...

taking images in

...

same spot

...

, unable to move (

...

X

...

& Y axis motors)

  • Restart the BBot app

...

  • .

...

  • Simply close

...

  • and reopen

...

Examples of Plant Spacing and Non-Target Weeds

Non-target weeds

...

Plant spacing

Avoid overlapping plants. Thin plants when they do overlap. Be liberal when thinning plants. We don’t need to worry about having enough plants. It’s more important to have no overlap than it is to have more plants per plot.

Prioritize no-overlap for plant within a pot and no-overlap of plants from different pots. View below for examples of good plant spacing.

Within-Pot Plant Spacing

...

Between-Pot Plant Spacing

...

  • .

8.4 “No images taken”

In the mini-computer (via piKVM)

While in the mini-computer, execute localhost:5000/image in the address bar. This message is returned:

Code Block
{“text”: “RAW BMP missing”, “imageTaken”: 0}

on the screen it says “Raw BMP missing”

  • Cabling - Step by step

  1. Power cable → Camera

  2. Data cable → Camera

  3. Flash cables and Camera

    1. Power Cable → Camera

    2. Camera → Flash

    3. Data ethernet (from camera) → Power Box

Note

Make sure to plug in the camera in before turning on the BBot.

Make sure to turn off the BBot before removing power cable from camera.

  • Check cables. Make sure they are plugged in securely.

  • Check Minicomputer. Make sure it is properly communicating with the camera.