Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
minLevel1
maxLevel3
outlinefalse
stylenone
typelist
printabletrue

Checklist of these steps can be found here

1. Prior Day Preparations

  1. Charge flash battery

  2. Charge Amiga batteries

  3. Prepare supplies

    1. Color checkers (x2)

    2. Measuring tape

    3. Small step ladder

2. Supplies

BB V3.1 - SVCam

NC, TX

BBV 3.0 - Sony Camera

MD

Power:

  •  Charged flash battery
  •  BB camera power cable
  •  4 charged Amiga Lithium Ion Batteries
  •  4 Battery Keys

Power:

  •  Charged flash battery
  •  Charged camera battery
  •  4 Amiga Lithium Ion Batteries
  •  4 Battery Keys

Flash:

  •  Godox AD1200 Pro (charged flash bulb & flash box)

Flash:

  •  Flash

USB:

  •  Ethernet cable

USB:

  •  Fan setup
  •  Color Checkers - Large and passport
  •  Color Checker
  •  UI Protective Cover
  •  UI Protective Cover
  •  Measuring Tape
  •  Measuring Tape

Other:

Small Step Ladder

Grease Gun

Other:

Small Step Ladder

Grease Gun

3. Potting area maintenance

Note

Time should be allocated and scheduled in advance to ensure daily and thorough potting maintenance.

3.1 Debris removal

Before image collection begins, ensure that the potting area is free of debris. Follow these steps to maintain a clean workspace:

  • Use a leaf blower to clear debris from the surface of the landscape fabric.

    • Be cautious to avoid blowing directly into the pots, as this may displace soil or damage plants.

  • Inspect the area for any remaining loose material or obstructions and remove them manually if necessary.

A clean potting area is essential for accurate image collection and preventing unwanted elements from interfering with data quality.

image-20250129-164157.pngImage Added
image-20250129-164035.pngImage Added

3.2 Individual plant spacing

Note

Do NOT move pots unless otherwise directed to/confirmed by Matthew Kutugata.

It is, however, permissible to rotate individual pots to avoid overlapping of plants.

Proper plant spacing is critical to ensure accurate image collection and minimize occlusions. Follow these guidelines:

  1. Avoid plant overlap—thin out plants wherever overlap occurs. Be generous when thinning to maintain clear separation.

  2. Prepare the first species groups (8–10 rows) before starting the BBot imaging process.

    1. These initial rows must be fully cleaned and spaced properly before imaging begins.

  3. Continue spacing adjustments while the BBot is running.

    1. Once the first group is set, you may clean and adjust the remaining rows as imaging progresses.

Maintaining proper plant spacing reduces errors and ensures high-quality, usable images.

Image Added
Image Added
SemiField Image Acquisition.jpgImage Added

3.3 Weed Potting Area

Note

The first species groups ( 8-10 rows) need to be cleaned before the BBot begins it’s run. The remaining pots can be weeded while the BBot is imaging.

Discard non-target weeds or plants with overlapping leaves by uprooting, shaking off soil, and placing into a bucket or bag.

Do not leave removed weeds or plants on pots or on the landscape fabric. Anything green will be detected, therefore everything that should not be imaged must be removed.

  1. Eliminate non-target weeds from both the pots and the surrounding landscape fabric:

    1. Inside the pots – Check for and remove any non-target weeds.

    2. Underneath the pots – Lift pots if necessary to remove any hidden weeds.

    3. On the landscape fabric – Remove any weeds growing in or around the area.

  2. Proper disposal – Uproot unwanted plants, shake off excess soil, and place them in a designated disposal bucket or bag. Do not leave removed plants on pots or the landscape fabric, as anything green may be detected in the images.

Note

Attention to detail is crucial! Take care to remove all non-target weeds without rushing, and avoid being in the images during the process.

Image Added

image-20250129-165953.pngImage Added

3.4 More examples of non-target weeds and dirty potting areas

Expand
titleDropdown to see examples
image-20250129-170311.pngImage Addedimage-20250129-170528.pngImage Addedimage-20250129-170443.pngImage Addedimage-20250129-170420.pngImage Addedimage-20250129-170327.pngImage Addedimage-20250129-170235.pngImage Addedimage-20250129-170247.pngImage Added

4. Camera/Flash/BBot Setup

4.1 Attaching the Camera & Flash

BB V3.1 - SVCam

NC, TX

BBV 3.0 - Sony Camera

MD

  1. Attach camera to bracket on BBot

    1. Slide the black triangle piece on camera bracket into the piece toward the bottom of the Z-axis.

    2. Make sure to have a strong grip on the flash/camera and have a hand below the camera, ensuring it does not drop to the ground.

  1. Set up Flash

    1. Plug jack into flash.

    2. Run camera cable to flash.

  1. Check camera’s Focus, Aperture, and Height - Settings Table

    1. Height - check that : Confirm the distance from the camera lens to the top of the pot in correct (see table)pot.

  1. Attach camera to flash bracket.

  1. Plug in green cable to brain of camera

  1. Align camera lens parallel with the ground.

  1. Plug in ethernet training cable from camera to BBot power box

  1. Tighten screw & two washers until sturdy.

  1. Attach “audio jack” to the flash box

  1. Attach camera to BBot bracket.

  1. Check for battery in flash box

  1. Attach camera to bracket on BBot

    1. Slide the black triangle piece on camera bracket into the piece toward the bottom of the Z-axis.

    2. Make sure to have a strong grip on the flash/camera and have a hand below the camera, ensuring it does not drop to the ground.

  1. Plug in flash bulb power cable to flash box

  1. Remove lens cap.

  1. Power on flash and check settings on flash box

  1. Unscrew the protective cap on the BBot power box. Inside is a USB port.

  1. Set Flash box on top of camera mount (safely)

  1. Plug USB-A to USB-C cable into USB port and camera respectively.

  1. If cable has extra slack, make sure it is not dangling in view of lens.

  1. It is advisable to put a sunshade over the camera.

Attaching

4.2 Configuring the SVCam

Section here about connecting the SVCam before the bbot is turned on. Include a “important” info panel because this is a very important step. There’s a risk of burning the camera if it’s connected after the bbot is already turned on.

Ask Maria for more images of the completely assembled SVCam setup (including flash).

image-20250122-152153.pngImage Removed
image-20250122-152246.pngImage Removed

Configure SVCam

  1. Check focus

  2. check aperture

  3. check camera height are correct (see table)

    1. For height - check that the distance from the lens to the top of the pot in correct (see table)

Setup the flash

  1. physically attaching

  2. plugging in the cables

  3. making sure the flash settings are correct (see table)

  4. Need to clarify Maria about:

    1. how the flash is powered and

    2. about the order of operations for attaching the camera and flash

Test SVCam

  1. take some images, make sure the camera is functioning properly and no errors appear on the BBot interface

2.
Note

The SVCam must be plugged in prior to the BBot being powered on.

If not done properly, we risk the camera being fried with the sudden power surge.

img_1442_720.jpgImage Added

IMG_1432.jpgImage Added

image-20250122-152246.pngImage Added
IMG_1433.jpgImage Added
IMG_1440.jpgImage Added
IMG_1439.jpgImage Added

4.21 Check Camera and Flash Settings

Make sure that the camera settings match what is listed in the camera settings table

  1. Check aperture is correct

  2. Check that the focus is correct

  3. Check the flash power

  4. Check height of the lens from the potting soil surface using a measuring tape

  5. Place the color checker in frame of the starting position

  6. Open the BBot app on the BBot interface and press the “take image” button to take a test image.

4.22 Camera and Flash Settings Table

  1. To avoid the Amiga /BBot frame being in the images, we start the starting camera at a position further in the X-axis, must be further away from its right/leftmost position, which I am referring to as “0”. To get the camera into proper “0 cm”.

  2. Beginning in the “0 cm” position, move it the camera to the “0” position so that it is at its standard starting place, and then move it whatever distance your site species in the table below (the “xappropriate distance relevant to the site location (refer to the “X-axis starting” column in the Settings Table ).

  3. If you are changing your species map (or need to replace it, as sometimes it will clear itself when restarting the app or BBot), use the “Species Map” tab to build it. Use Enter the information in the table corresponding to your site to build the species map. At the moment, what you select for the “species” itself does not matter (

    1. Currently, the selected species is unimportant, as we do not use

    that metadata and there are limited options). Just make
    1. those metadata. Be sure to

    select
    1. have a species

    from the list
    1. selected. If

    you leave
    1. it is left as “none”, the BBot will not take images there.

    2. After

    making your
    1. inputting the settings, click

    add rows
    1. “Add Rows” and

    your
    1. a map will appear on the right side of the screen.

    If it looks good to you, then
    1. If looking accurate, press “Save.” If

    you do
    1. not

    press save
    1. saved,

    then the
    1. a map will not appear in the “Traversal” tab and

    you
    1. it will

    have
    1. need to

    rebuild it
    1. be rebuilt.

Check and Adjust BBot App Settings

BenchBot App

Programmed

Settings Table

Site

Semi-Field Potting Area Dimensions

Semi-Field Physical Pot Layout

BB App Programmed Settings

Camera Settings

Notes

Width (m)

Length (m)

Pots/Row

Number of Rows

On-Center pot spacing (in)

Programmed Number of Rows

Pots/Row

Pot Spacing (cm)

Row spacing (cm)

X-axis starting (cm)

Z-axis height (cm)

Lens height over pot surface

Y-axis starting (cm)

Aperture

Flash power

Focus

Exposure

NC

15

43

40

+58

170

12-13

1/1

20.75

300

Updated 1/15/2025

TX

MD

6.1

39.0

80

11

45

30

40

Updated 10/19/2024

4.3

.

BBot Setup

2

4.

1

31 Gantry setup

  •  Place the 4 Amiga batteries into their slot above each wheel.
  • Slides into internal track as it is easy to miss.

  •  Insert key into each battery.
  • When turning from “Unlocked” to “Off”, gentle pressure must be applied towards the battery.

  • A peg will push out of the underside of the battery, entering a hole in the metal panel of the Amiga.

  • If not unlocking, the battery is likely misaligned. Try reinserting the battery.

  •  Plug the dangling power cable into each respective battery.
  •  Turn the key to the “On” position.
  • Boot up will commence.

  •  Remove cover from Amiga interface if applicable and press “Start”.
Note

Reduce motor speed to 4 bars (value of 80)

By default, motor speed is set to half power. Adverse conditions could can occur if left at default setting.

  •  Adjust alignment using the joystick. Get the wheels parallel to the pot edges, as best as possible.
  • When choosing a starting place, make sure the camera is above the first row.

  • Pausing the BBot during batch collection to adjust alignment is okay.

  •  Click the “Auto” tab on the left of interface (“A” surrounded by a circle) and turn on Auto-Control.
  1. The light on the joystick will be orange or blue. When on, the BBot can control itself (Y-axis), but the joystick will be unresponsive.

  2. To use the joystick, turn this off.

Note
  1. Turn back on after making your adjustments. If BBot runs with this “off,” it will not move forward, continuously taking images of the same row.

2.2 Spec setup

NC:

X-axis: +52cm from wheel (starting point)

Y-axis: Place where camera is directly above first row of pots.

Z-axis:165cm to 175cm TX:

X_axis:

Y-Axis:

Z-Axis:

MD:

X_axis:

Y-Axis:

Z-Axis:

Place color checker

5. Test Image Collection

Place color checkers in appropriate starting position.

Take test image and validate everything is in order.

Enter number of species, pots, pot spacing, etc. Begin Image Acquisition

4. Weed Potting Area

Discard non-target weeds or plants with overlapping leaves by uprooting, shaking off soil, and placing into a bucket or bag. Do not leave removed weeds or plants on pots or on the landscape fabric. Anything green will be detected, therefore everything that should not be imaged must be removed.

  1. Remove overlapping target weeds in all pots

  2. Remove non-target weeds from pots and landscape fabric

    1. Check inside the pots for non-target weeds

    2. Check and remove weeds growing from underneath the pots

    3. Check for and remove weeds growing on the landscape fabric

SemiField Image Acquisition.jpgImage Removed4
  1. Make sure flash is triggering

  2. Make sure there are not obvious signs of poor quality in the images using the interface

  3. Make sure the BBot wheels base is not in the image frame.

6. Begin the Batch

  1. Place 2 Color Checkers in the potting area. Place one roughly 15cm ~15cm above the pot surface using something to prop it up the color checker. Place the other at the height of the pot surface. Shown below.

image-20250122-153158.pngImage Removed

image-20250122-153158.pngImage Added

IMG_1444.jpgImage Added
  1. Enter number of species, pots, pot spacing, etc.

  2. Start BBot collection via the “run” button on the “Traversal” tab

  3. Stick around for at least the first two rows to ensure everything is working properly.

    1. If the BBot is not

    rolling
    1. moving forward after a row,

    then
    1. check the

    auto
    1. Auto button on the Amiga interface. It is likely

    in the wrong state
    1. turned off (the joystick light should be blue or orange, not white).

  4. Move the color checker , once it will no longer be in anymore images, to a new spot ahead of the BBot. I personally when the BBot has passed over it. Bring it to a new are that has yet be imaged. It is good practice to put it at the start of every species. It is good to have the color checker in a batch several times, as lighting conditions do change throughout the day.Every now and then, when

  5. When BBot reaches the ends of a row, check these outermost photos to make sure the pot is fully in the frame and no Amiga is in frame. If either of these happened, then your camera may not be parallel to the ground, or you may need to adjust BBot’s position with the joystick.

  6. Depending on site, you may have to replace the flash battery every once and a while.

    1. At MD, our BBot does not charge the flash as it goes along, so the battery is not gaining any charge. I find that the Battery lasts about 2.5 species normally, so I like to change it out at the end of the second species and the end of the fourth species. Make sure to pause the BBot traversal before doing so, and also when you slip the new battery in, turn the flash on. The flash does not automatically turn on (even if it was still on when your removed the old battery), so you will have to manually turn it on again. Always have your flash batteries charging in case you are ready at any moment.

5
  1. for the Amiga. If the wheels or frame are in the image, you will need to readjust the camera angle or starting point on the X-axis.

7. Packing-Up

  1. Return BBot to its starting position.

  2. Reapply lens cap to camera lens if needed

  3. Unplug the camera cable, and screw the USB-port cap back onto the BBot box.Turn off the BBot and remove batteries, then unplug the camera and other cords.

  4. Leave the BBot on for sometime to allow images to transfer

  5. Be sure to replace the protective covers on plugs and cords.

Note

Not replacing protective covers leave them vulnerable to corrosion, potentially damaging equipment.

20250128_163124 (1).jpgImage Added
20250128_163131.jpgImage Added
  1. Take the camera off the BBot

. At
  1. by disengaging the triangle mounting

spot, there is a little tab you will need to press in to disengage the mount. When holding that tab in, you will be able to lift the camera/flash out. I like to have one hand dedicated to the tab, and another below the flash, holding it and pushing up
  1. , paying mind to the weight of the camera.

  2. Pack away any accessories

you brought out
  1. (Color Checker,

Tweezers
  1. measuring tapes, etc.).

  • Turn off Amiga batteries and unplug them.

    1. Bring everything inside, and charge all batteries so that they are ready for the next batch collection.

    8. Troubleshooting

    8.1 Basic Troubleshooting Tips:

    • Check the emergency breaks. Make sure they aren’t active. They should be lifted so that you can see a strip of black below them, indicating the brakes are not on.

    • Check wi-fi connection. On the top right corner of the BBot interface. If no signal, Advanced wi-fi settings can be assessed in settings if there is no signal.

    • Check Amiga settings. Make sure they are properly set.

    • Check camera & flash. Make sure they are turned on and plugged in.

    • Reboot the system. Remember to turn off BBot before unplugging camera.

    8.2 “Missing JPG/RAW” , “Missing JPG” , Image loading indefinitely

    It is believed this is caused by an issue with the camera having a proper connection to BBot.

    Try to remedy this by:

    • Unplugging the camera cable from both ports several times. Try to image after each attempt.

    • Dismounting the camera and moving it a little bit. Remove & replace the battery. Doing anything to maybe jostle something back into place.

    • Rebooting BBot.

    8.3 BBot taking images in same spot, unable to move (X & Y axis motors)

    • Restart the BBot app. Simply close and reopen.

    8.4 “No images taken”

    In the mini-computer (via piKVM)

    While in the mini-computer, execute localhost:5000/image in the address bar. This message is returned:

    Code Block
    {“text”: “RAW BMP missing”, “imageTaken”: 0}

    on the screen it says “Raw BMP missing”

    • Cabling - Step by step

    1. Power cable → Camera

    2. Data cable → Camera

    3. Flash cables and Camera

      1. Power Cable → Camera

      2. Camera → Flash

      3. Data ethernet (from camera) → Power Box

    Note

    Make sure to plug in the camera in before turning on the BBot.

    Make sure to turn off the Bbot BBot before removing power cable from camera.

    • Check cables. Make sure they are plugged in securely.

    • Check Minicomputer. Make sure it is properly communicating with the camera.

    Examples of Plant Spacing and Non-Target Weeds

    Individual plant spacing

    Avoid overlapping plants, thinning in every instance of overlap. Be liberal when thinning plants
    • .

    Individual pot spacing

    Do NOT move pots from their location unless otherwise directed to by Matthew Kutugata or others on the Computer Vision team. It is, however, permissible to rotate individual pots to avoid overlapping of plants.

    Non-target weeds

    Image Removed
    Image Removed
    Image Removed