V2 Image Acquisition System Requirements

Assumptions

The Image Aquisition System will be a payload on the BenchBot, and can rely on the BenchBot meeting its stated requirements.

Bench Bot v3 Concept Design - BenchBot - Confluence (atlassian.net)

• This will be mounted to the end effector of an X, Y, Z gantry on the new BenchBot.

• The BenchBot will be able to position this system to an accuracy of +/- 1 cm.

• This system will request positions from the BenchBot and can trust it was accurately reached.

Success metrics

Goal: Automated high throughput collection of high resolution images and associated metadata.

Objectives:

• Collect high resolution images in an automated and systematic manner.

• Collect environmental metadata.

• Track metadata corresponding to each image.

• Automate data upload.

• Obtain camera position/orientation relative to grid.

• Good user experience.

Introduction

The purpose of BB 3.0 is to collect large amounts of high throughput image data in semi-controlled outdoor nursery conditions of agriculturally relevant weeds, cover crops, and cash crops. Images are collected in such a way that they can be semi-automatically annotated, enabling the development of a comprehensive image repository. The image repository will serve as a valuable resource for computer vision researchers and professionals in the field.

Depth of field considerations to keep in mind wrt need for z-axis camera movement

With a set of base assumptions, the produced depth of field is 16.9 cm, corresponding to a far and near limit at 1.74 m and 1.57 m respectively, assuming that the focus is set for a distance of 1.65 m. This is based on a pixel size of 3.76 um in a full frame sensor setup at 61 megapixel, a 55mm lens, an aperture of F13 and a distance from the camera to the plant of 1.65 meter. As the aperture is physically decreased, the depth of field in increase, at the cost of decreased optical resolution due to diffraction. F13, is what I, Søren, would characterize as the sweet-spot between depth of field and a negligible loss of optical resolution due to diffraction. Sources for depth of field and diffraction calculations. With this in mind, if the lens is not auto-focusing, the camera should to be controlled in the z-axis with a resolution of 3-5 cm.

Flash consideration to keep in mind

The flash should be dominant relative to natural sunlight. As sunlight can reach an intensity of 98,000 lux, the flash should ideally fire with at least twice the intensity.

The alienbees ABR800 has an output of 14000 lumenseconds with a flash duration (t.5) of 1/2000, meaning that 3/4 of the light has been fired after 1/2000 seconds. Based on this, the ABR800 has a light output of 21,000,000 lumen. Assuming a light spread of 10 m2, that results in 2,100,000 lux, or 21 times the maximum sunlight intensity for a short interval. If limited to a shutter speed of 1/200 due to a rolling shutter sensor, that number is down to 2,800,000 lumen and 280,000 lux, or three times the sun intensity.

Our current Godox AR400 ring flash has an output of approximately 8500 lumenseconds with an unknown flash duration. However, assuming that the same numbers apply, we have: 1,270,000 lux, or 13 times the maximum sunlight intensity for a short interval. If limited to a shutter speed of 1/200 due to a rolling shutter sensor, that number is down to 1,700,000 lumen and 170,000 lux, or 1.7 times the sun intensity.

As Chris has pointed out in the comments, the above revolve around the need for an artificial dominant light source. Another consideration is that of depth of field. The current system, when running the AR400 at full power, allows for an aperture at F11, with ISO=100 and shutter speed=1/200 sec. If, for the sake of increased depth of field, we would like to increase the F-number from F11 to F16, that will increase the flash output requirements by a factor of 2, given that we remain at base ISO.

Another way to increase the applied light onto the plants is by changing the flash distance. As it is setup today, the flash is 1.65 meters above the potting area to provide a close to even illumination of the plants within the supported plant heights. As a flash distance is decreased, more light will be applied to the potted plants, but the light distribution from the top of the plant to lower parts will worsen. Another way to increase the applied light, while maintaining the light distribution, is by focusing the emitted light from the flash either using a reflector or a different light source.

Requirements Table

Emergent design properties

 Out of Scope

Goal: Industrial camera, auto focus, global shutter