Table of Contents | ||||
---|---|---|---|---|
|
Directory Structure
Processing occurs within the main SemiF-AnnotationPipeline repository which used for temporary data storage. Resulting data for each batch is then moved to the respective permanent blob locations.
...
Various types of data are used and produced during processing. Full resolution images are the main data input and are processed to produce plant segments, or cutouts, various types of masks, and metadata products for both original images and cutouts. This section describes how this is data structured, details its contents, and documents Image and Cutout metadata at length.
Directory Structure
Code Block | ||
---|---|---|
| ||
data ├── semifield-developed-images │ ├── NC_2022-07-27 │ │ ├── NC_1658926241_0.png │ │ │ ├── NC_1658926241_02022-07-27.json │ │ ├── NC_1658926241_1.png │ │ │ ├── NC_1658926241_1.json autosfm │ │ ├── NC_1658926255_0.png │ │ ├── NC_1658926255_0.json │ │ └── ... │ └── NC_2022-08-05 ├── semifield-developed-images │ ├── NC_2022-07-27 │ │ ├── NC_2022-07-27.json _preview.png │ │ │ │ │ ├── autosfm │ │ │ ├── detections.csv │ │ │ ├── dem │ │ │ │ └── dem.tif │ │ │ ├── downscaled_photos │ │ │ │ ├── NC_1658926241.png │ │ │ │ ├── NC_1658926255.png │ │ │ │ └── ... │ │ │ ├── downscaled_masks │ │ │ │ ├── NC_1658926241_mask.png │ │ │ │ ├── NC_1658926255_mask.png │ │ │ │ └── ... │ │ │ ├── ortho │ │ │ │ └── orthomosaic.tif │ │ │ ├── project │ │ │ │ ├── NC_2022-07-27.psx │ │ │ │ └── NC_2022-07-27.files │ │ │ └── reference │ │ │ ├── camera_reference.csv │ │ │ ├── error_statistic.csv │ │ │ ├── fov.csv │ │ │ └──gcp_reference.csv │ │ │ │ │ ├── images │ │ │ ├── NC_1658926241.png │ │ │ ├── NC_1658926255.png │ │ │ └── ... │ │ │ │ │ ├── masks │ │ │ ├── NC_1658926241_mask.png │ │ │ ├── NC_1658926255_mask.png │ │ │ └── ... │ │ │ │ │ └──├── metadataplant-detections │ │ │ ├── NC_1658926241.jsoncsv │ │ │ ├── NC_1658926255.json csv │ │ │ └── ... │ │ │ │ │ ├── NC_2022-08-05metadata │ │ │ ├── autosfm NC_1658926241.json │ │ │ ├── dem NC_1658926255.json │ │ │ │ ├── downscaled_masks └── ... │ │ │ │ │ │ ├── downscaled_photos │ │ │ └── │ metamasks │ ├── ortho│ │ │ │ │ ├── projectsemantic_masks │ │ │ │ │ └──├── NC_2022-08-05.files1658926241.png │ │ │ │ │ ├── NC_1658926255.png └──│ 0│ │ │ │ │ └── reference... │ │ ├── images └── instance_masks │ │ ├── masks ├── NC_1658926241.png │ │ └── metadata ├── │ └── NC_2022-08-06 NC_1658926255.png │ ├── images │ ├── masks └── ... │ │ └── metadata... │ ├── semifield-models cutouts │ ├── plant_classifier NC_2022-07-27 │ │ └── data├── NC_1658926241_0.png │ │ └── train ├── NC_1658926241_0.json │ │ ├── badNC_plant_sample 1658926241_0.jpg │ │ ├── not_plantNC_1658926241_0_mask.png │ │ └── plant ... │ └── plant_detector... │ └── ├── semifield-upload-images utils │ ├── MD_2022-06-28 │ ├── MD_2022-07-01shapefiles │ │ ├── MD_2022-07-06 │ │ └──├── MD_2022-07-15.shp └──│ semifield-utils │ │ └── ... ├── MD │ │ │ └── shapefilesGroundControlPoints.csv ├── NC │ └──├── shapefiles │ └── old_stacked_markers |
Batches
blob_home
and data_root
- storage location information
batch_id
- unique batch identifier
upload_datetime
- when image were uploaded to “uploads” blob storage
image_list
- list of images contained in a single batch folder
schema_version
- version of data schema used for organizing metadata
Code Block |
---|
{ "blob_home": "data", "data_root": "semifield-developed-images", "batch_id": "NC_2022-08-05", "upload_datetime": "2022-08-19_21:28:37", "image_list": [ "images/NC_1659710908.jpg",│ ├── NC.shp │ │ └── ... "images/NC_1659711200.jpg",│ "images/NC_1659706234.jpg",└── GroundControlPoints.csv ... "images/NC_1659709264.jpg", "images/NC_1659715086.jpg", └── "images/NC_1659706245.jpg"species_info.json ], "schema_version": "1.0" } |
Images
Cutouts
...