Weeds detection with ESP32

Help
#1

Hello everyone

I would like to know the scope that has been achieved with Edge Impulse in the detection of weeds or plants for selective spraying.

Our team has experience in the field but so far we have not carried out selective work which is for the benefit of the health of the planet.

I send some images and I open the debate among all to find the best path in development.

PHOTO-2023-07-04-09-41-34
PHOTO-2023-07-04-09-41-34720×1280 293 KB

Simplifying all green objects in this planting stage must be detected.

Thanks, Mario from Argentina

#2

How many different weeds or plants do you need to identify? If the count is low I would use the EdgeImpulse FOMO method.

I wonder if you could use a thermal camera to crop out parts of the image and then feed the cropped RGB image to a simple EdgeImpulse image classifier.

1 Like
#3

Thank for your answer!

The first step it is necessary to detect any green plant and your idea could solve the detection we will investigate thermal.

Thanks, Mario

#4

@mghersi65

Could you just downsample this RGB image ( to, say, 10x20 ) and then threshold a value on the G channel ?

cheers, Mat

#5

I’ve worked with autonomous farming robots in the past and this baseline approach has worked surprisingly well. e.g. consider the following of downsample, colour adjustment and then a threshold…

you can tune the brightness and contrast adjustments, either by hand or by treating those as hyperparameters ( i.e. actually optimising them with labelled data ) but by hand and eye balling is probably enough…

v2 would be seeing how far you can get with something put together from skimage.measure — skimage 0.21.0 documentation

and v3 is treating the whole thing as coarse segmentation using a neural net but you get lucky with something much simpler

Selection_004
Selection_0041042×861 110 KB

Selection_005

Selection_006
Selection_006741×476 23.6 KB

1 Like
#6

Hi Mat

Thank for your advise.
I’m dealing with the color and the results are much better than AI searching the plant like an object.

Thanks, Mario

1 Like
#7

I reckon you’ll be able to get a long way with just colour based approaches. If nothing else it can act as a good preprocessing step for data collection if you need to later use some ML to get a more complex answer out of your data

Cheers, Mat