Inference predictions results on model for BYOM

Report bugs
, , ,
#1

Question/Issue:
Why are all the prediction results for my model returning 0 in all the inferences?

Project ID:
730902

Context/Use case:
Applying Quantization to BYOM

Summary:
I’ve successfully loaded my model (BYOM) in saved_model.zip format and provided representative dataset, it appears to load correctly and it calculates the MCU performance.
I’ve also selected the Quantization(int 8) option.
Everything builds successfully on Edge Impulse. Then i generated the C++ library to my project and the build for my model is successfull. But when i try to Flash and Monitor i’m getting predictions as 0 for every inference.

MCU performance and prediction results
MCU performance and prediction results817×642 110 KB

I’ve uploaded a LSTM model but i had to downgrade to an older version of tensorflow, tf-2.13.
Am i missing something or is the Quantization not working properly?

Steps to Reproduce:

  1. Load BYOM in SavedModel format
  2. Check quantization optimization option
  3. Implement C++ library in project

Expected Results:
I’ve expected to get actual values in my prediction results as i did in my non-optimized tflite models that work when implemented on the MCU (ESP32-S3-N8R8)

Actual Results:
Predictions results return 0 for every inference.

Reproducibility:

  • [x] Always
  • [ ] Sometimes
  • [ ] Rarely

Environment:

  • Platform: ESP32-S3-N8R8
  • Build Environment Details: IDF-ESP
  • OS Version: Windows 11
  • Edge Impulse Version (Firmware): 1.72.4
  • Edge Impulse CLI Version: Not used
  • Project Version: 1.0.0
  • Custom Blocks / Impulse Configuration: None
#2

Hi @Aleksa95

LSTM is not supported as far as my knowledge goes, are you working with any solutions / sales team?

Can you try via 32 unoptimised first, does that work for you? If not then LSTM is not supported and you will need to try an alternative architecture.

Best

Eoin

#3

Hi @Eoin

No i am not a part of any solution/sales team.
I have tried uploading both LSTM and SRU models without optimization and they work fine. I am having issues with Quantization not working properly on both models. Do you have any input regarding Quantization?

Thanks.
Best regards,

Aleksa.