Sony Spresense & Ready-To-Go Binary

Help
#1

Why can I do Live Classification but run out of RAM when running the Impulse on device

  • Project ID: 134024
  • The Sony Spresense microcontroller board has 1.5 MB of RAM.
  • The Deployment page shows 280.8K RAM usage.
  • The device is running the default firmware:
    image
    image777×357 33.7 KB

I can do EI Studio Live Classification via either

  • WebUSB
  • edge-impulse-daemon

edge-impulse-run-impulse

Results in:

Inferencing settings:
        Image resolution: 96x96
        Frame size: 9216
        No. of classes: 3
Starting inferencing in 2 seconds...
Taking photo...
ERR: failed to allocate tensor arena
Failed to allocate TFLite arena (error code 1)
ERR: Failed to run impulse (-6)

edge-impulse-run-impulse --debug

Hangs at:

[SER] Started inferencing, press CTRL+C to stop...
#2

Hi @MMarcial ,

I’ll have a look, thx for reporting.

1 Like
#3

I have investigated a bit and the model, with the selected architecture, is too big to fit in RAM.
I have tried to lower the stream buffer but it’s not enough.

Did you try with other architectures ?

#4

@ei_francesco

By lower the stream buffer do you mean you reduced the Impulse Input Block from say 96x96 to 16x16 or 3x3 or 1x1 or something like this?

  • Try a new architecture?

    • As in try another MCU, aka, not a Sony Spresense?
    • Is the Spresense no longer an EdgeImpulse Fully Supported board?

  • When selecting Sony's Spresense from the EI Studio Deployment page shows total RAM for the Impulse to be estimated at 280.8K (Kelvin or lower case ‘k’ for kilo?). How does the ready-to-go firmware, default firmware, firmware bundle, firmware source code, pre-compiled firmware, or whatever it is called now not fit into the Spresense’s 1,500,000 byte RAM space?

    • This is the ready-to-go firmware. It is EI code. None of my code is inflating the code. How can it not fit into this ginormous RAM?

  • I re-compiled one of my custom Arduino apps that used an older version of the deployed Impulse as an Arduino library. The files were dated April 4th, 2023 so I assume that’s when I deployed the library from the Studio.

    • Therefore, I believe the behind-the-scences code that implements the ready-to-go firmware has changed and is now longer useable.

Please advise…

#5

Hi @MMarcial ,

By lower the stream buffer do you mean you reduced the Impulse Input Block from say 96x96 to 16x16 or 3x3 or 1x1 or something like this? => no, there is a buffer which is used when streaming the camera, which can be pretty big.

By Architecture I mean the model architecture, like using FOMO.

The code does fit, what it doesn’t fit is the Tensor for this model, which is dynamically allocated.

We updated the Spresense-SDK, could be this lead to an increase of RAM usage, I didn’t check.
I am checking if we can lower it in the base firmware.

regards,
fdv

#6

@ei_francesco

  • I re-deployed from the Studio and it is working now.
    • It would be nice to know the internal EI version that deployed the binary. I assume this would be the GitHub tag on the Releases page.
  • The predicted RAM usage stayed the same.
  • The architecture I am using is Image Classification not FOMO
#7

We recently merged new feature for the Spresense (support for 48kHz audio, support for the Commonsense board) plus an update on the Spresense SDK that probably has lowered the use of RAM.