I tested the new added features for the Sony Spresense. The firmware for all the sensors (Cam, mics and accelerometer), capturing data went OK. Now, when I flashed the package I found one problem and one question:
1)- I used the cli to run the camera inference and I got an error telling me that it couldn’t allocate tensors. (See the screenshot)
2)- How do I get the source code for the NuttX package you generate for the Spresense?
You’re right, large vision models won’t run on the smaller boards. MobileNetV1 usually give the best results on embedded targets.
For most targets, the compiler returns an error in the build process. Sony build doesn’t return an error, because it uses heap memory (so it’s a runtime error). But it’s a good idea to create a separate mechanism for Sony to determine if the model fits.
@alexjaw Yeah it’s super annoying. It’s been a long standing wish for me to get the device selection much earlier into project creation (as part of the new wizard: what do you want to do? where do you want to run it?) and then only suggest things that will work as-is on the device. So we’re definitely tracking it, just so much stuff to do (if someone reads this: we’re hiring )
I heard Sony will release a new camera board, I hope it will consume less resources so we can take advantage of the full potential without doing that much work. We will see. The 5MP camera is great for doing things by code but I guess a smaller resolution one will be more suitable for the current state of tiny machine learning.