Unable to run model on Jetson Orin Nano

Question/Issue:
Unable to run keyword spotting model on Jetson Orin Nano

Project ID:
722263

Context/Use case:
I am trying to use edge-impulse-linux-runner to run the model on my Orin Nano.

Steps Taken:

  1. successfully built model in Edge Impulse project
  2. Started a jetson-container Docker container
  3. installed edge-impulse-linux within the container: wget -q -O - https://cdn.edgeimpulse.com/firmware/linux/orin.sh | bash

Expected Outcome:
Expected to run the model and test the keyword spotting functionality

Actual Outcome:
root@jetson-nano:/sambashare# edge-impulse-linux-runner
Edge Impulse Linux runner v1.15.2

[RUN] Downloading model…
[RUN] Downloading model OK
[RUN] Failed to run impulse Failed to start runner (code: 127): /tmp/tmp/ei-1750187310932Cvzfto/runner-linux-aarch64-jetson-orin: error while loading shared libraries: libcudart.so.11.0: cannot open shared object file: No such file or directory

The jetson container for Jetpack 6.2 has a newer version of libcudart

Reproducibility:

  • [x] Always
  • [ ] Sometimes
  • [ ] Rarely

Environment:

  • Platform: Jetson Orin Nano dev board
  • Build Environment Details: Jetpack 6.2, Jetson-Container
  • OS Version: Ubuntu 22.04
  • Edge Impulse Version (Firmware): [e.g., 1.2.3]
  • To find out Edge Impulse Version:
  • if you have pre-compiled firmware: run edge-impulse-run-impulse --raw and type AT+INFO. Look for Edge Impulse version in the output.
  • if you have a library deployment: inside the unarchived deployment, open model-parameters/model_metadata.h and look for EI_STUDIO_VERSION_MAJOR, EI_STUDIO_VERSION_MINOR, EI_STUDIO_VERSION_PATCH
  • Edge Impulse CLI Version: [e.g., 1.5.0]
  • Project Version: [e.g., 1.0.0]
  • Custom Blocks / Impulse Configuration: [Describe custom blocks used or impulse configuration]
    Logs/Attachments:
    [Include any logs or screenshots that may help in diagnosing the issue]

Additional Information:
Is it possible to run the impulse in the jetson container that was built for Jetpack 6.2?

Hi @ericr

Thanks for the detail, and welcome to the forum, it looks like you’re encountering a compatibility issue between the Edge Impulse runner binary and JetPack 6.2. The runner expects libcudart.so.11.0, but JetPack 6.2 includes a newer CUDA version (e.g., libcudart.so.12), causing a runtime error.

Can you try to use the 6.0 or 5.1.2 JetPack?

JetPack

For NVIDIA Jetson Orin:

see - NVIDIA Jetson | Edge Impulse Documentation

Let me know if you need help with downgrading the Jetpack version, cc: @rjames

Best

Eoin