Direct import of data from wandb Artifacts into EI Studio

Hello EI-Team,

I am using W&B Artifacts to track datasets. For example, below, you see an ‘interim dataset’ (testing and training), stored as an Artifact in wandb. This data is obtained after data-preprocessing (raw data —> | data-preprocessing component | —> interim data).

Currently, I download the data to a local drive and upload it to edge impulse using edge-impulse-uploader. I am building a small pipeline to automate this.

My question: Can I import datasets stored in wandb Artifiact directly into EI studio, i.e. without downloading them to a local drive?

Thanks for the feedback.


Hi @Joeri,

Right now, you have a couple of options:

Hi @shawn_edgeimpulse,

The implementation that I am working on is based on your second option, a combination of API and CLI:

So I will proceed with this.

Thanks for the feedback!

1 Like