I am using W&B Artifacts to track datasets. For example, below, you see an ‘interim dataset’ (testing and training), stored as an Artifact in wandb. This data is obtained after data-preprocessing (raw data —> | data-preprocessing component | —> interim data).
Currently, I download the data to a local drive and upload it to edge impulse using edge-impulse-uploader. I am building a small pipeline to automate this.
My question: Can I import datasets stored in wandb Artifiact directly into EI studio, i.e. without downloading them to a local drive?
Thanks for the feedback.