Unable to generate features

What’s your project ID? I’ll take a look.

Hi When I run again I get the following error

Creating job... 

Failed to create job: Cannot start job. There already is a job with key "dsp-2" running.

Job failed (see above)

My Project is vibDemoFieldDevice

Creating job... OK (ID: 188272)

Not generating new features: features already generated and no options or files have changed.

Job completed

So this is what I see. I think this might be related to the distance to the data center, if the job finishes sometimes the last job messages don’t come through…

@janjongboom
Thank you for logging into my project for support. I see that when I increase the window size from 2800ms that you set to 4000ms, It now shows that necessary frames are not there. Can you share how the calculation of window size is done so that Spectral Features can be generated?

@paulphilip your items in the dataset are 3 seconds long, so your window should be less than that; otherwise you’ll get these errors indeed.

@janjongboom Please excuse that I got the project wrong. It is TESTDATAUPLOAD and the data length is 5s. The errors mentioned above is for the project above.

Interesting. I’ve killed the job for you now, and will make something where you won’t get stuck.

@mathijs could you look at the logs to see why this job was not marked as finished? Job ID 188264.

@janjongboom @mathijs
Hi I was trying to build the model for project 5392 but it is not getting scheduled for build

Still waiting for job to be scheduled...
Job did not start within 60 seconds

Received cancellation, stopping job in cluster...

Attached to job 255795...
No data received from server for 30 seconds...

Job failed (see above)

When I rerun again I get the following error.


Failed to create job: Cannot start job. There already is a job with key "dsp-3" running.

Job failed (see above)

Kindly advise on how to avoid this problem.
/cc @Hardik

@janjongboom @mathijs

Hi I used the cancel job api to cancel the job and reschedule it once again. I am unable to do it. Kindly advise.

Creating job... OK (ID: 255797)

Retraining Spectral features...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Still waiting for job to be scheduled...
Job did not start within 60 seconds

No data received from server for 60 seconds...

Job failed (see above)

/cc @Hardik

Hi @paulphilip, we had an outage this morning (events to/from job containers were not routed), this has now been resolved!

Hi @janjongboom

I was able to build the model. Now I am facing a new error when I am trying to run the model to classify on a test data.

FreqEINotMatching

Please advise.

/cc @Hardik

Hi, we rolled out a change to prevent samples with a different frequency to be classified (to avoid mixing frequencies), but apparently there is some rounding differences involved when calculating the frequency. Will push out a fix today.

@paulphilip @Hardik this has now been rolled out!

There are 3 features as you can see.

Error in feature generation -
Feature generation output
Creating job… OK (ID: 1100410)

Scheduling job in cluster…
Creating windows from 1 files…
Job started
[0/1] Creating windows from files…
[1/1] Creating windows from files…
[1/1] Creating windows from files…
Created 14939 windows: standing_test: 14939

Creating features
[ 1/14939] Creating features…
[14939/14939] Creating features…
Created features

Scheduling job in cluster…
Job started
Reducing dimensions for visualizations…
ERR: Found array with 0 feature(s) (shape=(2000, 0)) while a minimum of 1 is required.

Application exited with code 1 (Error)

Job failed (see above)

Hi @Lakshmi I looked at your project (39100) but I think you removed the data.

Ok I can add the data and then you can take a look at it


Have uploaded the data now

Its critical for our project, so any hint in solving this would help us. Really appreciate it.

@Lakshmi your intervalMs is set to 49500000. This then gets normalized to a frequency of 0Hz, and thus no data is selected. Will add a check for this in the ingestion APIs, but quick fix is to lower this number in your data file.

You can click the three dots next to the item => Download => Edit the number to e.g. 10, and reupload.

Note that you have a single class now, to train a classifier you’ll need at least two.