Could I run VAD model (jit or onnx) on GPU

[mironnn]

❓ Questions and Help

Hi.
Thank you for the provided repo and models.
Wiki says, that "Using batching or GPU can also improve performance considerably".
I've tried to run VAD models of GPU and faced errors.
Could I run jit or Onnx models on GPU?
Thanks

[snakers4]

Could I run jit or Onnx models on GPU?

It does not make much practical sense, unless you have some very specific conditions or large batches, but you can try.

Make sure to read this before proceeding:

• Are different samples in a batch processed independently? #142

[trzy]

GPU inference would definitely be helpful :) I have a use case where I need to proceed multiple hours of sound captured by a wearable device.