Wrong cuda device (device_id > 0) on VAD in whisperx.load_model() method

[grzegorz700]

When we use whisperx.load_model(..., device='cuda', device_id=1), we get a quick peek at the wrong (cuda:0) GPU device instead of the desired one. The problem occurs due to different setups for the model and VAD (in the model, we split to device and device_id, but in VAD we use only device name).

whisperX/whisperx/asr.py

Line 347 in f2da2f8

vad_model = load_vad_model(torch.device(device), use_auth_token=None, **default_vad_options)

Bug visually:

Possible solution:

if device == 'cuda' and device_id  and device_id> 0:
    device_vad = f"cuda:{device_id}"
else:
    device_vad = device
vad_model = load_vad_model(torch.device(device_vad), use_auth_token=None, **default_vad_options)