Please include frozen or more restricted requirements.txt

[viraptor]

Currently installing through requirements.txt causes pip to download at least 4 versions of torch (I'm at 2.0.0, 2.0.1, 2.1.0, 2.1.1 so far, maybe more to come) to figure out what is the correct set of versions to install. This is not a great experience - it would be great if you could also include a list of versions from pip freeze, or at least include the minimum bounds for torch, triton and onnxruntime to avoid long useless downloads.

INFO: pip is looking at multiple versions of triton to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of nvidia-nvtx-cu12 to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of nvidia-nccl-cu12 to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of nvidia-cusparse-cu12 to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of nvidia-cusolver-cu12 to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of nvidia-curand-cu12 to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of nvidia-cufft-cu12 to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of nvidia-cudnn-cu12 to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of nvidia-cuda-runtime-cu12 to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of nvidia-cuda-nvrtc-cu12 to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of nvidia-cuda-cupti-cu12 to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of nvidia-cublas-cu12 to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of torch to determine which version is compatible with other requirements. This could take a while.

[tophee]

Is there any workaround for this issue?

[viraptor]

If anyone with an already installed version of this posts the output of pip freeze, that would help a lot...

[edsonsantoro]

Mine is working, I'll list it here when get back to my PC.

[viraptor]

@edsonsantoro have you got it available?

[edsonsantoro]

Not totally functional, I'm seeing some messages like torchvision is not available - cannot save figures and [NeMo W 2024-02-18 21:25:15 transformer_bpe_models:59] Could not import NeMo NLP collection which is required for speech translation model.. But it worked perfectly for transcribing and diarization of the audio from English.

System:
Ubuntu 22.04.3 LTS
python 3.10.12
ffmpeg version 4.4.2-0ubuntu0.22.04.1
cython version 0.29.28
pip 22.0.2

Cuda:
nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2021 NVIDIA Corporation Built on Thu_Nov_18_09:45:30_PST_2021 Cuda compilation tools, release 11.5, V11.5.119 Build cuda_11.5.r11.5/compiler.30672275_0

Pip freeze:

aiohttp==3.9.3
aiosignal==1.3.1
alembic==1.13.1
antlr4-python3-runtime==4.9.3
appdirs==1.4.4
asteroid-filterbanks==0.4.0
asttokens==2.4.1
async-timeout==4.0.3
attrs==23.2.0
audioread==3.0.1
av==10.0.0
blinker==1.4
braceexpand==0.1.7
certifi==2024.2.2
cffi==1.16.0
charset-normalizer==3.3.2
click==8.1.7
cloudpickle==3.0.0
cmake==3.28.3
colorama==0.4.6
coloredlogs==15.0.1
colorlog==6.8.2
comm==0.2.1
command-not-found==0.3
contourpy==1.2.0
cryptography==3.4.8
ctranslate2==3.24.0
cycler==0.12.1
Cython==0.29.28
dbus-python==1.2.18
decorator==5.1.1
deepmultilingualpunctuation==1.0.1
demucs @ git+https://github.com/facebookresearch/demucs@e976d93ecc3865e5757426930257e200846a520a
Distance==0.1.3
distro==1.7.0
distro-info==1.1+ubuntu0.1
docker-pycreds==0.4.0
docopt==0.6.2
dora-search==0.1.12
editdistance==0.8.1
einops==0.7.0
exceptiongroup==1.2.0
executing==2.0.1
faster-whisper @ git+https://github.com/SYSTRAN/faster-whisper.git@e1a218fab1ab02d637b79565995bf1a9c4c83a09
filelock==3.13.1
flatbuffers==23.5.26
fonttools==4.49.0
frozenlist==1.4.1
fsspec==2024.2.0
g2p-en==2.1.0
gitdb==4.0.11
GitPython==3.1.42
greenlet==3.0.3
grpcio==1.60.1
httplib2==0.20.2
huggingface-hub==0.20.3
humanfriendly==10.0
hydra-core==1.3.2
HyperPyYAML==1.2.2
idna==3.6
importlib-metadata==4.6.4
inflect==7.0.0
ipython==8.21.0
ipywidgets==8.1.2
jedi==0.19.1
jeepney==0.7.1
Jinja2==3.1.3
jiwer==3.0.3
joblib==1.3.2
julius==0.2.7
jupyterlab_widgets==3.0.10
kaldi-python-io==1.2.2
kaldiio==2.18.0
keyring==23.5.0
kiwisolver==1.4.5
lameenc==1.7.0
launchpadlib==1.10.16
lazr.restfulclient==0.14.4
lazr.uri==1.0.6
lazy_loader==0.3
Levenshtein==0.25.0
librosa==0.10.1
lightning==2.2.0.post0
lightning-utilities==0.10.1
lit==17.0.6
llvmlite==0.42.0
loguru==0.7.2
Mako==1.3.2
Markdown==3.5.2
markdown-it-py==3.0.0
MarkupSafe==2.1.5
marshmallow==3.20.2
matplotlib==3.8.3
matplotlib-inline==0.1.6
mdurl==0.1.2
more-itertools==8.10.0
mpmath==1.3.0
msgpack==1.0.7
multidict==6.0.5
nemo-toolkit==1.21.0
netifaces==0.11.0
networkx==3.2.1
nltk==3.8.1
numba==0.59.0
numpy==1.23.5
nvidia-cublas-cu11==11.10.3.66
nvidia-cuda-cupti-cu11==11.7.101
nvidia-cuda-nvrtc-cu11==11.7.99
nvidia-cuda-runtime-cu11==11.7.99
nvidia-cudnn-cu11==8.5.0.96
nvidia-cufft-cu11==10.9.0.58
nvidia-curand-cu11==10.2.10.91
nvidia-cusolver-cu11==11.4.0.1
nvidia-cusparse-cu11==11.7.4.91
nvidia-nccl-cu11==2.14.3
nvidia-nvtx-cu11==11.7.91
oauthlib==3.2.0
omegaconf==2.3.0
onnx==1.15.0
onnxruntime==1.17.0
openunmix==1.2.1
optuna==3.5.0
packaging==23.2
pandas==2.2.0
parso==0.8.3
pexpect==4.9.0
pillow==10.2.0
plac==1.4.2
platformdirs==4.2.0
pooch==1.8.0
primePy==1.3
prompt-toolkit==3.0.43
protobuf==4.25.3
psutil==5.9.8
ptyprocess==0.7.0
pure-eval==0.2.2
pyannote.audio==3.1.0
pyannote.core==5.0.0
pyannote.database==5.0.1
pyannote.metrics==3.2.1
pyannote.pipeline==3.0.1
pybind11==2.11.1
pycparser==2.21
pydantic==1.10.14
pydub==0.25.1
Pygments==2.17.2
PyGObject==3.42.1
PyJWT==2.3.0
pyparsing==2.4.7
python-apt==2.4.0+ubuntu2
python-dateutil==2.8.2
pytorch-lightning==2.0.7
pytorch-metric-learning==2.4.1
pytz==2024.1
PyYAML==5.4.1
rapidfuzz==3.6.1
regex==2023.12.25
requests==2.31.0
retrying==1.3.4
rich==13.7.0
ruamel.yaml==0.18.6
ruamel.yaml.clib==0.2.8
sacremoses==0.1.1
safetensors==0.4.2
scikit-learn==1.4.1.post1
scipy==1.12.0
SecretStorage==3.3.1
semver==3.0.2
sentencepiece==0.1.99
sentry-sdk==1.40.4
setproctitle==1.3.3
shellingham==1.5.4
six==1.16.0
smmap==5.0.1
sortedcontainers==2.4.0
soundfile==0.12.1
sox==1.4.1
soxr==0.3.7
speechbrain==0.5.16
SQLAlchemy==2.0.27
stack-data==0.6.3
submitit==1.5.1
sympy==1.12
systemd-python==234
tabulate==0.9.0
tensorboard==2.16.2
tensorboard-data-server==0.7.2
tensorboardX==2.6.2.2
termcolor==2.4.0
text-unidecode==1.3
texterrors==0.4.4
threadpoolctl==3.3.0
tokenizers==0.13.3
torch==2.0.1
torch-audiomentations==0.11.1
torch-pitch-shift==1.2.4
torchaudio==2.0.2
torchmetrics==1.3.1
tqdm==4.66.2
traitlets==5.14.1
transformers==4.33.3
treetable==0.2.5
triton==2.0.0
typer==0.9.0
typing_extensions==4.9.0
tzdata==2024.1
ubuntu-advantage-tools==8001
ufw==0.36.1
unattended-upgrades==0.1
urllib3==2.2.1
wadllib==1.3.6
wandb==0.16.3
wcwidth==0.2.13
webdataset==0.1.62
Werkzeug==3.0.1
wget==3.2
whisperx @ git+https://github.com/m-bain/whisperX.git@a5dca2cc65b1a37f32a347e574b2c56af3a7434a
widgetsnbextension==4.0.10
wrapt==1.16.0
yarl==1.9.4
youtokentome==1.0.6
zipp==1.0.0```