Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Numpy 2.0.0rc2 causes pytest on ONNX to fail #6136

Open
cjvolzka opened this issue May 13, 2024 · 2 comments
Open

Numpy 2.0.0rc2 causes pytest on ONNX to fail #6136

cjvolzka opened this issue May 13, 2024 · 2 comments
Labels
bug contributions welcome
Milestone
1.17

Comments

@cjvolzka
Copy link
Contributor

Bug Report

Is the issue related to model conversion?

No

Describe the bug

Numpy is working towards a 2.0 release. If the numpy 2.0.0rc2 is installed, when pytest is run against onnx, tests fail.

System information

  • OS Platform and Distribution (e.g. Linux Ubuntu 20.04): Debian 12 x86 (I was running in a container based on python:3.11 from dockerhub)
  • ONNX version (e.g. 1.13): main
  • Python version: 3.11
  • GCC/Compiler version (if compiling from source): 12.2.0
  • CMake version: ? (whatever pip install -e . uses if cmake isn't pre-installed)
  • Protobuf version: 5.26.1
  • Visual Studio version (if applicable): N/A

Reproduction instructions

  1. Build Docker file with docker build -t onnx_numpy2_pytest:3.11-main -f onnx_numpy2_pytest.txt .
    • The onnx_numpy2_pytest.txt has:
      • Use official python 3.11 image as its base
      • Requirements to build onnx
      • numpy 2rc2 installed
      • clones the latest onnx main commit and builds it
    • See the RUN statements in the dockerfile for the setup if you want to recreate outside of a container.
  2. Run container with docker run --rm -it onnx_numpy2_pytest:3.11-main
  3. run pytest in the container

Expected behavior

Tests pass

Actual behavior

============================================== test session starts ===============================================
platform linux -- Python 3.11.9, pytest-8.2.0, pluggy-1.5.0
rootdir: /onnx
configfile: pyproject.toml
testpaths: onnx/test, onnx/examples
plugins: nbval-0.11.0
collected 7482 items                                                                                             

onnx/test/basic_test.py ....................................                                               [  0%]
onnx/test/checker_test.py .........................................                                        [  1%]
onnx/test/compose_test.py ..........................                                                       [  1%]
onnx/test/data_propagation_test.py .....                                                                   [  1%]
onnx/test/elu_test.py .                                                                                    [  1%]
onnx/test/function_inference_test.py ...                                                                   [  1%]
onnx/test/function_test.py .                                                                               [  1%]
onnx/test/helper_test.py ................................................F.F.F.F.......................... [  2%]
................................                                                                           [  3%]
onnx/test/hub_test.py sssssssssss                                                                          [  3%]
onnx/test/inference_function_test.py ......                                                                [  3%]
onnx/test/inliner_test.py ...                                                                              [  3%]
onnx/test/model_container_refeval_test.py ...                                                              [  3%]
onnx/test/model_container_test.py ...                                                                      [  3%]
onnx/test/model_inference_test.py ...........                                                              [  3%]
onnx/test/numpy_helper_test.py .....................................................                       [  4%]
onnx/test/parser_test.py ......................                                                            [  4%]
onnx/test/printer_test.py .                                                                                [  4%]
onnx/test/reference_evaluator_ml_test.py ...........................................................       [  5%]
onnx/test/reference_evaluator_model_test.py .                                                              [  5%]
onnx/test/reference_evaluator_test.py ..................F...FF.......s.ss....s.....................F..F... [  6%]
..................................................s........................................ss............. [  7%]
.F.........                                                                                                [  7%]
onnx/test/relu_test.py .                                                                                   [  7%]
onnx/test/schema_test.py ................................                                                  [  8%]
onnx/test/serialization_test.py ....                                                                       [  8%]
onnx/test/shape_inference_test.py ...............................................sssss.................... [  9%]
.......................................................................................................... [ 10%]
.......................................................................................................... [ 12%]
...........................s..ss.ss....................................................................... [ 13%]
........................s.....................s...............s...............s.ssss....s....sss..sss..s.. [ 14%]
.......sss..sss..sss..sss..sss..sss..........................................................s...s...s...s [ 16%]
...s...................................................................................................... [ 17%]
.....                                                                                                      [ 17%]
onnx/test/symbolic_shape_test.py ....                                                                      [ 17%]
onnx/test/test_backend_reference.py .s.s.s.s.sFsFs.sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 18%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sss.s.s.s.s.s.s.s.s [ 20%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssssssssssss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sss.s.s.sss [ 21%]
ssssss.sssss.s.s.s.s.s.s.s.sss.s.sssssssssssssss.s.s.s.s.s.s.sssssssssssssssssssss.s.s.s.s.s.s.s.s.s.s.s.s [ 23%]
.s.s.s.sssss.s.s.s.sssssssssssssssssssss.s.s.s.s.s.s.s.s.s.s.sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 24%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 25%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sFsFs.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 27%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 28%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 30%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 31%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 32%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssFsFsssFsFsFsFsFs.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 34%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 35%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 37%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 38%]
.s.s.s.s.s.s.s.s.s.sssss.sss.sss.sss.sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 40%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 41%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 42%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 44%]
ss.s.s.s.s.s.sssss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 45%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 47%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 48%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssssssssssss.s.s.s [ 49%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 51%]
.s.s.s.s.sFsFsFs.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssssssssssssssssss.s.s.s.sssss.s.s.s.s.s.s.s.s.s.s [ 52%]
.sssssssssssss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 54%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 55%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s                                                                       [ 56%]
onnx/test/test_backend_test.py .s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 57%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 58%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 59%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 61%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 62%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 64%]
s.s.s.s.s.s.s.s.s.s.s.s.s.sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 65%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 67%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 68%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 69%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 71%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 72%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 74%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 75%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 76%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 78%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 79%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 81%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 82%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 84%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 85%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 86%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 88%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 89%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 91%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 92%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 93%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s                                                                            [ 94%]
onnx/test/test_external_data.py .....s...........s............................................sss          [ 95%]
onnx/test/test_with_ort.py s                                                                               [ 95%]
onnx/test/tools_test.py ........                                                                           [ 95%]
onnx/test/training_tool_test.py .                                                                          [ 95%]
onnx/test/utils_test.py .                                                                                  [ 95%]
onnx/test/version_converter/automatic_downgrade_test.py ..............                                     [ 95%]
onnx/test/version_converter/automatic_upgrade_test.py .................................................... [ 96%]
.......................................................................................................... [ 97%]
.............................................................                                              [ 98%]
onnx/test/version_converter_test.py ...................................................................... [ 99%]
.................                                                                                          [ 99%]
onnx/examples/Protobufs.ipynb .ssssssss.                                                                   [ 99%]
onnx/examples/check_model.ipynb s.                                                                         [ 99%]
onnx/examples/load_model.ipynb s.                                                                          [ 99%]
onnx/examples/make_model.ipynb s.                                                                          [ 99%]
onnx/examples/np_array_tensorproto.ipynb .....                                                             [ 99%]
onnx/examples/save_model.ipynb .                                                                           [ 99%]
onnx/examples/shape_inference.ipynb ..                                                                     [100%]

==================================================== FAILURES ====================================================
__________________________ TestHelperTensorFunctions.test_make_float8e4m3fn_tensor_raw ___________________________
onnx/test/helper_test.py:588: in test_make_float8e4m3fn_tensor_raw
    ynp = numpy_helper.to_array(y)
onnx/numpy_helper.py:267: in to_array
    return float8e4m3_to_float32(data, dims)
onnx/numpy_helper.py:112: in float8e4m3_to_float32
    res = _float8e4m3_to_float32(data, fn=fn, uz=uz)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2397: in __call__
    return self._call_as_normal(*args, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2390: in _call_as_normal
    return self._vectorize_call(func=func, args=vargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2475: in _vectorize_call
    ufunc, otypes = self._get_ufunc_and_otypes(func=func, args=args)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2435: in _get_ufunc_and_otypes
    outputs = func(*inputs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2385: in func
    return self.pyfunc(*the_args, **kwargs)
onnx/numpy_helper.py:60: in _float8e4m3_to_float32_scalar
    sign = ival & 0x80
E   OverflowError: Python integer 128 out of bounds for int8
_________________________ TestHelperTensorFunctions.test_make_float8e4m3fnuz_tensor_raw __________________________
onnx/test/helper_test.py:604: in test_make_float8e4m3fnuz_tensor_raw
    ynp = numpy_helper.to_array(y)
onnx/numpy_helper.py:271: in to_array
    return float8e4m3_to_float32(data, dims, uz=True)
onnx/numpy_helper.py:112: in float8e4m3_to_float32
    res = _float8e4m3_to_float32(data, fn=fn, uz=uz)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2397: in __call__
    return self._call_as_normal(*args, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2390: in _call_as_normal
    return self._vectorize_call(func=func, args=vargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2475: in _vectorize_call
    ufunc, otypes = self._get_ufunc_and_otypes(func=func, args=args)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2435: in _get_ufunc_and_otypes
    outputs = func(*inputs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2385: in func
    return self.pyfunc(*the_args, **kwargs)
onnx/numpy_helper.py:60: in _float8e4m3_to_float32_scalar
    sign = ival & 0x80
E   OverflowError: Python integer 128 out of bounds for int8
___________________________ TestHelperTensorFunctions.test_make_float8e5m2_tensor_raw ____________________________
onnx/test/helper_test.py:620: in test_make_float8e5m2_tensor_raw
    ynp = numpy_helper.to_array(y)
onnx/numpy_helper.py:275: in to_array
    return float8e5m2_to_float32(data, dims)
onnx/numpy_helper.py:182: in float8e5m2_to_float32
    res = _float8e5m2_to_float32(data, fn=fn, uz=uz)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2397: in __call__
    return self._call_as_normal(*args, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2390: in _call_as_normal
    return self._vectorize_call(func=func, args=vargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2475: in _vectorize_call
    ufunc, otypes = self._get_ufunc_and_otypes(func=func, args=args)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2435: in _get_ufunc_and_otypes
    outputs = func(*inputs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2385: in func
    return self.pyfunc(*the_args, **kwargs)
onnx/numpy_helper.py:138: in _float8e5m2_to_float32_scalar
    sign = ival & 0x80
E   OverflowError: Python integer 128 out of bounds for int8
_________________________ TestHelperTensorFunctions.test_make_float8e5m2fnuz_tensor_raw __________________________
onnx/test/helper_test.py:637: in test_make_float8e5m2fnuz_tensor_raw
    ynp = numpy_helper.to_array(y)
onnx/numpy_helper.py:279: in to_array
    return float8e5m2_to_float32(data, dims, fn=True, uz=True)
onnx/numpy_helper.py:182: in float8e5m2_to_float32
    res = _float8e5m2_to_float32(data, fn=fn, uz=uz)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2397: in __call__
    return self._call_as_normal(*args, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2390: in _call_as_normal
    return self._vectorize_call(func=func, args=vargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2475: in _vectorize_call
    ufunc, otypes = self._get_ufunc_and_otypes(func=func, args=args)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2435: in _get_ufunc_and_otypes
    outputs = func(*inputs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2385: in func
    return self.pyfunc(*the_args, **kwargs)
onnx/numpy_helper.py:138: in _float8e5m2_to_float32_scalar
    sign = ival & 0x80
E   OverflowError: Python integer 128 out of bounds for int8
____________________________________ TestReferenceEvaluator.test_cast_float8 _____________________________________
onnx/test/reference_evaluator_test.py:3309: in test_cast_float8
    assert_allclose(got[0], expected1)
/usr/local/lib/python3.11/contextlib.py:81: in inner
    return func(*args, **kwds)
E   AssertionError: 
E   Not equal to tolerance rtol=1e-07, atol=0
E   
E   Mismatched elements: 4 / 5 (80%)
E   Max absolute difference among violations: 192.
E   Max relative difference among violations: 1.
E    ACTUAL: array([0., 0., 0., 0., 0.], dtype=float32)
E    DESIRED: array([0.000000e+00, 1.000000e+00, 2.000000e+00, 5.078125e-02,
E          1.920000e+02], dtype=float32)
_________________________________ TestReferenceEvaluator.test_cast_int4_input_0 __________________________________
/usr/local/lib/python3.11/site-packages/parameterized/parameterized.py:620: in standalone_func
    return func(*(a + p.args), **p.kwargs, **kw)
onnx/test/reference_evaluator_test.py:5681: in test_cast_int4_input
    [subbyte.float32_to_4bit_unpacked(x, cast_from_np) for x in data]
onnx/test/reference_evaluator_test.py:5681: in <listcomp>
    [subbyte.float32_to_4bit_unpacked(x, cast_from_np) for x in data]
onnx/subbyte.py:32: in float32_to_4bit_unpacked
    return np.rint(np.clip(x, clip_low, clip_high)).astype(dtype)  # type: ignore[no-any-return]
/usr/local/lib/python3.11/site-packages/numpy/_core/fromnumeric.py:2247: in clip
    return _wrapfunc(a, 'clip', a_min, a_max, out=out, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/_core/fromnumeric.py:57: in _wrapfunc
    return bound(*args, **kwds)
/usr/local/lib/python3.11/site-packages/numpy/_core/_methods.py:108: in _clip
    return um.clip(a, min, max, out=out, **kwargs)
E   OverflowError: Python integer -8 out of bounds for uint8
_________________________________ TestReferenceEvaluator.test_cast_int4_input_1 __________________________________
/usr/local/lib/python3.11/site-packages/parameterized/parameterized.py:620: in standalone_func
    return func(*(a + p.args), **p.kwargs, **kw)
onnx/test/reference_evaluator_test.py:5681: in test_cast_int4_input
    [subbyte.float32_to_4bit_unpacked(x, cast_from_np) for x in data]
onnx/test/reference_evaluator_test.py:5681: in <listcomp>
    [subbyte.float32_to_4bit_unpacked(x, cast_from_np) for x in data]
onnx/subbyte.py:32: in float32_to_4bit_unpacked
    return np.rint(np.clip(x, clip_low, clip_high)).astype(dtype)  # type: ignore[no-any-return]
/usr/local/lib/python3.11/site-packages/numpy/_core/fromnumeric.py:2247: in clip
    return _wrapfunc(a, 'clip', a_min, a_max, out=out, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/_core/fromnumeric.py:57: in _wrapfunc
    return bound(*args, **kwds)
/usr/local/lib/python3.11/site-packages/numpy/_core/_methods.py:108: in _clip
    return um.clip(a, min, max, out=out, **kwargs)
E   OverflowError: Python integer -8 out of bounds for uint8
_____________________________________ TestReferenceEvaluator.test_eval_cast ______________________________________
onnx/test/reference_evaluator_test.py:1511: in test_eval_cast
    assert_allclose(expected, dy)
/usr/local/lib/python3.11/contextlib.py:81: in inner
    return func(*args, **kwds)
E   AssertionError: 
E   Not equal to tolerance rtol=1e-07, atol=0
E   
E   Mismatched elements: 3 / 4 (75%)
E   Max absolute difference among violations: 2.
E   Max relative difference among violations: inf
E    ACTUAL: array([[ 0.,  1.],
E          [-1.,  2.]], dtype=float32)
E    DESIRED: array([[0., 0.],
E          [0., 0.]], dtype=float32)
___________________________________ TestReferenceEvaluator.test_float8_4_types ___________________________________
onnx/test/reference_evaluator_test.py:3497: in test_float8_4_types
    y = ref.run(None, {"X": x})[0]
onnx/reference/reference_evaluator.py:599: in run
    outputs = node.run(*inputs, **linked_attributes)
onnx/reference/op_run.py:514: in run
    res = self._run(*args, **kwargs)
onnx/reference/ops/op_cast.py:142: in _run
    return (cast_to(x, to, saturate),)
onnx/reference/ops/op_cast.py:67: in cast_to
    el = cvt(xr[i])
onnx/numpy_helper.py:112: in float8e4m3_to_float32
    res = _float8e4m3_to_float32(data, fn=fn, uz=uz)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2397: in __call__
    return self._call_as_normal(*args, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2390: in _call_as_normal
    return self._vectorize_call(func=func, args=vargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2475: in _vectorize_call
    ufunc, otypes = self._get_ufunc_and_otypes(func=func, args=args)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2435: in _get_ufunc_and_otypes
    outputs = func(*inputs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2385: in func
    return self.pyfunc(*the_args, **kwargs)
onnx/numpy_helper.py:74: in _float8e4m3_to_float32_scalar
    res |= expo << 23
E   OverflowError: Python integer 1006632960 out of bounds for uint8
________________________________ TestReferenceEvaluator.test_string_concat_2_cat _________________________________
/usr/local/lib/python3.11/site-packages/parameterized/parameterized.py:620: in standalone_func
    return func(*(a + p.args), **p.kwargs, **kw)
onnx/test/reference_evaluator_test.py:5349: in test_string_concat
    self.assertEqual(result.dtype.kind, "O")
E   AssertionError: 'U' != 'O'
E   - U
E   + O
___________________________________ OnnxBackendNodeModelTest.test_adagrad_cpu ____________________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
    np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E   AssertionError: 
E   Items are not equal:
E    ACTUAL: dtype('float64')
E    DESIRED: dtype('float32')
_______________________________ OnnxBackendNodeModelTest.test_adagrad_multiple_cpu _______________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
    np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E   AssertionError: 
E   Items are not equal:
E    ACTUAL: dtype('float64')
E    DESIRED: dtype('float32')
_________________________________ OnnxBackendNodeModelTest.test_dft_inverse_cpu __________________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:221: in assert_similar_outputs
    np.testing.assert_allclose(
/usr/local/lib/python3.11/contextlib.py:81: in inner
    return func(*args, **kwds)
E   AssertionError: 
E   Not equal to tolerance rtol=0.001, atol=1e-07
E   
E   Mismatched elements: 10 / 200 (5%)
E   Max absolute difference among violations: 1.9073487e-07
E   Max relative difference among violations: 1.3421773e+08
E    ACTUAL: array([[[[ 4.500000e+01,  0.000000e+00],
E            [ 4.600000e+01,  0.000000e+00],
E            [ 4.700000e+01,  0.000000e+00],...
E    DESIRED: array([[[[ 4.500000e+01,  0.000000e+00],
E            [ 4.600000e+01,  0.000000e+00],
E            [ 4.700000e+01,  0.000000e+00],...
_____________________________ OnnxBackendNodeModelTest.test_dft_inverse_opset19_cpu ______________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:221: in assert_similar_outputs
    np.testing.assert_allclose(
/usr/local/lib/python3.11/contextlib.py:81: in inner
    return func(*args, **kwds)
E   AssertionError: 
E   Not equal to tolerance rtol=0.001, atol=1e-07
E   
E   Mismatched elements: 10 / 200 (5%)
E   Max absolute difference among violations: 1.9073487e-07
E   Max relative difference among violations: 1.3421773e+08
E    ACTUAL: array([[[[ 4.500000e+01,  0.000000e+00],
E            [ 4.600000e+01,  0.000000e+00],
E            [ 4.700000e+01,  0.000000e+00],...
E    DESIRED: array([[[[ 4.500000e+01,  0.000000e+00],
E            [ 4.600000e+01,  0.000000e+00],
E            [ 4.700000e+01,  0.000000e+00],...
______________________________ OnnxBackendNodeModelTest.test_lppool_1d_default_cpu _______________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
    np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E   AssertionError: 
E   Items are not equal:
E    ACTUAL: dtype('float64')
E    DESIRED: dtype('float32')
______________________________ OnnxBackendNodeModelTest.test_lppool_2d_default_cpu _______________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
    np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E   AssertionError: 
E   Items are not equal:
E    ACTUAL: dtype('float64')
E    DESIRED: dtype('float32')
________________________________ OnnxBackendNodeModelTest.test_lppool_2d_pads_cpu ________________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
    np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E   AssertionError: 
E   Items are not equal:
E    ACTUAL: dtype('float64')
E    DESIRED: dtype('float32')
_____________________________ OnnxBackendNodeModelTest.test_lppool_2d_same_lower_cpu _____________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
    np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E   AssertionError: 
E   Items are not equal:
E    ACTUAL: dtype('float64')
E    DESIRED: dtype('float32')
_____________________________ OnnxBackendNodeModelTest.test_lppool_2d_same_upper_cpu _____________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
    np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E   AssertionError: 
E   Items are not equal:
E    ACTUAL: dtype('float64')
E    DESIRED: dtype('float32')
______________________________ OnnxBackendNodeModelTest.test_lppool_2d_strides_cpu _______________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
    np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E   AssertionError: 
E   Items are not equal:
E    ACTUAL: dtype('float64')
E    DESIRED: dtype('float32')
______________________________ OnnxBackendNodeModelTest.test_lppool_3d_default_cpu _______________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
    np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E   AssertionError: 
E   Items are not equal:
E    ACTUAL: dtype('float64')
E    DESIRED: dtype('float32')
__________________________ OnnxBackendNodeModelTest.test_unique_sorted_with_axis_3d_cpu __________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:221: in assert_similar_outputs
    np.testing.assert_allclose(
/usr/local/lib/python3.11/contextlib.py:81: in inner
    return func(*args, **kwds)
E   AssertionError: 
E   Not equal to tolerance rtol=0.001, atol=1e-07
E   
E   (shapes (1, 4, 1), (4,) mismatch)
E    ACTUAL: array([[[1],
E           [0],
E           [2],
E           [0]]])
E    DESIRED: array([1, 0, 2, 0])
___________________________ OnnxBackendNodeModelTest.test_unique_sorted_with_axis_cpu ____________________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:221: in assert_similar_outputs
    np.testing.assert_allclose(
/usr/local/lib/python3.11/contextlib.py:81: in inner
    return func(*args, **kwds)
E   AssertionError: 
E   Not equal to tolerance rtol=0.001, atol=1e-07
E   
E   (shapes (3, 1), (3,) mismatch)
E    ACTUAL: array([[0],
E          [0],
E          [1]])
E    DESIRED: array([0, 0, 1])
_______________________ OnnxBackendNodeModelTest.test_unique_sorted_with_negative_axis_cpu _______________________
onnx/backend/test/runner/__init__.py:483: in run
    self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:221: in assert_similar_outputs
    np.testing.assert_allclose(
/usr/local/lib/python3.11/contextlib.py:81: in inner
    return func(*args, **kwds)
E   AssertionError: 
E   Not equal to tolerance rtol=0.001, atol=1e-07
E   
E   (shapes (1, 3), (3,) mismatch)
E    ACTUAL: array([[1, 0, 0]])
E    DESIRED: array([1, 0, 0])
================================================ warnings summary ================================================
onnx/test/basic_test.py::TestIO_3_onnxtxt::test_load_model_when_input_is_bytes
  /onnx/onnx/__init__.py:258: UserWarning: The onnxtxt format is experimental. Please report any errors to the ONNX GitHub repository.
    return _get_serializer(format).deserialize_proto(s, ModelProto())

onnx/test/basic_test.py::TestIO_3_onnxtxt::test_save_and_load_model_when_input_has_read_function
onnx/test/basic_test.py::TestIO_3_onnxtxt::test_save_and_load_model_when_input_is_file_name
onnx/test/basic_test.py::TestIO_3_onnxtxt::test_save_and_load_model_when_input_is_pathlike
  /onnx/onnx/__init__.py:212: UserWarning: The onnxtxt format is experimental. Please report any errors to the ONNX GitHub repository.
    model = _get_serializer(format, f).deserialize_proto(_load_bytes(f), ModelProto())

onnx/test/numpy_helper_test.py::TestNumpyHelper::test_bfloat16_to_float32_5
  /onnx/onnx/test/numpy_helper_test.py:27: RuntimeWarning: overflow encountered in cast
    return np.float32(fval)

onnx/test/reference_evaluator_ml_test.py::TestReferenceEvaluatorAiOnnxMl::test_svm_classifier_linear
onnx/test/reference_evaluator_ml_test.py::TestReferenceEvaluatorAiOnnxMl::test_svm_classifier_noprob_linear
  /onnx/onnx/reference/ops/aionnxml/_common_classifier.py:65: RuntimeWarning: invalid value encountered in log
    log = np.log(x)

onnx/test/test_backend_reference.py: 12 warnings
onnx/test/tools_test.py: 3 warnings
  /onnx/onnx/reference/ops/op_range.py:13: DeprecationWarning: Conversion of an array with ndim > 0 to a scalar is deprecated, and will error in future. Ensure you extract a single element from your array before performing this operation. (Deprecated NumPy 1.25.)
    return (np.arange(starts, ends, steps).astype(starts.dtype),)

onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_maxpool_2d_uint8_cpu
  /usr/local/lib/python3.11/site-packages/numpy/lib/_arraypad_impl.py:147: RuntimeWarning: invalid value encountered in cast
    padded[left_slice] = value_pair[0]

onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_maxpool_2d_uint8_cpu
  /usr/local/lib/python3.11/site-packages/numpy/lib/_arraypad_impl.py:151: RuntimeWarning: invalid value encountered in cast
    padded[right_slice] = value_pair[1]

onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_reduce_log_sum_empty_set_expanded_cpu
onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_reduce_log_sum_exp_empty_set_expanded_cpu
  /onnx/onnx/reference/ops/op_log.py:13: RuntimeWarning: divide by zero encountered in log
    return (np.log(x).astype(x.dtype),)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
============================================ short test summary info =============================================
FAILED onnx/test/helper_test.py::TestHelperTensorFunctions::test_make_float8e4m3fn_tensor_raw - OverflowError: Python integer 128 out of bounds for int8
FAILED onnx/test/helper_test.py::TestHelperTensorFunctions::test_make_float8e4m3fnuz_tensor_raw - OverflowError: Python integer 128 out of bounds for int8
FAILED onnx/test/helper_test.py::TestHelperTensorFunctions::test_make_float8e5m2_tensor_raw - OverflowError: Python integer 128 out of bounds for int8
FAILED onnx/test/helper_test.py::TestHelperTensorFunctions::test_make_float8e5m2fnuz_tensor_raw - OverflowError: Python integer 128 out of bounds for int8
FAILED onnx/test/reference_evaluator_test.py::TestReferenceEvaluator::test_cast_float8 - AssertionError: 
FAILED onnx/test/reference_evaluator_test.py::TestReferenceEvaluator::test_cast_int4_input_0 - OverflowError: Python integer -8 out of bounds for uint8
FAILED onnx/test/reference_evaluator_test.py::TestReferenceEvaluator::test_cast_int4_input_1 - OverflowError: Python integer -8 out of bounds for uint8
FAILED onnx/test/reference_evaluator_test.py::TestReferenceEvaluator::test_eval_cast - AssertionError: 
FAILED onnx/test/reference_evaluator_test.py::TestReferenceEvaluator::test_float8_4_types - OverflowError: Python integer 1006632960 out of bounds for uint8
FAILED onnx/test/reference_evaluator_test.py::TestReferenceEvaluator::test_string_concat_2_cat - AssertionError: 'U' != 'O'
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_adagrad_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_adagrad_multiple_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_dft_inverse_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_dft_inverse_opset19_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_1d_default_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_2d_default_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_2d_pads_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_2d_same_lower_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_2d_same_upper_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_2d_strides_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_3d_default_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_unique_sorted_with_axis_3d_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_unique_sorted_with_axis_cpu - AssertionError: 
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_unique_sorted_with_negative_axis_cpu - AssertionError: 
===================== 24 failed, 4429 passed, 3029 skipped, 26 warnings in 168.03s (0:02:48) =====================
@cjvolzka cjvolzka added the bug label May 13, 2024
@titaiwangms
Copy link

cc @justinchuby @gramalingam

@justinchuby
Copy link
Contributor

https://numpy.org/devdocs/numpy_2_0_migration_guide.html

@justinchuby justinchuby added this to the 1.17 milestone May 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug contributions welcome
Projects
None yet
Milestone
1.17
Development

No branches or pull requests
3 participants
@justinchuby @titaiwangms @cjvolzka