CI Failures of release branch release/0.15 #7299
Description
The latest status of the release/0.15 CI can be checked in #7292. Current failures are:
- Unit-tests on Linux CPU / tests (3.10) / linux-job is failing because a simple
import torchvisionis causing the following warning:
2023-02-21T17:06:25.6104129Z Error: mkl-service + Intel(R) MKL: MKL_THREADING_LAYER=INTEL is incompatible with libgomp.so.1 library. 2023-02-21T17:06:25.6104506Z Try to import numpy first or set the threading layer accordingly. Set MKL_SERVICE_FORCE_INTEL to force it. - cmake_windows_gpu and cmake_windows_cpu both fail with dependency installation issues (likely because they try to rely on Python 3.7??)
- Build Linux Conda / pytorch/vision / conda-py3_9-cuda11_7 fails with
File "/opt/conda/lib/python3.10/site-packages/conda/core/package_cache_data.py", line 803, in execute raise CondaMultiError(exceptions) conda.CondaMultiError: Downloaded bytes did not match Content-Length url: https://conda.anaconda.org/nvidia/linux-64/libcusparse-11.7.4.91-0.tar.bz2 test/test_backbone_utils.py::TestFxFeatureExtraction::test_forward_backward[regnet_y_1_6gf] PASSED [ 0%] /var/folders/yh/q3_29drn3d3bw226r0xgt9180000gn/T/tmpj5jgojmn: line 3: 94052 Killed: 9 python3 -u -mpytest -v --tb=long --durations 20 ERROR conda.cli.main_run:execute(47): `conda run python3 -u -mpytest -v --tb=long --durations 20` failed. (See above for error) test/test_backbone_utils.py::TestFxFeatureExtraction::test_forward_backward[regnet_y_32gf] Error: Process completed with exit code 137. - cmake_linux_gpu fails with
CMake Error in /home/circleci/project/cpp_build/CMakeFiles/CMakeTmp/CMakeLists.txt: CUDA_ARCHITECTURES is empty for target "cmTC_4ad9f". CMake Error in /home/circleci/project/cpp_build/CMakeFiles/CMakeTmp/CMakeLists.txt: CUDA_ARCHITECTURES is empty for target "cmTC_4ad9f". CMake Error at /usr/local/lib64/python3.6/site-packages/cmake/data/share/cmake-3.18/Modules/CMakeDetermineCompilerABI.cmake:48 (try_compile): Failed to generate test project build system. Call Stack (most recent call first): /usr/local/lib64/python3.6/site-packages/cmake/data/share/cmake-3.18/Modules/CMakeTestCUDACompiler.cmake:19 (CMAKE_DETERMINE_COMPILER_ABI) CMakeLists.txt:12 (enable_language) - unittest_linux_gpu_py3.8 fails with
RuntimeError: The detected CUDA version (10.2) mismatches the version that was used to compile PyTorch (11.7). Please make sure to use the same CUDA versions. -
unittest_windows_cpu_py3.11 and unittest_macos_cpu_py3.11 fail with dependency satisfaction errors.
-
(Can be ignored) unittest_windows_gpu_py3.8 fails the models output checks. These ones aren't due to infra / CI issues, and can be somewhat safely ignored for now.
@atalman @malfet @seemethere we'd be grateful for your help on the issues listed above, thanks!
cc @seemethere