conda-forge / cudatoolkit-dev-feedstock

A conda-smithy repository for cudatoolkit-dev.

About cudatoolkit-dev-feedstock

Feedstock license: BSD-3-Clause

Home: https://developer.nvidia.com

Package license: LicenseRef-NVIDIA-End-User-License-Agreement

Summary: Develop, Optimize and Deploy GPU-accelerated Apps

Development: https://developer.nvidia.com/cuda-toolkit

Documentation: https://developer.nvidia.com/cuda-toolkit

The NVIDIA CUDA Toolkit provides a development environment for creating high performance GPU-accelerated applications. With the CUDA Toolkit, you can develop, optimize and deploy your applications on GPU-accelerated embedded systems, desktop workstations, enterprise data centers, cloud-based platforms and HPC supercomputers. The toolkit includes GPU-accelerated libraries, debugging and optimization tools, a C/C++ compiler and a runtime library to deploy your application. This package consists of a post-install script that downloads and installs the full cuda toolkit(compiler, libraries, with the exception of cuda drivers).

Current build status

Azure

Variant Status linux_64_python3.10.____cpython linux_64_python3.8.____cpython linux_64_python3.9.____cpython win_64_python3.10.____cpython win_64_python3.8.____cpython win_64_python3.9.____cpython

Current release info

Name	Downloads	Version	Platforms

Installing cudatoolkit-dev

Installing cudatoolkit-dev from the conda-forge channel can be achieved by adding conda-forge to your channels with:

conda config --add channels conda-forge
conda config --set channel_priority strict

Once the conda-forge channel has been enabled, cudatoolkit-dev can be installed with conda:

conda install cudatoolkit-dev

or with mamba:

mamba install cudatoolkit-dev

It is possible to list all of the versions of cudatoolkit-dev available on your platform with conda:

conda search cudatoolkit-dev --channel conda-forge

or with mamba:

mamba search cudatoolkit-dev --channel conda-forge

Alternatively, mamba repoquery may provide more information:

# Search all versions available on your platform:
mamba repoquery search cudatoolkit-dev --channel conda-forge

# List packages depending on `cudatoolkit-dev`:
mamba repoquery whoneeds cudatoolkit-dev --channel conda-forge

# List dependencies of `cudatoolkit-dev`:
mamba repoquery depends cudatoolkit-dev --channel conda-forge

About conda-forge

conda-forge is a community-led conda channel of installable packages. In order to provide high-quality builds, the process has been automated into the conda-forge GitHub organization. The conda-forge organization contains one repository for each of the installable packages. Such a repository is known as a feedstock.

A feedstock is made up of a conda recipe (the instructions on what and how to build the package) and the necessary configurations for automatic building using freely available continuous integration services. Thanks to the awesome service provided by Azure, GitHub, CircleCI, AppVeyor, Drone, and TravisCI it is possible to build and upload installable packages to the conda-forge Anaconda-Cloud channel for Linux, Windows and OSX respectively.

To manage the continuous integration and simplify feedstock maintenance conda-smithy has been developed. Using the conda-forge.yml within this repository, it is possible to re-render all of this feedstock's supporting files (e.g. the CI configuration files) with conda smithy rerender.

For more information please check the conda-forge documentation.

Terminology

feedstock - the conda recipe (raw material), supporting scripts and CI configuration.

conda-smithy - the tool which helps orchestrate the feedstock. Its primary use is in the construction of the CI .yml files and simplify the management of many feedstocks.

conda-forge - the place where the feedstock and smithy live and work to produce the finished article (built conda distributions)

Updating cudatoolkit-dev-feedstock

If you would like to improve the cudatoolkit-dev recipe or build a new package version, please fork this repository and submit a PR. Upon submission, your changes will be run on the appropriate platforms to give the reviewer an opportunity to confirm that the changes result in a successful build. Once merged, the recipe will be re-built and uploaded automatically to the conda-forge channel, whereupon the built conda packages will be available for everybody to install and use from the conda-forge channel. Note that all branches in the conda-forge/cudatoolkit-dev-feedstock are immediately built and any created packages are uploaded, so PRs should be based on branches in forks and branches in the main repository should only be used to build distinct package versions.

In order to produce a uniquely identifiable distribution:

• If the version of a package is not being increased, please add or increase the build/number.
• If the version of a package is being increased, please remember to return the build/number back to 0.

Feedstock Maintainers

• @AgrawalAmey
• @andersy005
• @scopatz
• @xmnlab

cudatoolkit-dev-feedstock's Issues

cuda 11 support

Hi!

Is there a plan to add support for cuda 11? From the history, it looks like there were issues hit during 10.2 update. If someone can guide me through the issues we have hit, I am willing to contribute this change.

Building conda package for cuda drivers

Hi! It would be great if we could install cuda drivers with conda package. I just wanted to understand why is it excluded from current bundle, is it to avoid conflicts with user's primary graphics drivers? Or does it have something to do with licensing? From what I understand this should be technically possible, I am missing something? Thank you!

Installation problems

Comment:

I don't find the package. Since I use cudatoolkit(version 10.2.289) that doesn't include nvcc, I see that others have suggested installing this cudatoolkit-dev.

Missing nvcc Compiler

@AgrawalAmey @xmnlab Do either of you know if nvcc has been (accidentally) removed in this repo for cuda 11? When I install cudatoolkit-dev=10.1 it contains nvcc and I understand that nvcc doesn't come pre-packaged with cudatoolkit. Did something change for cuda 11? Is there an alternative way to get nvcc via conda-forge?

cudatoolkit-dev installed within a conda-build requires conda package dependency

Issue: see the title, otherwise the conda-build fails with

ERROR:conda.core.link:An error occurred while installing package 'conda-forge::cudatoolkit-dev-10.0-2'.
ERROR conda.core.link:_execute(696): An error occurred while installing package 'conda-forge::cudatoolkit-dev-10.0-2'.
Rolling back transaction: ...working... done
Traceback (most recent call last):
  File "/home/pearu/miniconda3/bin/conda-build", line 11, in <module>
    sys.exit(main())
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda_build/cli/main_build.py", line 445, in main
    execute(sys.argv[1:])
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda_build/cli/main_build.py", line 436, in execute
    verify=args.verify, variants=args.variants)
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda_build/api.py", line 209, in build
    notest=notest, need_source_download=need_source_download, variants=variants)
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda_build/build.py", line 2343, in build_tree
    notest=notest,
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda_build/build.py", line 1407, in build
    create_build_envs(top_level_pkg, notest)
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda_build/build.py", line 1247, in create_build_envs
    is_conda=m.name() == 'conda')
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda_build/environ.py", line 867, in create_env
    execute_actions(actions, index)
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda/common/io.py", line 88, in decorated
    return f(*args, **kwds)
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda/plan.py", line 321, in execute_actions
    execute_instructions(plan, index, verbose)
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda/plan.py", line 533, in execute_instructions
    cmd(state, arg)
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda/instructions.py", line 73, in UNLINKLINKTRANSACTION_CMD
    unlink_link_transaction.execute()
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda/core/link.py", line 247, in execute
    self._execute(tuple(concat(interleave(itervalues(self.prefix_action_groups)))))
  File "/home/pearu/miniconda3/lib/python3.7/site-packages/conda/core/link.py", line 712, in _execute
    rollback_excs,
conda.CondaMultiError: post-link script failed for package conda-forge::cudatoolkit-dev-10.0-2
location of failed script: /home/pearu/miniconda3/conda-bld/omniscidb-cuda_1566553013867/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/bin/.cudatoolkit-dev-post-link.sh
==> script messages <==
<None>
==> script output <==
stdout: 
stderr: Traceback (most recent call last):
  File "/home/pearu/miniconda3/conda-bld/omniscidb-cuda_1566553013867/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/bin/cudatoolkit-dev-post-install.py", line 44, in <module>
    from conda.exports import download, hashsum_file
ModuleNotFoundError: No module named 'conda'

Details about conda and system ( conda info ):

$ conda info
     active environment : base
    active env location : /home/pearu/miniconda3
            shell level : 1
       user config file : /home/pearu/.condarc
 populated config files : /home/pearu/.condarc
          conda version : 4.7.11
    conda-build version : 3.18.9
         python version : 3.7.3.final.0
       virtual packages : __cuda=10.1
       base environment : /home/pearu/miniconda3  (writable)
           channel URLs : https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/pearu/miniconda3/pkgs
                          /home/pearu/.conda/pkgs
       envs directories : /home/pearu/miniconda3/envs
                          /home/pearu/.conda/envs
               platform : linux-64
             user-agent : conda/4.7.11 requests/2.22.0 CPython/3.7.3 Linux/4.15.0-51-generic ubuntu/18.04.2 glibc/2.27
                UID:GID : 1001:1001
             netrc file : None
           offline mode : False

Unable to install package due to libxml2.so.2

Solution to issue cannot be found in the documentation.

• I checked the documentation.

Issue

Hi I am trying to instal cudatoolkit-dev from conda-forge and after two days of trial and error, I am still having the same issue. I get the following error

*stderr: ./cuda-installer: error while loading shared libraries: libxml2.so.2: cannot open shared object file: No such file or directory*

I install first
conda install pytorch torchvision torchaudio pytorch-cuda=11.7 cuda-toolkit -c 'nvidia/label/cuda-11.7.0' -c pytorch -c nvidia -y

Then
conda install -c conda-forge cudatoolkit-dev

I have installed manually libxml2 via conda install, while activated the environment. Still no effect. I have a feeling it has nothing to do with the dependency. I tried so many times thinking it was the sequential error, but it's not.

Full error is as follows
ERROR conda.core.link:_execute(945): An error occurred while installing package 'conda-forge::cudatoolkit-dev-11.7.0-h1de0b5d_6'. Rolling back transaction: done LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-11.7.0-h1de0b5d_6 location of failed script: /root/miniconda/envs/vicuna-matata/bin/.cudatoolkit-dev-post-link.sh ==> script messages <== <None> ==> script output <== stdout: Running Post installation downloading https://developer.download.nvidia.com/compute/cuda/11.7.0/local_installers/cuda_11.7.0_515.43.04_linux.run to /root/miniconda/envs/vicuna-matata/pkgs/cudatoolkit-dev/cuda_11.7.0_515.43.04_linux.run Extracting on Linux stderr: ./cuda-installer: error while loading shared libraries: libxml2.so.2: cannot open shared object file: No such file or directory Traceback (most recent call last): File "/root/miniconda/envs/vicuna-matata/bin/cudatoolkit-dev-post-install.py", line 311, in <module> _main() File "/root/miniconda/envs/vicuna-matata/bin/cudatoolkit-dev-post-install.py", line 307, in _main extractor.extract() File "/root/miniconda/envs/vicuna-matata/bin/cudatoolkit-dev-post-install.py", line 135, in extract subprocess.run(cmd, env=os.environ.copy(), check=True) File "/root/miniconda/envs/vicuna-matata/lib/python3.10/subprocess.py", line 526, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['/root/miniconda/envs/vicuna-matata/pkgs/cudatoolkit-dev/cuda_11.7.0_515.43.04_linux.run', '--silent', '--toolkit', '--toolkitpath=/tmp/tmpm21ydnnj', '--override']' returned non-zero exit status 127. return code: 1 ()

Executing all inside a docker container with base Linuxserver.io ubuntu, updated with wget, git, sudo and screen, as well as gcc-9 and g++-9

Installed packages

# packages in environment at /root/miniconda/envs/vicuna-matata:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main  
_openmp_mutex             5.1                       1_gnu  
blas                      1.0                         mkl  
brotli-python             1.0.9           py310h6a678d5_7  
bzip2                     1.0.8                h7b6447c_0  
ca-certificates           2023.12.12           h06a4308_0  
certifi                   2023.11.17      py310h06a4308_0  
cffi                      1.16.0          py310h5eee18b_0  
charset-normalizer        3.3.2                    pypi_0    pypi
cryptography              41.0.7          py310hdda0065_0  
cuda-cccl                 11.7.58              hc415cf5_0    nvidia/label/cuda-11.7.0
cuda-command-line-tools   11.7.0                        0    nvidia/label/cuda-11.7.0
cuda-compiler             11.7.0                        0    nvidia/label/cuda-11.7.0
cuda-cudart               11.7.60              h9538e0e_0    nvidia/label/cuda-11.7.0
cuda-cudart-dev           11.7.60              h6a7c232_0    nvidia/label/cuda-11.7.0
cuda-cuobjdump            11.7.50              h28cc80a_0    nvidia/label/cuda-11.7.0
cuda-cupti                11.7.50              hb6f9eaf_0    nvidia/label/cuda-11.7.0
cuda-cuxxfilt             11.7.50              hb365495_0    nvidia/label/cuda-11.7.0
cuda-documentation        11.7.50                       0    nvidia/label/cuda-11.7.0
cuda-driver-dev           11.7.60                       0    nvidia/label/cuda-11.7.0
cuda-gdb                  11.7.50              h4a0ac72_0    nvidia/label/cuda-11.7.0
cuda-libraries            11.7.0                        0    nvidia/label/cuda-11.7.0
cuda-libraries-dev        11.7.0                        0    nvidia/label/cuda-11.7.0
cuda-memcheck             11.7.50              hc446b2b_0    nvidia/label/cuda-11.7.0
cuda-nsight               11.7.50                       0    nvidia/label/cuda-11.7.0
cuda-nsight-compute       11.7.0                        0    nvidia/label/cuda-11.7.0
cuda-nvcc                 11.7.64                       0    nvidia/label/cuda-11.7.0
cuda-nvdisasm             11.7.50              h5bd0695_0    nvidia/label/cuda-11.7.0
cuda-nvml-dev             11.7.50              h3af1343_0    nvidia/label/cuda-11.7.0
cuda-nvprof               11.7.50              h7a2404d_0    nvidia/label/cuda-11.7.0
cuda-nvprune              11.7.50              h7add7b4_0    nvidia/label/cuda-11.7.0
cuda-nvrtc                11.7.50              hd0285e0_0    nvidia/label/cuda-11.7.0
cuda-nvrtc-dev            11.7.50              heada363_0    nvidia/label/cuda-11.7.0
cuda-nvtx                 11.7.50              h05b0816_0    nvidia/label/cuda-11.7.0
cuda-nvvp                 11.7.50              hd2289d5_0    nvidia/label/cuda-11.7.0
cuda-runtime              11.7.0                        0    nvidia/label/cuda-11.7.0
cuda-sanitizer-api        11.7.50              hb424887_0    nvidia/label/cuda-11.7.0
cuda-toolkit              11.7.0                        0    nvidia/label/cuda-11.7.0
cuda-tools                11.7.0                        0    nvidia/label/cuda-11.7.0
cuda-visual-tools         11.7.0                        0    nvidia/label/cuda-11.7.0
ffmpeg                    4.3                  hf484d3e_0    pytorch
filelock                  3.13.1          py310h06a4308_0  
freetype                  2.12.1               h4a9f257_0  
fsspec                    2023.12.2                pypi_0    pypi
gds-tools                 1.3.0.44                      0    nvidia/label/cuda-11.7.0
giflib                    5.2.1                h5eee18b_3  
gmp                       6.2.1                h295c915_3  
gmpy2                     2.1.2           py310heeb90bb_0  
gnutls                    3.6.15               he1e5248_0  
icu                       73.1                 h6a678d5_0  
idna                      3.6                      pypi_0    pypi
intel-openmp              2023.1.0         hdb19cb5_46306  
jinja2                    3.1.3                    pypi_0    pypi
jpeg                      9e                   h5eee18b_1  
lame                      3.100                h7b6447c_0  
lcms2                     2.12                 h3be6417_0  
ld_impl_linux-64          2.38                 h1181459_1  
lerc                      3.0                  h295c915_0  
libcublas                 11.10.1.25           he442b6f_0    nvidia/label/cuda-11.7.0
libcublas-dev             11.10.1.25           h0c8ac2b_0    nvidia/label/cuda-11.7.0
libcufft                  10.7.2.50            h80a1efe_0    nvidia/label/cuda-11.7.0
libcufft-dev              10.7.2.50            h59a5ac8_0    nvidia/label/cuda-11.7.0
libcufile                 1.3.0.44                      0    nvidia/label/cuda-11.7.0
libcufile-dev             1.3.0.44                      0    nvidia/label/cuda-11.7.0
libcurand                 10.2.10.50           heec50f7_0    nvidia/label/cuda-11.7.0
libcurand-dev             10.2.10.50           hd49a9cd_0    nvidia/label/cuda-11.7.0
libcusolver               11.3.5.50            hcab339c_0    nvidia/label/cuda-11.7.0
libcusolver-dev           11.3.5.50            hc6eba6f_0    nvidia/label/cuda-11.7.0
libcusparse               11.7.3.50            h6aaafad_0    nvidia/label/cuda-11.7.0
libcusparse-dev           11.7.3.50            hc644b96_0    nvidia/label/cuda-11.7.0
libdeflate                1.17                 h5eee18b_1  
libffi                    3.4.4                h6a678d5_0  
libgcc-ng                 11.2.0               h1234567_1  
libgomp                   11.2.0               h1234567_1  
libiconv                  1.16                 h7f8727e_2  
libidn2                   2.3.4                h5eee18b_0  
libjpeg-turbo             2.0.0                h9bf148f_0    pytorch
libnpp                    11.7.3.21            h3effbd9_0    nvidia/label/cuda-11.7.0
libnpp-dev                11.7.3.21            hb6476a9_0    nvidia/label/cuda-11.7.0
libnvjpeg                 11.7.2.34            hfe236c7_0    nvidia/label/cuda-11.7.0
libnvjpeg-dev             11.7.2.34            h2e48410_0    nvidia/label/cuda-11.7.0
libpng                    1.6.39               h5eee18b_0  
libstdcxx-ng              11.2.0               h1234567_1  
libtasn1                  4.19.0               h5eee18b_0  
libtiff                   4.5.1                h6a678d5_0  
libunistring              0.9.10               h27cfd23_0  
libuuid                   1.41.5               h5eee18b_0  
libwebp                   1.3.2                h11a3e52_0  
libwebp-base              1.3.2                h5eee18b_0  
libxml2                   2.10.4               hf1b16e4_1  
llvm-openmp               14.0.6               h9e868ea_0  
lz4-c                     1.9.4                h6a678d5_0  
markupsafe                2.1.3           py310h5eee18b_0  
mkl                       2023.1.0         h213fc3f_46344  
mkl-service               2.4.0           py310h5eee18b_1  
mkl_fft                   1.3.8           py310h5eee18b_0  
mkl_random                1.2.4           py310hdb19cb5_0  
mpc                       1.1.0                h10f8cd9_1  
mpfr                      4.0.2                hb69a4c5_1  
mpmath                    1.3.0           py310h06a4308_0  
ncurses                   6.4                  h6a678d5_0  
nettle                    3.7.3                hbbd107a_1  
networkx                  3.2.1                    pypi_0    pypi
nsight-compute            2022.2.0.13                   0    nvidia/label/cuda-11.7.0
numpy                     1.26.3          py310h5f9d8c6_0  
numpy-base                1.26.3          py310hb5e798b_0  
nvidia-cublas-cu12        12.1.3.1                 pypi_0    pypi
nvidia-cuda-cupti-cu12    12.1.105                 pypi_0    pypi
nvidia-cuda-nvrtc-cu12    12.1.105                 pypi_0    pypi
nvidia-cuda-runtime-cu12  12.1.105                 pypi_0    pypi
nvidia-cudnn-cu12         8.9.2.26                 pypi_0    pypi
nvidia-cufft-cu12         11.0.2.54                pypi_0    pypi
nvidia-curand-cu12        10.3.2.106               pypi_0    pypi
nvidia-cusolver-cu12      11.4.5.107               pypi_0    pypi
nvidia-cusparse-cu12      12.1.0.106               pypi_0    pypi
nvidia-nccl-cu12          2.18.1                   pypi_0    pypi
nvidia-nvjitlink-cu12     12.3.101                 pypi_0    pypi
nvidia-nvtx-cu12          12.1.105                 pypi_0    pypi
openh264                  2.1.1                h4ff587b_0  
openjpeg                  2.4.0                h3ad879b_0  
openssl                   3.0.12               h7f8727e_0  
pillow                    10.2.0                   pypi_0    pypi
pip                       23.3.1          py310h06a4308_0  
pycparser                 2.21               pyhd3eb1b0_0  
pyopenssl                 23.2.0          py310h06a4308_0  
pysocks                   1.7.1           py310h06a4308_0  
python                    3.10.13              h955ad1f_0  
pytorch                   2.1.2              py3.10_cpu_0    pytorch
pytorch-cuda              11.7                 h778d358_5    pytorch
pytorch-mutex             1.0                         cpu    pytorch
pyyaml                    6.0.1           py310h5eee18b_0  
readline                  8.2                  h5eee18b_0  
requests                  2.31.0          py310h06a4308_0  
setuptools                68.2.2          py310h06a4308_0  
sqlite                    3.41.2               h5eee18b_0  
sympy                     1.12            py310h06a4308_0  
tbb                       2021.8.0             hdb19cb5_0  
tk                        8.6.12               h1ccaba5_0  
torch                     2.1.2                    pypi_0    pypi
torchaudio                2.1.2                    pypi_0    pypi
torchvision               0.16.2                   pypi_0    pypi
triton                    2.1.0                    pypi_0    pypi
typing_extensions         4.9.0           py310h06a4308_0  
tzdata                    2023d                h04d1e81_0  
urllib3                   2.1.0                    pypi_0    pypi
wheel                     0.41.2          py310h06a4308_0  
xz                        5.4.5                h5eee18b_0  
yaml                      0.2.5                h7b6447c_0  
zlib                      1.2.13               h5eee18b_0  
zstd                      1.5.5                hc292b87_0

Environment info

active environment : vicuna-matata
    active env location : /root/miniconda/envs/vicuna-matata
            shell level : 2
       user config file : /root/.condarc
 populated config files : 
          conda version : 23.11.0
    conda-build version : not installed
         python version : 3.11.5.final.0
                 solver : libmamba (default)
       virtual packages : __archspec=1=haswell
                          __conda=23.11.0=0
                          __cuda=12.2=0
                          __glibc=2.35=0
                          __linux=6.1.64=0
                          __unix=0=0
       base environment : /root/miniconda  (writable)
      conda av data dir : /root/miniconda/etc/conda
  conda av metadata url : None
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /root/miniconda/pkgs
                          /root/.conda/pkgs
       envs directories : /root/miniconda/envs
                          /root/.conda/envs
               platform : linux-64
             user-agent : conda/23.11.0 requests/2.31.0 CPython/3.11.5 Linux/6.1.64-Unraid ubuntu/22.04.2 glibc/2.35 solver/libmamba conda-libmamba-solver/23.12.0 libmambapy/1.5.3
                UID:GID : 0:0
             netrc file : None
           offline mode : False

Is conda needed as a run dependency?

conda is currently listed as a run dependency, which means if you create an environment, conda gets installed with that environment, leading to multiple conda installs with potentially different versions (I think in principle only the base environment should have conda installed).

Is conda needed as a run dependency?

installation stuck on "Executing transaction"

Issue: Installation with conda stuck on "Executing transaction". After hitting C-c I get

ERROR conda.core.link:_execute(700): An error occurred while installing package 'conda-forge::cudatoolkit-dev-10.1.243-h516909a_1'.
Rolling back transaction: done

CondaSignalInterrupt: Signal interrupt SIGINT
()

Environment (conda list):

# packages in environment at /home/hovnatan/miniconda3:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main  
asn1crypto                0.24.0                py37_1003    conda-forge
astroid                   2.3.0                    py37_0    conda-forge
backcall                  0.1.0                      py_0    conda-forge
binutils_impl_linux-64    2.31.1               h6176602_1  
binutils_linux-64         2.31.1               h6176602_9    conda-forge
boost                     1.70.0           py37h9de70de_1    conda-forge
boost-cpp                 1.70.0               h8e57a91_2    conda-forge
bzip2                     1.0.8                h516909a_1    conda-forge
ca-certificates           2019.9.11            hecc5488_0    conda-forge
cairo                     1.16.0            hfb77d84_1002    conda-forge
certifi                   2019.9.11                py37_0    conda-forge
cffi                      1.12.3           py37h8022711_0    conda-forge
chardet                   3.0.4                 py37_1003    conda-forge
cmake                     3.15.3               hf94ab9c_0    conda-forge
conda                     4.7.12                   py37_0    conda-forge
conda-package-handling    1.6.0            py37h516909a_0    conda-forge
cryptography              2.7              py37h72c5cf5_0    conda-forge
cudatoolkit               10.0.130                      0  
curl                      7.65.3               hf8cf82a_0    conda-forge
cython                    0.29.13          py37he1b5a44_0    conda-forge
dbus                      1.13.6               he372182_0    conda-forge
decorator                 4.4.0                      py_0    conda-forge
expat                     2.2.5             he1b5a44_1003    conda-forge
fastcache                 1.1.0            py37h516909a_0    conda-forge
ffmpeg                    4.1.3                h167e202_0    conda-forge
fontconfig                2.13.1            h86ecdb6_1001    conda-forge
freetype                  2.10.0               he983fc9_1    conda-forge
gcc_impl_linux-64         7.3.0                habb00fd_1    conda-forge
gcc_linux-64              7.3.0                h553295d_9    conda-forge
gettext                   0.19.8.1          hc5be6a0_1002    conda-forge
giflib                    5.1.9                h516909a_0    conda-forge
glib                      2.58.3            h6f030ca_1002    conda-forge
gmp                       6.1.2             hf484d3e_1000    conda-forge
gmpy2                     2.1.0b1          py37h04dde30_0    conda-forge
gnutls                    3.6.5             hd3a4fd2_1002    conda-forge
graphite2                 1.3.13            hf484d3e_1000    conda-forge
greenlet                  0.4.15           py37h516909a_0    conda-forge
gst-plugins-base          1.14.5               h0935bb2_0    conda-forge
gstreamer                 1.14.5               h36ae1b5_0    conda-forge
gxx_impl_linux-64         7.3.0                hdf63c60_1    conda-forge
gxx_linux-64              7.3.0                h553295d_9    conda-forge
harfbuzz                  2.4.0                h9f30f68_3    conda-forge
hdf5                      1.10.5          nompi_h3c11f04_1103    conda-forge
icu                       64.2                 he1b5a44_1    conda-forge
idna                      2.8                   py37_1000    conda-forge
intel-openmp              2019.5                      281  
ipython                   7.8.0            py37h5ca1d4c_0    conda-forge
ipython_genutils          0.2.0                      py_1    conda-forge
isort                     4.3.21                   py37_0    conda-forge
jasper                    1.900.1           h07fcdf6_1006    conda-forge
jedi                      0.15.1                   py37_0    conda-forge
jpeg                      9c                h14c3975_1001    conda-forge
krb5                      1.16.3            h05b26f9_1001    conda-forge
lame                      3.100             h14c3975_1001    conda-forge
lazy-object-proxy         1.4.2            py37h516909a_0    conda-forge
libarchive                3.4.0                hb44662c_0    conda-forge
libblas                   3.8.0               12_openblas    conda-forge
libcblas                  3.8.0               12_openblas    conda-forge
libclang                  9.0.0                hc9558a2_0    conda-forge
libcurl                   7.65.3               hda55be3_0    conda-forge
libdrm-cos6-x86_64        2.4.65               hd39d64f_0  
libedit                   3.1.20170329      hf8c457e_1001    conda-forge
libffi                    3.2.1             he1b5a44_1006    conda-forge
libgcc-ng                 9.1.0                hdf63c60_0  
libgfortran-ng            7.3.0                hdf63c60_0  
libiconv                  1.15              h516909a_1005    conda-forge
liblapack                 3.8.0               12_openblas    conda-forge
liblapacke                3.8.0               12_openblas    conda-forge
libllvm9                  9.0.0                hc9558a2_2    conda-forge
libopenblas               0.3.7                h6e990d7_1    conda-forge
libpng                    1.6.37               hed695b0_0    conda-forge
libselinux-cos6-x86_64    2.0.94               hc7b3062_0  
libsepol-cos6-x86_64      2.0.41               h6e2433f_0  
libssh2                   1.8.2                h22169c7_2    conda-forge
libstdcxx-ng              9.1.0                hdf63c60_0  
libtiff                   4.0.10            h57b8799_1003    conda-forge
libuuid                   2.32.1            h14c3975_1000    conda-forge
libuv                     1.31.0               h516909a_0    conda-forge
libwebp                   1.0.2                h576950b_1    conda-forge
libx11-common-cos6-x86_64 1.6.4                h023ea50_0  
libx11-cos6-x86_64        1.6.4                h64a1553_0  
libxcb                    1.13              h14c3975_1002    conda-forge
libxdamage-cos6-x86_64    1.1.3                h8e310ee_0  
libxfixes-cos6-x86_64     5.0.3                h3a64028_0  
libxkbcommon              0.8.4                h516909a_0    conda-forge
libxml2                   2.9.9                hee79883_5    conda-forge
libxxf86vm-cos6-x86_64    1.1.3                h3cd9653_0  
lz4-c                     1.8.3             he1b5a44_1001    conda-forge
lzo                       2.10              h14c3975_1000    conda-forge
mccabe                    0.6.1                      py_1    conda-forge
mesa-dri-drivers-cos6-x86_64 11.0.7               h6ae8bd2_0  
mesa-dri1-drivers-cos6-x86_64 7.11                 hd08e721_0  
mesa-libgl-cos6-x86_64    11.0.7               h045e36e_0  
mkl                       2019.5                      281  
mpc                       1.1.0             hb20f59a_1006    conda-forge
mpfr                      4.0.2                he80fd80_0    conda-forge
mpmath                    1.1.0                      py_0    conda-forge
msgpack-python            0.6.2            py37hc9558a2_0    conda-forge
ncurses                   6.1               hf484d3e_1002    conda-forge
neovim                    0.3.1                    py37_0    conda-forge
nettle                    3.4.1             h1bed415_1002    conda-forge
ninja                     1.9.0                h6bb024c_0    conda-forge
nspr                      4.20              hf484d3e_1000    conda-forge
nss                       3.46                 he751ad9_0    conda-forge
numpy                     1.17.2           py37h95a1406_0    conda-forge
olefile                   0.46                       py_0    conda-forge
openblas                  0.3.7                h6e990d7_1    conda-forge
opencv                    4.1.1            py37h0cc45ee_2    conda-forge
openh264                  1.8.0             hdbcaa40_1000    conda-forge
openssl                   1.1.1c               h516909a_0    conda-forge
parso                     0.5.1                      py_0    conda-forge
pcre                      8.41              hf484d3e_1003    conda-forge
pexpect                   4.7.0                    py37_0    conda-forge
pickleshare               0.7.5                 py37_1000    conda-forge
pillow                    6.1.0            py37h6b7be26_1    conda-forge
pip                       19.2.3                   py37_0    conda-forge
pixman                    0.38.0            h516909a_1003    conda-forge
prompt_toolkit            2.0.9                      py_0    conda-forge
pthread-stubs             0.4               h14c3975_1001    conda-forge
ptyprocess                0.6.0                   py_1001    conda-forge
pudb                      2019.1                   py37_0    conda-forge
pycosat                   0.6.3           py37h14c3975_1001    conda-forge
pycparser                 2.19                     py37_1    conda-forge
pygments                  2.4.2                      py_0    conda-forge
pylint                    2.4.1                    py37_0    conda-forge
pynvim                    0.3.2                    py37_0    conda-forge
pyopenssl                 19.0.0                   py37_0    conda-forge
pysocks                   1.7.1                    py37_0    conda-forge
python                    3.7.3                h33d41f4_1    conda-forge
python-libarchive-c       2.8                   py37_1004    conda-forge
pytorch                   1.2.0           py3.7_cuda10.0.130_cudnn7.6.2_0    pytorch
qt                        5.12.5               h0c104cb_0    conda-forge
readline                  8.0                  hf8c457e_0    conda-forge
requests                  2.22.0                   py37_1    conda-forge
rhash                     1.3.6             h14c3975_1001    conda-forge
ruamel_yaml               0.15.71         py37h14c3975_1000    conda-forge
setuptools                41.2.0                   py37_0    conda-forge
six                       1.12.0                py37_1000    conda-forge
sqlite                    3.29.0               hcee41ef_1    conda-forge
sympy                     1.4                      py37_0    conda-forge
tbb                       2019.8               hc9558a2_0    conda-forge
tbb-devel                 2019.8               hc9558a2_0    conda-forge
tk                        8.6.9             hed695b0_1003    conda-forge
torchvision               0.4.0                py37_cu100    pytorch
tqdm                      4.36.1                     py_0    conda-forge
traitlets                 4.3.2                 py37_1000    conda-forge
urllib3                   1.25.6                   py37_0    conda-forge
urwid                     2.0.1           py37h14c3975_1000    conda-forge
wcwidth                   0.1.7                      py_1    conda-forge
wheel                     0.33.6                   py37_0    conda-forge
wrapt                     1.11.2           py37h516909a_0    conda-forge
x264                      1!152.20180806       h14c3975_0    conda-forge
xorg-kbproto              1.0.7             h14c3975_1002    conda-forge
xorg-libice               1.0.10               h516909a_0    conda-forge
xorg-libsm                1.2.3             h84519dc_1000    conda-forge
xorg-libx11               1.6.8                h516909a_0    conda-forge
xorg-libxau               1.0.9                h14c3975_0    conda-forge
xorg-libxdmcp             1.1.3                h516909a_0    conda-forge
xorg-libxext              1.3.4                h516909a_0    conda-forge
xorg-libxrender           0.9.10            h516909a_1002    conda-forge
xorg-renderproto          0.11.1            h14c3975_1002    conda-forge
xorg-xextproto            7.3.0             h14c3975_1002    conda-forge
xorg-xproto               7.0.31            h14c3975_1007    conda-forge
xz                        5.2.4             h14c3975_1001    conda-forge
yaml                      0.1.7             h14c3975_1001    conda-forge
yapf                      0.28.0                     py_0    conda-forge
zlib                      1.2.11            h516909a_1006    conda-forge
zstd                      1.4.0                h3b9ef0a_0    conda-forge

Details about conda and system ( conda info ):

     active environment : base
    active env location : /home/hovnatan/miniconda3
            shell level : 1
       user config file : /home/hovnatan/.condarc
 populated config files : /home/hovnatan/.condarc
          conda version : 4.7.12
    conda-build version : not installed
         python version : 3.7.3.final.0
       virtual packages : 
       base environment : /home/hovnatan/miniconda3  (writable)
           channel URLs : https://conda.anaconda.org/pytorch/linux-64
                          https://conda.anaconda.org/pytorch/noarch
                          https://conda.anaconda.org/fastai/linux-64
                          https://conda.anaconda.org/fastai/noarch
                          https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/hovnatan/miniconda3/pkgs
                          /home/hovnatan/.conda/pkgs
       envs directories : /home/hovnatan/miniconda3/envs
                          /home/hovnatan/.conda/envs
               platform : linux-64
             user-agent : conda/4.7.12 requests/2.22.0 CPython/3.7.3 Linux/5.3.1-arch1-1-ARCH arch/rolling glibc/2.29
                UID:GID : 1000:1000
             netrc file : None
           offline mode : False

Can't run the cuda program in bin directory which is symbolic link.

• I read the conda-forge documentation and could not find the solution for my problem there.

Issue: Can't run the cuda program in bin directory which is symbolic link.
Let's take nsys for example.

The nsys in envs/cuda113/bin is a symbolic link to envs/cuda113/pkgs/cuda-toolkit/bin/nsys

$ pwd
/home/ubuntu/miniconda3/envs/cuda113/bin
$ ll|grep nsys
lrwxrwxrwx  1 ubuntu ubuntu   63 Jan 17 17:14 nsys -> /home/ubuntu/miniconda3/envs/cuda113/pkgs/cuda-toolkit/bin/nsys*

But envs/cuda113/bin/nsys runs with Error, Because the code DIR=$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd) in the nsys script returns wrong directory path.

nsys script content:

#!/bin/bash

shopt -s execfail
try_exec() {
    if [[ -x "$1" ]]; then
        exec "$@"
    fi
}

die() {
    echo "$@" >&2
    exit 1
}

case "$(uname -m)" in
    x86_64) arch=x64 ;;
    aarch64) arch=armv8 ;;
    ppc64le) arch=ppc64le ;;
    *)
        die "Error: Nsight Systems is not supported on $(uname -m)"
        ;;
esac

DIR=$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)
CUDA_INSTALL_DIR=$(cd "$DIR/.." && pwd)
try_exec "$CUDA_INSTALL_DIR"/nsight-systems-2021.1.3/target-linux-"$arch"/nsys "$@"
try_exec /opt/nvidia/nsight-systems/2021.1.3/target-linux-"$arch"/nsys "$@"
try_exec /opt/nvidia/nsight-systems-cli/2021.1.3/target-linux-"$arch"/nsys "$@"

die "Error: Nsight Systems 2021.1.3 hasn't been installed with CUDA Toolkit 11.3"

$ bash -x nsys with error:

+ shopt -s execfail
+ case "$(uname -m)" in
++ uname -m
+ arch=x64
+++ dirname nsys
++ cd .
++ pwd
+ DIR=/home/ubuntu/miniconda3/envs/cuda113/bin
++ cd /home/ubuntu/miniconda3/envs/cuda113/bin/..
++ pwd
+ CUDA_INSTALL_DIR=/home/ubuntu/miniconda3/envs/cuda113
+ try_exec /home/ubuntu/miniconda3/envs/cuda113/nsight-systems-2021.1.3/target-linux-x64/nsys
+ [[ -x /home/ubuntu/miniconda3/envs/cuda113/nsight-systems-2021.1.3/target-linux-x64/nsys ]]
+ try_exec /opt/nvidia/nsight-systems/2021.1.3/target-linux-x64/nsys
+ [[ -x /opt/nvidia/nsight-systems/2021.1.3/target-linux-x64/nsys ]]
+ try_exec /opt/nvidia/nsight-systems-cli/2021.1.3/target-linux-x64/nsys
+ [[ -x /opt/nvidia/nsight-systems-cli/2021.1.3/target-linux-x64/nsys ]]
+ die 'Error: Nsight Systems 2021.1.3 hasn'\''t been installed with CUDA Toolkit 11.3'
+ echo 'Error: Nsight Systems 2021.1.3 hasn'\''t been installed with CUDA Toolkit 11.3'
Error: Nsight Systems 2021.1.3 hasn't been installed with CUDA Toolkit 11.3
+ exit 1

bash -x $(readlink nsys) is OK:

+ shopt -s execfail
+ case "$(uname -m)" in
++ uname -m
+ arch=x64
+++ dirname /home/ubuntu/miniconda3/envs/cuda113/pkgs/cuda-toolkit/bin/nsys
++ cd /home/ubuntu/miniconda3/envs/cuda113/pkgs/cuda-toolkit/bin
++ pwd
+ DIR=/home/ubuntu/miniconda3/envs/cuda113/pkgs/cuda-toolkit/bin
++ cd /home/ubuntu/miniconda3/envs/cuda113/pkgs/cuda-toolkit/bin/..
++ pwd
+ CUDA_INSTALL_DIR=/home/ubuntu/miniconda3/envs/cuda113/pkgs/cuda-toolkit
+ try_exec /home/ubuntu/miniconda3/envs/cuda113/pkgs/cuda-toolkit/nsight-systems-2021.1.3/target-linux-x64/nsys
+ [[ -x /home/ubuntu/miniconda3/envs/cuda113/pkgs/cuda-toolkit/nsight-systems-2021.1.3/target-linux-x64/nsys ]]
+ exec /home/ubuntu/miniconda3/envs/cuda113/pkgs/cuda-toolkit/nsight-systems-2021.1.3/target-linux-x64/nsys
 usage: nsys [--version] [--help] <command> [<args>] [application] [<application args>]

 The most commonly used nsys commands are:
	profile       Run an application and capture its profile into a QDSTRM file.
	launch        Launch an application ready to be profiled.
	start         Start a profiling session.
	stop          Stop a profiling session and capture its profile into a QDSTRM file.
	cancel        Cancel a profiling session and discard any collected data.
	stats         Generate statistics from an existing QDREP or SQLite file.
	status        Provide current status of CLI or the collection environment.
	shutdown      Disconnect launched processes from the profiler and shutdown the profiler.
	sessions list List active sessions.
	export        Export QDREP file into another format.
	nvprof        Translate nvprof switches to nsys switches and execute collection.

 Use 'nsys --help <command>' for more information about a specific command.

 To run a basic profiling session:   nsys profile ./my-application

Environment (conda list):

$ conda list
# packages in environment at /home/ubuntu/miniconda3/envs/cuda113:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main  
_openmp_mutex             4.5                       1_gnu  
ca-certificates           2021.10.8            ha878542_0    conda-forge
certifi                   2021.10.8        py38h578d9bd_1    conda-forge
cudatoolkit-dev           11.3.1           py38h497a2fe_0    conda-forge
ld_impl_linux-64          2.35.1               h7274673_9  
libffi                    3.3                  he6710b0_2  
libgcc-ng                 9.3.0               h5101ec6_17  
libgomp                   9.3.0               h5101ec6_17  
libstdcxx-ng              9.3.0               hd4cf53a_17  
ncurses                   6.3                  h7f8727e_2  
openssl                   1.1.1m               h7f8727e_0  
pip                       21.2.4           py38h06a4308_0  
python                    3.8.12               h12debd9_0  
python_abi                3.8                      2_cp38    conda-forge
readline                  8.1.2                h7f8727e_1  
setuptools                58.0.4           py38h06a4308_0  
sqlite                    3.37.0               hc218d9a_0  
tk                        8.6.11               h1ccaba5_0  
wheel                     0.37.1             pyhd3eb1b0_0  
xz                        5.2.5                h7b6447c_0  
zlib                      1.2.11               h7f8727e_4  

Details about conda and system ( conda info ):

$ conda info
     active environment : cuda113
    active env location : /home/ubuntu/miniconda3/envs/cuda113
            shell level : 1
       user config file : /home/ubuntu/.condarc
 populated config files : /home/ubuntu/.condarc
          conda version : 4.11.0
    conda-build version : not installed
         python version : 3.8.3.final.0
       virtual packages : __cuda=11.2=0
                          __linux=5.11.0=0
                          __glibc=2.31=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : /home/ubuntu/miniconda3  (writable)
      conda av data dir : /home/ubuntu/miniconda3/etc/conda
  conda av metadata url : None
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/ubuntu/miniconda3/pkgs
                          /home/ubuntu/.conda/pkgs
       envs directories : /home/ubuntu/miniconda3/envs
                          /home/ubuntu/.conda/envs
               platform : linux-64
             user-agent : conda/4.11.0 requests/2.27.1 CPython/3.8.3 Linux/5.11.0-46-generic ubuntu/20.04.3 glibc/2.31
                UID:GID : 1000:1000
             netrc file : /home/ubuntu/.netrc
           offline mode : False

Got 'Ensure there is enough space in /tmp and that the installation package is not corrupt' when run 'conda install cudatoolkit-dev -c conda-forge'

• I read the conda-forge documentation and could not find the solution for my problem there.

Issue: Got 'Ensure there is enough space in /tmp and that the installation package is not corrupt' when run 'conda install cudatoolkit-dev -c conda-forge'

I think the problem is my tmp directory (2GB available) doesn't have enough space. I want to know how much space installation of cudatoolkit-dev requires and whether I can point another tmp directory to complete the installation. Any idea?

Environment (conda list):

$ conda list
# packages in environment at /export/local/hxw080/anaconda3/envs/nerfies:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main
ca-certificates           2021.1.19            h06a4308_1
certifi                   2020.12.5        py38h06a4308_0
ld_impl_linux-64          2.33.1               h53a641e_7
libffi                    3.3                  he6710b0_2
libgcc-ng                 9.1.0                hdf63c60_0
libstdcxx-ng              9.1.0                hdf63c60_0
ncurses                   6.2                  he6710b0_1
openssl                   1.1.1j               h27cfd23_0
pip                       21.0.1           py38h06a4308_0
python                    3.8.8                hdb3f193_4
readline                  8.1                  h27cfd23_0
setuptools                52.0.0           py38h06a4308_0
sqlite                    3.35.2               hdfb4753_0
tk                        8.6.10               hbc83047_0
wheel                     0.36.2             pyhd3eb1b0_0
xz                        5.2.5                h7b6447c_0
zlib                      1.2.11               h7b6447c_3

Details about conda and system ( conda info ):

$ conda info
     active environment : nerfies
    active env location : /export/local/hxw080/anaconda3/envs/nerfies
            shell level : 3
       user config file : /home/students/hxw080/.condarc
 populated config files :
          conda version : 4.9.2
    conda-build version : 3.20.5
         python version : 3.8.5.final.0
       virtual packages : __cuda=10.1=0
                          __glibc=2.17=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : /export/local/hxw080/anaconda3  (writable)
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /export/local/hxw080/anaconda3/pkgs
                          /home/students/hxw080/.conda/pkgs
       envs directories : /export/local/hxw080/anaconda3/envs
                          /home/students/hxw080/.conda/envs
               platform : linux-64
             user-agent : conda/4.9.2 requests/2.24.0 CPython/3.8.5 Linux/3.10.0-1160.11.1.el7.x86_64 centos/7.9.2009 glibc/2.17
                UID:GID : 18368:1040
             netrc file : None
           offline mode : False

Details about ( conda install ):

$ conda install
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /export/local/hxw080/anaconda3/envs/nerfies

  added / updated specs:
    - cudatoolkit-dev


The following NEW packages will be INSTALLED:

  cudatoolkit-dev    conda-forge/linux-64::cudatoolkit-dev-10.1.243-h516909a_3
  python_abi         conda-forge/linux-64::python_abi-3.8-1_cp38

The following packages will be UPDATED:

  certifi            pkgs/main::certifi-2020.12.5-py38h06a~ --> conda-forge::certifi-2020.12.5-py38h578d9bd_1

The following packages will be SUPERSEDED by a higher-priority channel:

  ca-certificates    pkgs/main::ca-certificates-2021.1.19-~ --> conda-forge::ca-certificates-2020.12.5-ha878542_0


Proceed ([y]/n)? y

Preparing transaction: done
Verifying transaction: done
Executing transaction: / Extraction failed.
Ensure there is enough space in /tmp and that the installation package is not corrupt
done
ERROR conda.core.link:_execute(698): An error occurred while installing package 'conda-forge::cudatoolkit-dev-10.1.243-h516909a_3'.
Rolling back transaction: done

LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-10.1.243-h516909a_3
location of failed script: /export/local/hxw080/anaconda3/envs/nerfies/bin/.cudatoolkit-dev-post-link.sh
==> script messages <==
<None>
==> script output <==
stdout: Running Post installation
downloading https://developer.download.nvidia.com/compute/cuda/10.1/Prod/local_installers/cuda_10.1.243_418.87.00_rhel6.run to /export/local/hxw080/anaconda3/envs/nerfies/pkgs/cudatoolkit-dev/cuda_10.1.243_418.87.00_rhel6.run
Extracting on Linux

stderr: Signal caught, cleaning up
Traceback (most recent call last):
  File "/export/local/hxw080/anaconda3/envs/nerfies/bin/cudatoolkit-dev-post-install.py", line 273, in <module>
    _main()
  File "/export/local/hxw080/anaconda3/envs/nerfies/bin/cudatoolkit-dev-post-install.py", line 269, in _main
    extractor.extract()
  File "/export/local/hxw080/anaconda3/envs/nerfies/bin/cudatoolkit-dev-post-install.py", line 117, in extract
    status = subprocess.run(cmd, check=True)
  File "/export/local/hxw080/anaconda3/envs/nerfies/lib/python3.8/subprocess.py", line 516, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/export/local/hxw080/anaconda3/envs/nerfies/pkgs/cudatoolkit-dev/cuda_10.1.243_418.87.00_rhel6.run', '--extract=/tmp/tmpzzfei42g', '--override']' returned non-zero exit status 15.

return code: 1

()

Updating cudatoolkit-dev fails: File exists: '/path/to/pkgs/cuda-toolkit'

Issue:
conda update -c conda-forge cudatoolkit-dev fails:

...
Running Post installation
downloading https://developer.download.nvidia.com/compute/cuda/10.1/Prod/local_installers/cuda_10.1.243_418.87.00_rhel6.run to /home/pearu/mconda3/envs/cudatoolkit-test/pkgs/cudatoolkit-dev/cuda_10.1.243_418.87.00_rhel6.run
Extracting on Linux
Try using /tmp/tmp_yq6alf_/cuda-linux.10.1.243-26907403.run

stderr: Traceback (most recent call last):
  File "/home/pearu/mconda3/envs/cudatoolkit-test/bin/cudatoolkit-dev-post-install.py", line 301, in <module>
    _main()
  File "/home/pearu/mconda3/envs/cudatoolkit-test/bin/cudatoolkit-dev-post-install.py", line 297, in _main
    extractor.extract()
  File "/home/pearu/mconda3/envs/cudatoolkit-test/bin/cudatoolkit-dev-post-install.py", line 168, in extract
    self.copy_files(toolkitpath, self.src_dir)
  File "/home/pearu/mconda3/envs/cudatoolkit-test/bin/cudatoolkit-dev-post-install.py", line 124, in copy_files
    source, destination, symlinks=True, ignore_dangling_symlinks=True
  File "/home/pearu/mconda3/lib/python3.7/shutil.py", line 321, in copytree
    os.makedirs(dst)
  File "/home/pearu/mconda3/lib/python3.7/os.py", line 221, in makedirs
    mkdir(name, mode)
FileExistsError: [Errno 17] File exists: '/home/pearu/mconda3/envs/cudatoolkit-test/pkgs/cuda-toolkit'

return code: 1

()

subprocess.CalledProcessError in conda install cudatoolkit-dev=10.1

• [ x] I read the conda-forge documentation and could not find the solution for my problem there.

Issue:

Environment (conda list):

$ conda list

# packages in environment at /home/fuerste/miniconda3/envs/openmmlab_101:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main  
_openmp_mutex             4.5                       1_gnu  
addict                    2.4.0                    pypi_0    pypi
appdirs                   1.4.4                    pypi_0    pypi
argcomplete               1.12.3             pyhd3eb1b0_0  
argon2-cffi               20.1.0           py37h27cfd23_1  
async_generator           1.10             py37h28b3542_0  
asynctest                 0.13.0                   pypi_0    pypi
attrs                     21.2.0             pyhd3eb1b0_0  
autopep8                  1.5.7              pyhd3eb1b0_0  
backcall                  0.2.0              pyhd3eb1b0_0  
blas                      1.0                         mkl  
bleach                    4.0.0              pyhd3eb1b0_0  
bottleneck                1.3.2            py37heb32a55_1  
brotli                    1.0.9                he6710b0_2  
bzip2                     1.0.8                h7b6447c_0  
ca-certificates           2021.9.30            h06a4308_1  
certifi                   2021.10.8        py37h06a4308_0  
cffi                      1.14.6           py37h400218f_0  
charset-normalizer        2.0.7                    pypi_0    pypi
cityscapesscripts         2.2.0                    pypi_0    pypi
click                     8.0.3                    pypi_0    pypi
codecov                   2.1.12                   pypi_0    pypi
colorama                  0.4.4                    pypi_0    pypi
coloredlogs               15.0.1                   pypi_0    pypi
configparser              5.0.2                    pypi_0    pypi
coverage                  6.0.2                    pypi_0    pypi
cudatoolkit               10.1.243             h6bb024c_0  
cycler                    0.10.0                   pypi_0    pypi
cython                    0.29.24                  pypi_0    pypi
dbus                      1.13.18              hb2f20db_0  
debugpy                   1.4.1            py37h295c915_0  
decorator                 5.1.0              pyhd3eb1b0_0  
defusedxml                0.7.1              pyhd3eb1b0_0  
docker-pycreds            0.4.0                    pypi_0    pypi
dotty-dict                1.3.0                    pypi_0    pypi
entrypoints               0.3                      py37_0  
expat                     2.4.1                h2531618_2  
ffmpeg                    4.2.2                h20bf706_0  
flake8                    4.0.1                    pypi_0    pypi
flake8-import-order       0.18.1                   pypi_0    pypi
flatbuffers               2.0                      pypi_0    pypi
fontconfig                2.13.1               h6c09931_0  
fonttools                 4.25.0             pyhd3eb1b0_0  
freetype                  2.10.4               h5ab3b9f_0  
giflib                    5.2.1                h7b6447c_0  
gitdb                     4.0.9                    pypi_0    pypi
gitpython                 3.1.24                   pypi_0    pypi
glib                      2.69.1               h5202010_0  
gmp                       6.2.1                h2531618_2  
gnutls                    3.6.15               he1e5248_0  
gst-plugins-base          1.14.0               h8213a91_2  
gstreamer                 1.14.0               h28cd5cc_2  
humanfriendly             10.0                     pypi_0    pypi
icu                       58.2                 he6710b0_3  
idna                      3.3                      pypi_0    pypi
imagecorruptions          1.1.2                    pypi_0    pypi
imageio                   2.9.0                    pypi_0    pypi
importlib-metadata        4.2.0                    pypi_0    pypi
importlib_metadata        4.8.1                hd3eb1b0_0  
iniconfig                 1.1.1                    pypi_0    pypi
intel-openmp              2021.3.0          h06a4308_3350  
interrogate               1.5.0                    pypi_0    pypi
ipykernel                 6.4.1            py37h06a4308_1  
ipython                   7.27.0           py37hb070fc8_0  
ipython_genutils          0.2.0              pyhd3eb1b0_1  
ipywidgets                7.6.5              pyhd3eb1b0_1  
isort                     4.3.21                   pypi_0    pypi
jedi                      0.18.0           py37h06a4308_1  
jinja2                    3.0.1              pyhd3eb1b0_0  
joblib                    1.1.0                    pypi_0    pypi
jpeg                      9b                   h024ee3a_2  
jsonschema                3.2.0              pyhd3eb1b0_2  
jupyter                   1.0.0            py37h89c1867_6    conda-forge
jupyter_client            7.0.1              pyhd3eb1b0_0  
jupyter_console           6.4.0              pyhd3eb1b0_0  
jupyter_core              4.8.1            py37h06a4308_0  
jupyterlab_pygments       0.1.2                      py_0  
jupyterlab_widgets        1.0.0              pyhd3eb1b0_1  
kiwisolver                1.3.2                    pypi_0    pypi
kwarray                   0.5.19                   pypi_0    pypi
lame                      3.100                h7b6447c_0  
lcms2                     2.12                 h3be6417_0  
ld_impl_linux-64          2.35.1               h7274673_9  
libffi                    3.3                  he6710b0_2  
libgcc-ng                 9.3.0               h5101ec6_17  
libgfortran-ng            7.5.0               ha8ba4b0_17  
libgfortran4              7.5.0               ha8ba4b0_17  
libgomp                   9.3.0               h5101ec6_17  
libidn2                   2.3.2                h7f8727e_0  
libopus                   1.3.1                h7b6447c_0  
libpng                    1.6.37               hbc83047_0  
libsodium                 1.0.18               h7b6447c_0  
libstdcxx-ng              9.3.0               hd4cf53a_17  
libtasn1                  4.16.0               h27cfd23_0  
libtiff                   4.2.0                h85742a9_0  
libunistring              0.9.10               h27cfd23_0  
libuuid                   1.0.3                h7f8727e_2  
libuv                     1.40.0               h7b6447c_0  
libvpx                    1.7.0                h439df22_0  
libwebp                   1.2.0                h89dd481_0  
libwebp-base              1.2.0                h27cfd23_0  
libxcb                    1.14                 h7b6447c_0  
libxml2                   2.9.12               h03d6c58_0  
lz4-c                     1.9.3                h295c915_1  
markupsafe                2.0.1            py37h27cfd23_0  
matplotlib                3.4.3            py37h06a4308_0  
matplotlib-base           3.4.3            py37hbbc1b5f_0  
matplotlib-inline         0.1.2              pyhd3eb1b0_2  
mccabe                    0.6.1                    pypi_0    pypi
mistune                   0.8.4           py37h14c3975_1001  
mkl                       2021.3.0           h06a4308_520  
mkl-service               2.4.0            py37h7f8727e_0  
mkl_fft                   1.3.1            py37hd3c417c_0  
mkl_random                1.2.2            py37h51133e4_0  
mmcls                     0.16.0                   pypi_0    pypi
mmcv-full                 1.3.15                   pypi_0    pypi
mmdet                     2.17.0                   pypi_0    pypi
mmtrack                   0.8.0                    pypi_0    pypi
motmetrics                1.2.0                    pypi_0    pypi
munkres                   1.1.4                      py_0  
nbclient                  0.5.3              pyhd3eb1b0_0  
nbconvert                 6.1.0            py37h06a4308_0  
nbformat                  5.1.3              pyhd3eb1b0_0  
ncurses                   6.2                  he6710b0_1  
nest-asyncio              1.5.1              pyhd3eb1b0_0  
nettle                    3.7.3                hbbd107a_1  
networkx                  2.6.3                    pypi_0    pypi
ninja                     1.10.2               hff7bd54_1  
notebook                  6.4.5              pyha770c72_0    conda-forge
numexpr                   2.7.3            py37h22e1b3c_1  
numpy                     1.21.2           py37h20f2e39_0  
numpy-base                1.21.2           py37h79a1101_0  
olefile                   0.46                     py37_0  
onnx                      1.7.0                    pypi_0    pypi
onnxruntime               1.9.0                    pypi_0    pypi
opencv-python             4.5.3.56                 pypi_0    pypi
openh264                  2.1.0                hd408876_0  
openssl                   1.1.1l               h7f8727e_0  
ordered-set               4.0.2                    pypi_0    pypi
packaging                 21.0               pyhd3eb1b0_0  
pandas                    1.3.4                    pypi_0    pypi
pandocfilters             1.4.3            py37h06a4308_1  
parso                     0.8.2              pyhd3eb1b0_0  
pathtools                 0.1.2                    pypi_0    pypi
pcre                      8.45                 h295c915_0  
pexpect                   4.8.0              pyhd3eb1b0_3  
pickleshare               0.7.5           pyhd3eb1b0_1003  
pillow                    8.4.0            py37h5aabda8_0  
pip                       21.0.1           py37h06a4308_0  
pluggy                    1.0.0                    pypi_0    pypi
prometheus_client         0.11.0             pyhd3eb1b0_0  
promise                   2.3                      pypi_0    pypi
prompt-toolkit            3.0.20             pyhd3eb1b0_0  
prompt_toolkit            3.0.20               hd3eb1b0_0  
protobuf                  3.18.1                   pypi_0    pypi
psutil                    5.8.0                    pypi_0    pypi
ptyprocess                0.7.0              pyhd3eb1b0_2  
py                        1.10.0                   pypi_0    pypi
py-cpuinfo                8.0.0                    pypi_0    pypi
pycocotools               2.0.2                    pypi_0    pypi
pycodestyle               2.8.0                    pypi_0    pypi
pycparser                 2.20                       py_2  
pyflakes                  2.4.0                    pypi_0    pypi
pygments                  2.10.0             pyhd3eb1b0_0  
pyparsing                 2.4.7              pyhd3eb1b0_0  
pyqt                      5.9.2            py37h05f1152_2  
pyquaternion              0.9.9                    pypi_0    pypi
pyrsistent                0.17.3           py37h7b6447c_0  
pytest                    6.2.5                    pypi_0    pypi
pytest-benchmark          3.4.1                    pypi_0    pypi
python                    3.7.11               h12debd9_0  
python-dateutil           2.8.2              pyhd3eb1b0_0  
python_abi                3.7                     2_cp37m    conda-forge
pytorch                   1.8.1           py3.7_cuda10.1_cudnn7.6.3_0    pytorch
pytz                      2021.3                   pypi_0    pypi
pywavelets                1.1.1                    pypi_0    pypi
pyyaml                    6.0                      pypi_0    pypi
pyzmq                     22.2.1           py37h295c915_1  
qt                        5.9.7                h5867ecd_1  
qtconsole                 5.1.1              pyhd3eb1b0_0  
qtpy                      1.10.0             pyhd3eb1b0_0  
readline                  8.1                  h27cfd23_0  
requests                  2.26.0                   pypi_0    pypi
scikit-image              0.18.3                   pypi_0    pypi
scikit-learn              1.0                      pypi_0    pypi
scipy                     1.7.1            py37h292c36d_2  
seaborn                   0.11.2             pyhd3eb1b0_0  
send2trash                1.8.0              pyhd3eb1b0_1  
sentry-sdk                1.4.3                    pypi_0    pypi
setuptools                58.0.4           py37h06a4308_0  
setuptools-scm            6.3.2                    pypi_0    pypi
shortuuid                 1.0.1                    pypi_0    pypi
sip                       4.19.8           py37hf484d3e_0  
six                       1.16.0             pyhd3eb1b0_0  
sklearn                   0.0                      pypi_0    pypi
smmap                     5.0.0                    pypi_0    pypi
sqlite                    3.36.0               hc218d9a_0  
subprocess32              3.5.4                    pypi_0    pypi
tabulate                  0.8.9                    pypi_0    pypi
termcolor                 1.1.0                    pypi_0    pypi
terminado                 0.9.4            py37h06a4308_0  
terminaltables            3.1.0                    pypi_0    pypi
testpath                  0.5.0              pyhd3eb1b0_0  
threadpoolctl             3.0.0                    pypi_0    pypi
tifffile                  2021.10.12               pypi_0    pypi
tk                        8.6.11               h1ccaba5_0  
toml                      0.10.2             pyhd3eb1b0_0  
tomli                     1.2.1                    pypi_0    pypi
torchvision               0.9.1                py37_cu101    pytorch
tornado                   6.1              py37h27cfd23_0  
tqdm                      4.62.3                   pypi_0    pypi
traitlets                 5.1.0              pyhd3eb1b0_0  
typing                    3.7.4.3                  pypi_0    pypi
typing_extensions         3.10.0.2           pyh06a4308_0  
ubelt                     0.10.1                   pypi_0    pypi
urllib3                   1.26.7                   pypi_0    pypi
wandb                     0.12.5                   pypi_0    pypi
wcwidth                   0.2.5              pyhd3eb1b0_0  
webencodings              0.5.1                    py37_1  
wheel                     0.37.0             pyhd3eb1b0_1  
widgetsnbextension        3.5.1                    py37_0  
x264                      1!157.20191217       h7b6447c_0  
xdoctest                  0.15.10                  pypi_0    pypi
xmltodict                 0.12.0                   pypi_0    pypi
xz                        5.2.5                h7b6447c_0  
yapf                      0.31.0                   pypi_0    pypi
yaspin                    2.1.0                    pypi_0    pypi
zeromq                    4.3.4                h2531618_0  
zipp                      3.6.0              pyhd3eb1b0_0  
zlib                      1.2.11               h7b6447c_3  
zstd                      1.4.9                haebb681_0  

Details about conda and system ( conda info ):

$ conda info

     active environment : openmmlab_101
    active env location : /home/fuerste/miniconda3/envs/openmmlab_101
            shell level : 2
       user config file : /home/fuerste/.condarc
 populated config files : 
          conda version : 4.9.2
    conda-build version : not installed
         python version : 3.8.5.final.0
       virtual packages : __cuda=11.4=0
                          __glibc=2.31=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : /home/fuerste/miniconda3  (writable)
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/fuerste/miniconda3/pkgs
                          /home/fuerste/.conda/pkgs
       envs directories : /home/fuerste/miniconda3/envs
                          /home/fuerste/.conda/envs
               platform : linux-64
             user-agent : conda/4.9.2 requests/2.24.0 CPython/3.8.5 Linux/5.4.0-89-generic ubuntu/20.04.3 glibc/2.31
                UID:GID : 1071:100
             netrc file : /home/fuerste/.netrc
           offline mode : False

So I am trying to install cudatoolkit-dev 10.1, but it throws the error below. I Cudatoolkit 10.1 was already installed, but I tried to install it anew too.

Downloading and Extracting Packages
cudatoolkit-dev-10.1 | 9 KB      | ####################################################################################################################################################### | 100% 
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
ERROR conda.core.link:_execute(698): An error occurred while installing package 'conda-forge::cudatoolkit-dev-10.1.243-h516909a_1'.
Rolling back transaction: done

LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-10.1.243-h516909a_1
location of failed script: /home/fuerste/miniconda3/envs/openmmlab_101/bin/.cudatoolkit-dev-post-link.sh
==> script messages <==
<None>
==> script output <==
stdout: Running Post installation
re-using previously downloaded /home/fuerste/miniconda3/envs/openmmlab_101/pkgs/cudatoolkit-dev/cuda_10.1.243_418.87.00_rhel6.run

stderr: Traceback (most recent call last):
  File "/home/fuerste/miniconda3/envs/openmmlab_101/bin/cudatoolkit-dev-post-install.py", line 301, in <module>
    _main()
  File "/home/fuerste/miniconda3/envs/openmmlab_101/bin/cudatoolkit-dev-post-install.py", line 294, in _main
    extractor.download_blobs()
  File "/home/fuerste/miniconda3/envs/openmmlab_101/bin/cudatoolkit-dev-post-install.py", line 114, in download_blobs
    self.download(dl_url, dl_path)
  File "/home/fuerste/miniconda3/envs/openmmlab_101/bin/cudatoolkit-dev-post-install.py", line 101, in download
    raise exc
  File "/home/fuerste/miniconda3/envs/openmmlab_101/bin/cudatoolkit-dev-post-install.py", line 99, in download
    subprocess.check_call(cmd)
  File "/home/fuerste/miniconda3/envs/openmmlab_101/lib/python3.7/subprocess.py", line 363, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['wget', 'https://developer.download.nvidia.com/compute/cuda/10.1/Prod/local_installers/cuda_10.1.243_418.87.00_rhel6.run', '-O', '/home/fuerste/miniconda3/envs/openmmlab_101/pkgs/cudatoolkit-dev/cuda_10.1.243_418.87.00_rhel6.run', '-q']' returned non-zero exit status 3.

return code: 1

()

Commands/builds I tried:
conda install cudatoolkit-dev=10.1 -c conda-forge
conda install cudatoolkit=10.1 cudatoolkit-dev=10.1 -c conda-forge
conda install cudatoolkit=10.1 cudatoolkit-dev=10.1.243=h516909a_3 -c conda-forge
conda install cudatoolkit=10.1 cudatoolkit-dev=10.1.243=h516909a_1 -c conda-forge
conda install cudatoolkit=10.1 cudatoolkit-dev=10.1.243=h14c3975_0 -c conda-forge
The last one throws a different error, see below, the first 4 throw the subprocesserror above.

cudatoolkit-dev-10.1 | 9 KB      | ####################################################################################################################################################### | 100% 
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
ERROR conda.core.link:_execute(698): An error occurred while installing package 'conda-forge::cudatoolkit-dev-10.1.243-h14c3975_0'.
Rolling back transaction: done

LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-10.1.243-h14c3975_0
location of failed script: /home/fuerste/miniconda3/envs/openmmlab_101/bin/.cudatoolkit-dev-post-link.sh
==> script messages <==
<None>
==> script output <==
stdout: 
stderr: 
return code: 1

()

Could you help me fix this?
Edit: Installing in a fresh environment yields the same error.
Edit: Deleted the file at wgets location and reran conda install, fixed it.

cudatoolkit-dev installation pops up a terminal window

Issue: When running conda install cudatoolkit-dev -c conda-forge, a new terminal window is opened with a title 'NVIDIA CUDA PACKAGE' and one needs to wait for "Press Return to close this window..." message, otherwise the installation will fail.

Expected behavior: conda install ... would not use any graphical tools.

When resetting (DISPLAY=), no window will pop up and the installation seems to be successful (there are no errors or warnings from conda).

Version update removed improved readme

The update to version 11.1.1 #31 accidentally removed the text added in #37

Cudatoolkit-dev Installation Problem

CUDA header files not included in cudatoolkit-dev?

After installing cudatoolkit-dev, I cannot locate the cuda header files from the conda environment.

According to https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#download-nvidia-driver-and-cuda-software , the cudatoolkit should include the header files as well.

Consider replacing `wget` with a resumable download manager

• I read the conda-forge documentation and could not find the solution for my problem there.

Issue:

I recently tried to install this package on a jumpy connection and it was quite difficult to get the big .run file downloaded correctly due to its size. Every time it was failing, the download had to be started from the beginning. I had to download it manually to the right folder and fix caching (#51).

There are other download managers like aria2¹² that allow resuming, it could be worth checking them out to mitigate such problems. Switching to aria2 should be straightforward, just add a new run dependency here:

cudatoolkit-dev-feedstock/recipe/meta.yaml

Lines 27 to 30 in ab69e3f

	run:
	- python
	- curl # [win]
	- 7zip # [win]

and replace wget with aria2c here:

cudatoolkit-dev-feedstock/recipe/cudatoolkit-dev-post-install.py

Lines 72 to 77 in ab69e3f

	def download(self, url, target_full_path):
	cmd = ["wget", url, "-O", target_full_path, "-q"]
	try:
	subprocess.check_call(cmd)
	except subprocess.CalledProcessError as exc:
	raise exc

Footnotes

1. https://aria2.github.io/ ↩

2. https://github.com/conda-forge/aria2-feedstock ↩

CUDA toolkit 11.6

Could you please add CUDA toolkit 11.6? Thanks!

Should this package run with the same associated cudatoolkit version

Issue:
Upon activiating my environment, I get the following warning:

$ conda activate tf_gpu
Version of installed CUDA didn't match package

Should this package depend, or run_constraint on the same version of cudatoolkit?

Environment (conda list):

$ mamba list | grep cuda
cudatoolkit               11.3.1               ha36c431_9    conda-forge
cudatoolkit-dev           11.4.0           py39h3811e60_2    conda-forge

$ mamba list
# packages in environment at /home/mark/miniforge3/envs/tf_gpu:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       1_gnu    conda-forge
_sysroot_linux-64_curr_repodata_hack 3                   h5bd9786_13    conda-forge
abseil-cpp                20210324.2           h9c3ff4c_0    conda-forge
absl-py                   0.15.0             pyhd8ed1ab_0    conda-forge
aiohttp                   3.7.4.post0      py39h3811e60_1    conda-forge
alabaster                 0.7.12                     py_0    conda-forge
alsa-lib                  1.2.3                h516909a_0    conda-forge
aom                       3.2.0                h9c3ff4c_2    conda-forge
appdirs                   1.4.4              pyh9f0ad1d_0    conda-forge
astunparse                1.6.3              pyhd8ed1ab_0    conda-forge
async-timeout             3.0.1                   py_1000    conda-forge
attr                      2.4.48               h516909a_0    conda-forge
attrs                     21.2.0             pyhd8ed1ab_0    conda-forge
babel                     2.9.1              pyh44b312d_0    conda-forge
backcall                  0.2.0              pyh9f0ad1d_0    conda-forge
backports                 1.0                        py_2    conda-forge
backports.functools_lru_cache 1.6.4              pyhd8ed1ab_0    conda-forge
beautifulsoup4            4.10.0             pyha770c72_0    conda-forge
binutils                  2.36.1               hdd6e379_2    conda-forge
binutils_impl_linux-64    2.36.1               h193b22a_2    conda-forge
binutils_linux-64         2.36                 hf3e587d_1    conda-forge
blinker                   1.4                        py_1    conda-forge
blosc                     1.21.0               he05e8a1_1    ramonaoptics
bokeh                     2.3.3            py39hf3d152e_0    conda-forge
boost                     1.74.0           py39h5472131_4    conda-forge
boost-cpp                 1.74.0               h312852a_4    conda-forge
breathe                   4.31.0             pyhd8ed1ab_0    conda-forge
brotli                    1.0.9                h7f98852_6    conda-forge
brotli-bin                1.0.9                h7f98852_6    conda-forge
brotlipy                  0.7.0           py39h3811e60_1003    conda-forge
brunsli                   0.1                  h9c3ff4c_0    conda-forge
bzip2                     1.0.8                h7f98852_4    conda-forge
c-ares                    1.18.1               h7f98852_0    conda-forge
c-blosc2                  2.0.4                h5f21a17_1    conda-forge
c-compiler                1.3.0                h7f98852_0    conda-forge
ca-certificates           2021.10.8            ha878542_0    conda-forge
cached-property           1.5.2                hd8ed1ab_1    conda-forge
cached_property           1.5.2              pyha770c72_1    conda-forge
cachetools                4.2.4              pyhd8ed1ab_0    conda-forge
cairo                     1.16.0            h6cf1ce9_1008    conda-forge
certifi                   2021.10.8        py39hf3d152e_1    conda-forge
cffi                      1.14.6           py39he32792d_0    conda-forge
cfitsio                   4.0.0                h9a35b8e_0    conda-forge
cftime                    1.5.1.1          py39hce5d2b2_1    conda-forge
chardet                   4.0.0            py39hf3d152e_2    conda-forge
charls                    2.2.0                h9c3ff4c_0    conda-forge
charset-normalizer        2.0.0              pyhd8ed1ab_0    conda-forge
click                     8.0.3            py39hf3d152e_1    conda-forge
click-default-group       1.2.2              pyhd8ed1ab_1    conda-forge
cloudpickle               2.0.0              pyhd8ed1ab_0    conda-forge
coincbc                   2.10.5               hcee13e7_1    conda-forge
colorama                  0.4.4              pyh9f0ad1d_0    conda-forge
commonmark                0.9.1                      py_0    conda-forge
compilers                 1.3.0                ha770c72_0    conda-forge
cryptography              35.0.0           py39h95dcef6_2    conda-forge
cudatoolkit               11.3.1               ha36c431_9    conda-forge
cudatoolkit-dev           11.4.0           py39h3811e60_2    conda-forge
cudnn                     8.2.1.32             h86fa8c9_0    conda-forge
curl                      7.80.0               h2574ce0_0    conda-forge
cxx-compiler              1.3.0                h4bd325d_0    conda-forge
cycler                    0.11.0             pyhd8ed1ab_0    conda-forge
cython                    0.29.24          py39he80948d_1    conda-forge
cytoolz                   0.11.2           py39h3811e60_1    conda-forge
dask                      2021.11.1          pyhd8ed1ab_0    conda-forge
dask-core                 2021.11.1          pyhd8ed1ab_0    conda-forge
dataclasses               0.8                pyhc8e2a94_3    conda-forge
dbus                      1.13.6               h48d8840_2    conda-forge
decorator                 4.4.2                      py_0    conda-forge
deeplabcut                2.2.0.2                   dev_0    <develop>
desktop-app               0.2.8           py39he80948d_100    ramonaoptics
distlib                   0.3.3              pyhd8ed1ab_0    conda-forge
distributed               2021.11.1        py39hf3d152e_0    conda-forge
docutils                  0.17.1           py39hf3d152e_0    conda-forge
doxygen                   1.9.1                hb166930_1    conda-forge
enblend                   4.3             pl5321h512ac75_6    conda-forge
execnet                   1.9.0              pyhd8ed1ab_0    conda-forge
exiftool                  12.30           pl5321ha770c72_1    conda-forge
exiv2                     0.27.1               had08079_0    conda-forge
expat                     2.4.1                h9c3ff4c_0    conda-forge
ffmpeg                    4.4.1                h6987444_0    conda-forge
fftw                      3.3.10          nompi_h74d3f13_101    conda-forge
filelock                  3.3.2              pyhd8ed1ab_0    conda-forge
filterpy                  1.4.5                      py_1    conda-forge
flake8                    4.0.1              pyhd8ed1ab_1    conda-forge
font-ttf-dejavu-sans-mono 2.37                 hab24e00_0    conda-forge
font-ttf-inconsolata      3.000                h77eed37_0    conda-forge
font-ttf-source-code-pro  2.038                h77eed37_0    conda-forge
font-ttf-ubuntu           0.83                 hab24e00_0    conda-forge
fontconfig                2.13.1            hba837de_1005    conda-forge
fonts-conda-ecosystem     1                             0    conda-forge
fonts-conda-forge         1                             0    conda-forge
fortran-compiler          1.3.0                h1990efc_0    conda-forge
freetype                  2.10.4               h0708190_1    conda-forge
freetype-py               2.2.0              pyh9f0ad1d_0    conda-forge
fribidi                   1.0.10               h36c2ea0_0    conda-forge
fsspec                    2021.11.0          pyhd8ed1ab_0    conda-forge
ftd2xx                    1.1.2            py39hf3d152e_2    conda-forge
future                    0.18.2           py39hf3d152e_4    conda-forge
gast                      0.4.0              pyh9f0ad1d_0    conda-forge
gcc                       9.4.0                h192d537_1    conda-forge
gcc_impl_linux-64         9.4.0               h03d3576_11    conda-forge
gcc_linux-64              9.4.0                h391b98a_1    conda-forge
gdown                     4.2.0              pyhd8ed1ab_0    conda-forge
geos                      3.10.0               h9c3ff4c_0    conda-forge
gettext                   0.19.8.1          h0b5b191_1005    conda-forge
gfortran                  9.4.0                h2018a41_1    conda-forge
gfortran_impl_linux-64    9.4.0               h0003116_11    conda-forge
gfortran_linux-64         9.4.0                hf0ab688_1    conda-forge
giflib                    5.2.1                h36c2ea0_2    conda-forge
glew                      2.1.0                h9c3ff4c_2    conda-forge
glib                      2.68.4               h9c3ff4c_0    conda-forge
glib-tools                2.68.4               h9c3ff4c_0    conda-forge
glpk                      4.65              h9202a9a_1004    conda-forge
gmp                       6.2.1                h58526e2_0    conda-forge
gnutls                    3.6.13               h85f3911_1    conda-forge
google-auth               2.3.3              pyh6c4a22f_0    conda-forge
google-auth-oauthlib      0.4.6              pyhd8ed1ab_0    conda-forge
google-pasta              0.2.0              pyh8c360ce_0    conda-forge
graphite2                 1.3.13            h58526e2_1001    conda-forge
grpc-cpp                  1.39.1               h850795e_1    conda-forge
grpcio                    1.39.0           py39hff7568b_0    conda-forge
gsl                       2.7                  he838d99_0    conda-forge
gst-plugins-base          1.18.5               hf529b03_0    conda-forge
gstreamer                 1.18.5               h76c114f_0    conda-forge
gxx                       9.4.0                h192d537_1    conda-forge
gxx_impl_linux-64         9.4.0               h03d3576_11    conda-forge
gxx_linux-64              9.4.0                h0316aca_1    conda-forge
h5py                      3.1.0           nompi_py39h25020de_100    conda-forge
harfbuzz                  2.9.1                h83ec7ef_1    conda-forge
hdf4                      4.2.15               h10796ff_3    conda-forge
hdf5                      1.10.6          nompi_h6a2412b_1114    conda-forge
heapdict                  1.0.1                      py_0    conda-forge
hsluv                     5.0.2              pyh44b312d_0    conda-forge
hugin-base                2020.0.0        py39pl5321h63a8b30_3    conda-forge
icu                       68.2                 h9c3ff4c_0    conda-forge
idna                      3.1                pyhd3deb0d_0    conda-forge
ilmbase                   2.5.5                h780b84a_0    conda-forge
imagecodecs               2021.8.26        py39h571908b_2    conda-forge
imageio                   2.9.0                      py_0    conda-forge
imageio-ffmpeg            0.4.5              pyhd8ed1ab_0    conda-forge
imagesize                 1.3.0              pyhd8ed1ab_0    conda-forge
imgaug                    0.4.0                      py_1    conda-forge
importlib-metadata        4.2.0            py39hf3d152e_0    conda-forge
importlib_metadata        4.2.0                hd8ed1ab_0    conda-forge
incremental               21.3.0             pyhd8ed1ab_0    conda-forge
iniconfig                 1.1.1              pyh9f0ad1d_0    conda-forge
ipython                   7.29.0           py39hef51801_1    conda-forge
jasper                    1.900.1           h07fcdf6_1006    conda-forge
jbig                      2.1               h7f98852_2003    conda-forge
jedi                      0.18.0           py39hf3d152e_3    conda-forge
jinja2                    3.0.3              pyhd8ed1ab_0    conda-forge
joblib                    1.1.0              pyhd8ed1ab_0    conda-forge
jpeg                      9d                   h36c2ea0_0    conda-forge
json_tricks               3.15.5             pyhd8ed1ab_0    conda-forge
jxrlib                    1.1                  h7f98852_2    conda-forge
keras                     2.6.0              pyhd8ed1ab_0    conda-forge
keras-preprocessing       1.1.2              pyhd8ed1ab_0    conda-forge
kernel-headers_linux-64   3.10.0              h4a8ded7_13    conda-forge
kiwisolver                1.3.2            py39h1a9c180_1    conda-forge
krb5                      1.19.2               hcc1bbae_3    conda-forge
lame                      3.100             h7f98852_1001    conda-forge
lcms2                     2.12                 hddcbb42_0    conda-forge
ld_impl_linux-64          2.36.1               hea4e1c9_2    conda-forge
lemon                     1.3.1                he9d42e9_3    conda-forge
lerc                      3.0                  h9c3ff4c_0    conda-forge
libaec                    1.0.6                h9c3ff4c_0    conda-forge
libaio                    0.3.112              h7f98852_1    conda-forge
libblas                   3.9.0           12_linux64_openblas    conda-forge
libbrotlicommon           1.0.9                h7f98852_6    conda-forge
libbrotlidec              1.0.9                h7f98852_6    conda-forge
libbrotlienc              1.0.9                h7f98852_6    conda-forge
libcap                    2.51                 h7f98852_0    conda-forge
libcblas                  3.9.0           12_linux64_openblas    conda-forge
libclang                  11.1.0          default_ha53f305_1    conda-forge
libcurl                   7.80.0               h2574ce0_0    conda-forge
libdeflate                1.8                  h7f98852_0    conda-forge
libdrm                    2.4.108              h7f98852_0    conda-forge
libedit                   3.1.20191231         he28a2e2_2    conda-forge
libev                     4.33                 h516909a_1    conda-forge
libevent                  2.1.10               h9b69904_4    conda-forge
libffi                    3.3                  h58526e2_2    conda-forge
libgcc-devel_linux-64     9.4.0               hd854feb_11    conda-forge
libgcc-ng                 11.2.0              h1d223b6_11    conda-forge
libgfortran-ng            11.2.0              h69a702a_11    conda-forge
libgfortran5              11.2.0              h5c6108e_11    conda-forge
libglib                   2.68.4               h3e27bee_0    conda-forge
libglu                    9.0.0             he1b5a44_1001    conda-forge
libgomp                   11.2.0              h1d223b6_11    conda-forge
libhugetlbfs              2.23                 h9bf148f_0    ramonaoptics
libiconv                  1.16                 h516909a_0    conda-forge
liblapack                 3.9.0           12_linux64_openblas    conda-forge
liblapacke                3.9.0           12_linux64_openblas    conda-forge
libllvm11                 11.1.0               hf817b99_2    conda-forge
libnetcdf                 4.8.1           nompi_hcd642e3_100    conda-forge
libnghttp2                1.43.0               h812cca2_1    conda-forge
libnl                     3.5.0                h7f98852_0    conda-forge
libogg                    1.3.4                h7f98852_1    conda-forge
libopenblas               0.3.18          pthreads_h8fe5266_0    conda-forge
libopencv                 4.5.3            py39h70bf20d_1    conda-forge
libopus                   1.3.1                h7f98852_1    conda-forge
libpano13                 2.9.20rc2       pl5321h8a4c61d_2    conda-forge
libpciaccess              0.16                 h516909a_0    conda-forge
libpng                    1.6.37               h21135ba_2    conda-forge
libpq                     13.3               h7e1c00e_100    ramonaoptics
libprotobuf               3.16.0               h780b84a_0    conda-forge
libqdma                   2020.2.1             h7f98852_4    ramonaoptics
libqdmactl                0.1.0                h9bf148f_0    ramonaoptics
libsanitizer              9.4.0               h79bfe98_11    conda-forge
libsodium                 1.0.18               h36c2ea0_1    conda-forge
libssh2                   1.10.0               ha56f1ee_2    conda-forge
libstdcxx-devel_linux-64  9.4.0               hd854feb_11    conda-forge
libstdcxx-ng              11.2.0              he4da1e4_11    conda-forge
libtiff                   4.3.0                h6f004c6_2    conda-forge
libusb-compat             0.1.12               hf484d3e_0    ramonaoptics
libuuid                   2.32.1            h7f98852_1000    conda-forge
libva                     2.13.0               h7f98852_0    conda-forge
libvorbis                 1.3.7                h9c3ff4c_0    conda-forge
libvpx                    1.11.0               h9c3ff4c_3    conda-forge
libwebp-base              1.2.1                h7f98852_0    conda-forge
libxcb                    1.13              h7f98852_1004    conda-forge
libxkbcommon              1.0.3                he3ba5ed_0    conda-forge
libxml2                   2.9.12               h72842e0_0    conda-forge
libxslt                   1.1.33               h15afd5d_2    conda-forge
libzip                    1.8.0                h4de3113_1    conda-forge
libzlib                   1.2.11            h36c2ea0_1013    conda-forge
libzopfli                 1.0.3                h9c3ff4c_0    conda-forge
llvmlite                  0.37.0           py39h1bbdace_0    conda-forge
locket                    0.2.0                      py_2    conda-forge
lz4-c                     1.9.3                h9c3ff4c_1    conda-forge
lzo                       2.10              h516909a_1000    conda-forge
markdown                  3.3.4              pyhd8ed1ab_0    conda-forge
markupsafe                2.0.1            py39h3811e60_1    conda-forge
matplotlib                3.4.3            py39hf3d152e_1    conda-forge
matplotlib-base           3.4.3            py39h2fa2bec_1    conda-forge
matplotlib-inline         0.1.3              pyhd8ed1ab_0    conda-forge
mcam_sdk                  0.10.3               h3fd9d12_1    ramonaoptics
mccabe                    0.6.1                      py_1    conda-forge
mesalib                   18.3.1               h590aaf7_0    conda-forge
mock                      4.0.3            py39hf3d152e_2    conda-forge
more-itertools            8.11.0             pyhd8ed1ab_0    conda-forge
moviepy                   1.0.1                      py_0    conda-forge
msgpack-numpy             0.4.7.1            pyh9f0ad1d_0    conda-forge
msgpack-python            1.0.2            py39h1a9c180_2    conda-forge
multidict                 5.2.0            py39h3811e60_1    conda-forge
multiuserfilelock         0.0.3                      py_0    ramonaoptics
mysql-common              8.0.27               ha770c72_1    conda-forge
mysql-libs                8.0.27               hfa10184_1    conda-forge
nccl                      2.11.4.1             hdc17891_0    conda-forge
ncurses                   6.2                  h58526e2_4    conda-forge
netcdf4                   1.5.7           nompi_py39hd2e3950_101    conda-forge
nettle                    3.6                  he412f7d_0    conda-forge
networkx                  2.6.3              pyhd8ed1ab_1    conda-forge
nspr                      4.32                 h9c3ff4c_1    conda-forge
nss                       3.71                 hb5efdd6_0    conda-forge
numba                     0.54.1           py39h56b8d98_0    conda-forge
numexpr                   2.7.3            py39hde0f152_1    conda-forge
numpy                     1.19.5           py39hdbf815f_2    conda-forge
nvcc_linux-64             11.2                h309498c_15    conda-forge
oauthlib                  3.1.1              pyhd8ed1ab_0    conda-forge
ocl-icd                   2.3.1                h7f98852_0    conda-forge
ocl-icd-system            1.0.0                         1    conda-forge
olefile                   0.46               pyh9f0ad1d_1    conda-forge
opencv                    4.5.3            py39hf3d152e_1    conda-forge
openexr                   2.5.5                hf817b99_0    conda-forge
openh264                  2.1.1                h780b84a_0    conda-forge
openjpeg                  2.4.0                hb52868f_1    conda-forge
openssl                   1.1.1l               h7f98852_0    conda-forge
opt_einsum                3.3.0              pyhd8ed1ab_1    conda-forge
owl                       0.16.28+58.g2d9ba5a4.dirty           dev_0    <develop>
packaging                 21.0               pyhd8ed1ab_0    conda-forge
pandas                    1.3.4            py39hde0f152_1    conda-forge
pango                     1.48.10              hb8ff022_1    conda-forge
parso                     0.8.2              pyhd8ed1ab_0    conda-forge
partd                     1.2.0              pyhd8ed1ab_0    conda-forge
patsy                     0.5.2              pyhd8ed1ab_0    conda-forge
pcre                      8.45                 h9c3ff4c_0    conda-forge
perl                      5.32.1          1_h7f98852_perl5    conda-forge
pexpect                   4.8.0              pyh9f0ad1d_2    conda-forge
pickleshare               0.7.5           py39hde42818_1002    conda-forge
pillow                    8.4.0            py39ha612740_0    conda-forge
pip                       21.3.1             pyhd8ed1ab_0    conda-forge
pixman                    0.40.0               h36c2ea0_0    conda-forge
pluggy                    1.0.0            py39hf3d152e_2    conda-forge
pooch                     1.5.2              pyhd8ed1ab_0    conda-forge
proglog                   0.1.9                      py_0    conda-forge
prompt-toolkit            3.0.22             pyha770c72_0    conda-forge
protobuf                  3.16.0           py39he80948d_0    conda-forge
psutil                    5.8.0            py39h3811e60_2    conda-forge
pthread-stubs             0.4               h36c2ea0_1001    conda-forge
ptyprocess                0.7.0              pyhd3deb0d_0    conda-forge
py                        1.11.0             pyh6c4a22f_0    conda-forge
py-opencv                 4.5.3            py39hef51801_1    conda-forge
pyasn1                    0.4.8                      py_0    conda-forge
pyasn1-modules            0.2.7                      py_0    conda-forge
pycodestyle               2.8.0              pyhd8ed1ab_0    conda-forge
pycparser                 2.21               pyhd8ed1ab_0    conda-forge
pyflakes                  2.4.0              pyhd8ed1ab_0    conda-forge
pygments                  2.10.0             pyhd8ed1ab_0    conda-forge
pyilluminate              0.6.11             pyhd8ed1ab_0    ramonaoptics
pyjwt                     2.3.0              pyhd8ed1ab_0    conda-forge
pyopenssl                 21.0.0             pyhd8ed1ab_0    conda-forge
pyparsing                 3.0.5              pyhd8ed1ab_0    conda-forge
pyqt                      5.12.3           py39hf3d152e_8    conda-forge
pyqt-impl                 5.12.3           py39hde8b62d_8    conda-forge
pyqt5-sip                 4.19.18          py39he80948d_8    conda-forge
pyqtchart                 5.12             py39h0fcd23e_8    conda-forge
pyqtgraph                 0.12.3             pyhd8ed1ab_0    conda-forge
pyqtwebengine             5.12.1           py39h0fcd23e_8    conda-forge
pyserial                  3.5                pyhd8ed1ab_0    conda-forge
pyside2                   5.13.2           py39h363ec45_4    conda-forge
pysocks                   1.7.1            py39hf3d152e_4    conda-forge
pytables                  3.6.1            py39hf6dc253_3    conda-forge
pytest                    6.2.5            py39hf3d152e_1    conda-forge
pytest-env                0.6.2                      py_0    conda-forge
pytest-forked             1.3.0              pyhd3deb0d_0    conda-forge
pytest-qt                 4.0.2              pyhd8ed1ab_0    conda-forge
pytest-timeout            2.0.1              pyhd8ed1ab_0    conda-forge
pytest-xdist              2.4.0              pyhd8ed1ab_0    conda-forge
python                    3.9.6              h7c244ba_103    ramonaoptics
python-dateutil           2.8.2              pyhd8ed1ab_0    conda-forge
python-flatbuffers        1.12               pyhd8ed1ab_1    conda-forge
python-prctl              1.8.1            py39h9bf148f_0    ramonaoptics
python-xxhash             2.0.2            py39h3811e60_1    conda-forge
python_abi                3.9                      2_cp39    conda-forge
pytz                      2021.3             pyhd8ed1ab_0    conda-forge
pyu2f                     0.1.5              pyhd8ed1ab_0    conda-forge
pywavelets                1.2.0            py39hce5d2b2_0    conda-forge
pyyaml                    6.0              py39h3811e60_3    conda-forge
pyzmq                     22.3.0           py39h37b5a0c_1    conda-forge
qdarkstyle                3.0.2              pyhd8ed1ab_0    conda-forge
qdma                      0.8.30           py39h9bf148f_0    ramonaoptics
qt                        5.12.9               hda022c4_4    conda-forge
qtpy                      1.11.2             pyhd8ed1ab_0    conda-forge
qtpy-uic                  2.0.5              pyhd8ed1ab_0    conda-forge
rclone                    1.57.0               h519d9b9_0    conda-forge
re2                       2021.09.01           h9c3ff4c_0    conda-forge
recommonmark              0.7.1              pyhd8ed1ab_0    conda-forge
requests                  2.26.0             pyhd8ed1ab_0    conda-forge
requests-oauthlib         1.3.0              pyh9f0ad1d_0    conda-forge
rsa                       4.7.2              pyh44b312d_0    conda-forge
ruamel.yaml               0.17.17          py39h3811e60_0    conda-forge
ruamel.yaml.clib          0.2.2            py39h3811e60_2    conda-forge
rx                        3.2.0              pyhd8ed1ab_0    conda-forge
scikit-image              0.18.3           py39hde0f152_0    conda-forge
scikit-learn              1.0.1            py39h7c5d8c9_1    conda-forge
scipy                     1.7.2            py39hee8e79c_0    conda-forge
sed                       4.8                  he412f7d_0    conda-forge
setuptools                58.5.3           py39hf3d152e_0    conda-forge
setuptools-scm            6.3.2              pyhd8ed1ab_0    conda-forge
shapely                   1.8.0            py39hc7dd4e9_2    conda-forge
six                       1.15.0             pyh9f0ad1d_0    conda-forge
snappy                    1.1.8                he1b5a44_3    conda-forge
snowballstemmer           2.1.0              pyhd8ed1ab_0    conda-forge
sortedcontainers          2.4.0              pyhd8ed1ab_0    conda-forge
soupsieve                 2.3                pyhd8ed1ab_0    conda-forge
sphinx                    4.3.0              pyh6c4a22f_0    conda-forge
sphinx-copybutton         0.4.0              pyhd8ed1ab_0    conda-forge
sphinx_rtd_theme          1.0.0              pyhd8ed1ab_0    conda-forge
sphinxcontrib-applehelp   1.0.2                      py_0    conda-forge
sphinxcontrib-devhelp     1.0.2                      py_0    conda-forge
sphinxcontrib-htmlhelp    2.0.0              pyhd8ed1ab_0    conda-forge
sphinxcontrib-jsmath      1.0.1                      py_0    conda-forge
sphinxcontrib-programoutput 0.16               pyh9f0ad1d_0    conda-forge
sphinxcontrib-qthelp      1.0.3                      py_0    conda-forge
sphinxcontrib-serializinghtml 1.1.5              pyhd8ed1ab_0    conda-forge
sqlite                    3.36.0             h495f6a3_100    ramonaoptics
statsmodels               0.13.0           py39hce5d2b2_1    conda-forge
svt-av1                   0.8.7                h9c3ff4c_1    conda-forge
swig                      4.0.2                hd3c618e_2    conda-forge
sysroot_linux-64          2.17                h4a8ded7_13    conda-forge
tabulate                  0.8.9              pyhd8ed1ab_0    conda-forge
tblib                     1.7.0              pyhd8ed1ab_0    conda-forge
teensy_loader_cli         2.1.3                h7f98852_0    conda-forge
teensytoany               0.0.26             pyhd8ed1ab_0    conda-forge
tensorboard               2.7.0              pyhd8ed1ab_0    conda-forge
tensorboard-data-server   0.6.0            py39h95dcef6_1    conda-forge
tensorboard-plugin-wit    1.8.0              pyh44b312d_0    conda-forge
tensorflow                2.6.0           cuda112h9dc3950_1    ramonaoptics
tensorflow-base           2.6.0           cuda112py39h0b4cdfd_1    ramonaoptics
tensorflow-estimator      2.6.0           cuda112py39heacc632_1    ramonaoptics
tensorpack                0.11                       py_0    ramonaoptics
termcolor                 1.1.0                      py_2    conda-forge
tf_slim                   1.1.0              pyhd3deb0d_1    conda-forge
threadpoolctl             3.0.0              pyh8a188c0_0    conda-forge
tifffile                  2021.11.2          pyhd8ed1ab_0    conda-forge
tk                        8.6.11               h27826a3_1    conda-forge
toml                      0.10.2             pyhd8ed1ab_0    conda-forge
tomli                     1.2.2              pyhd8ed1ab_0    conda-forge
toolz                     0.11.2             pyhd8ed1ab_0    conda-forge
tornado                   6.1              py39h3811e60_2    conda-forge
towncrier                 21.3.0             pyhd8ed1ab_0    conda-forge
tqdm                      4.62.3             pyhd8ed1ab_0    conda-forge
traitlets                 5.1.1              pyhd8ed1ab_0    conda-forge
typing-extensions         3.7.4.3                       0    conda-forge
typing_extensions         3.7.4.3                    py_0    conda-forge
tzdata                    2021e                he74cb21_0    conda-forge
urllib3                   1.26.7             pyhd8ed1ab_0    conda-forge
vigra                     1.11.1          py39h86144be_1023    conda-forge
vispy                     0.9.3            py39h7c34278_1    conda-forge
wabisabi                  0.2.8                      py_0    conda-forge
wcwidth                   0.2.5              pyh9f0ad1d_2    conda-forge
werkzeug                  2.0.1              pyhd8ed1ab_0    conda-forge
wheel                     0.37.0             pyhd8ed1ab_1    conda-forge
wrapt                     1.12.1           py39h3811e60_3    conda-forge
x264                      1!161.3030           h7f98852_1    conda-forge
x265                      3.5                  h4bd325d_1    conda-forge
xarray                    0.20.1             pyhd8ed1ab_0    conda-forge
xorg-kbproto              1.0.7             h7f98852_1002    conda-forge
xorg-libice               1.0.10               h7f98852_0    conda-forge
xorg-libsm                1.2.3             hd9c2040_1000    conda-forge
xorg-libx11               1.7.2                h7f98852_0    conda-forge
xorg-libxau               1.0.9                h7f98852_0    conda-forge
xorg-libxdmcp             1.1.3                h7f98852_0    conda-forge
xorg-libxext              1.3.4                h7f98852_1    conda-forge
xorg-libxrender           0.9.10            h7f98852_1003    conda-forge
xorg-renderproto          0.11.1            h7f98852_1002    conda-forge
xorg-xextproto            7.3.0             h7f98852_1002    conda-forge
xorg-xproto               7.0.31            h7f98852_1007    conda-forge
xxhash                    0.8.0                h7f98852_3    conda-forge
xz                        5.2.5                h516909a_1    conda-forge
yaml                      0.2.5                h516909a_0    conda-forge
yarl                      1.7.2            py39h3811e60_1    conda-forge
zaber-motion              2.6.1            py39h73cf614_0    conda-forge
zeromq                    4.3.4                h9c3ff4c_1    conda-forge
zfp                       0.5.5                h9c3ff4c_7    conda-forge
zict                      2.0.0                      py_0    conda-forge
zipp                      3.6.0              pyhd8ed1ab_0    conda-forge
zlib                      1.2.11            h36c2ea0_1013    conda-forge
zstd                      1.5.0                ha95c52a_0    conda-forge

Details about conda and system ( conda info ):

$ conda info

     active environment : tf_gpu
    active env location : /home/mark/miniforge3/envs/tf_gpu
            shell level : 2
       user config file : /home/mark/.condarc
 populated config files : /home/mark/miniforge3/.condarc
                          /home/mark/.condarc
          conda version : 4.10.3
    conda-build version : 3.21.6
         python version : 3.9.4.final.0
       virtual packages : __cuda=11.4=0
                          __linux=5.11.0=0
                          __glibc=2.31=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : /home/mark/miniforge3  (writable)
      conda av data dir : /home/mark/miniforge3/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/t/<TOKEN>/ramonaoptics/linux-64
                          https://conda.anaconda.org/t/<TOKEN>/ramonaoptics/noarch
                          https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
          package cache : /home/mark/miniforge3/pkgs
                          /home/mark/.conda/pkgs
       envs directories : /home/mark/miniforge3/envs
                          /home/mark/.conda/envs
               platform : linux-64
             user-agent : conda/4.10.3 requests/2.26.0 CPython/3.9.4 Linux/5.11.0-40-generic ubuntu/20.04.3 glibc/2.31
                UID:GID : 1001:1001
             netrc file : None
           offline mode : False

Segmentation fault

Comment:

lighthouse@VM-12-17-ubuntu:~$ forge -h
Segmentation fault
lighthouse@VM-12-17-ubuntu:~$ source ./.bashrc lighthouse@VM-12-17-ubuntu:~$ forge Segmentation fault lighthouse@VM-12-17-ubuntu:~$ forge install Segmentation fault lighthouse@VM-12-17-ubuntu:~$ forge install Segmentation fault lighthouse@VM-12-17-ubuntu:~$ forge -h Segmentation fault lighthouse@VM-12-17-ubuntu:~$

CUDA 10.2?

Hi,

are you planning on updating this feedstock to provide CUDA 10.2.89?

Thanks a lot for considering,
Axel

LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-10.0-1

Issue: LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-10.0-1

The installation failed with a LinkError in a Python 2.7 environment where only the cudatoolkit is installed beforehand. This is strange because there is no error in another Python 3.6 env. Any ideas?

Environment (conda list):

$ conda list
# packages in environment at /home/ml/farleylai/Backups/miniconda3/envs/sinet27:
#
# Name                    Version                   Build  Channel
ca-certificates           2019.5.15                     0  
certifi                   2019.3.9                 py27_0  
chardet                   3.0.4                    pypi_0    pypi
cudatoolkit               10.0.130                      0  
cython                    0.29.10                  pypi_0    pypi
easydict                  1.9                      pypi_0    pypi
idna                      2.8                      pypi_0    pypi
libedit                   3.1.20181209         hc058e9b_0  
libffi                    3.2.1                hd88cf55_4  
libgcc-ng                 9.1.0                hdf63c60_0  
libstdcxx-ng              9.1.0                hdf63c60_0  
mxnet-cu100mkl            1.4.1                    pypi_0    pypi
ncurses                   6.1                  he6710b0_1  
numpy                     1.14.6                   pypi_0    pypi
opencv-python             4.1.0.25                 pypi_0    pypi
openssl                   1.1.1c               h7b6447c_1  
pip                       19.1.1                   py27_0  
python                    2.7.16               h9bab390_0  
python-graphviz           0.8.4                    pypi_0    pypi
readline                  7.0                  h7b6447c_5  
setuptools                41.0.1                   py27_0  
sqlite                    3.28.0               h7b6447c_0  
tk                        8.6.8                hbc83047_0  
urllib3                   1.25.3                   pypi_0    pypi
wheel                     0.33.4                   py27_0  
zlib                      1.2.11               h7b6447c_3  

Details about conda and system ( conda info ):

$ conda info
     active environment : sinet27
    active env location : /home/ml/farleylai/Backups/miniconda3/envs/sinet27
            shell level : 2
       user config file : /home/ml/farleylai/.condarc
 populated config files : /home/ml/farleylai/.condarc
          conda version : 4.6.14
    conda-build version : not installed
         python version : 3.7.1.final.0
       base environment : /home/ml/farleylai/Backups/miniconda3  (writable)
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/free/linux-64
                          https://repo.anaconda.com/pkgs/free/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
                          https://conda.anaconda.org/pytorch/linux-64
                          https://conda.anaconda.org/pytorch/noarch
                          https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
          package cache : /home/ml/farleylai/Backups/miniconda3/pkgs
                          /home/ml/farleylai/.conda/pkgs
       envs directories : /home/ml/farleylai/Backups/miniconda3/envs
                          /home/ml/farleylai/.conda/envs
               platform : linux-64
             user-agent : conda/4.6.14 requests/2.21.0 CPython/3.7.1 Linux/4.15.0-51-generic ubuntu/16.04.3 glibc/2.23
                UID:GID : 8531:3000
             netrc file : None
           offline mode : False

Details about conda install:

$ conda install cudatoolkit-dev
Collecting package metadata: done
Solving environment: done

## Package Plan ##

  environment location: /home/ml/farleylai/Backups/miniconda3/envs/sinet27

  added / updated specs:
    - cudatoolkit-dev


The following NEW packages will be INSTALLED:

  asn1crypto         pkgs/main/linux-64::asn1crypto-0.24.0-py27_0
  cffi               pkgs/main/linux-64::cffi-1.12.3-py27h2e261b9_0
  chardet            pkgs/main/linux-64::chardet-3.0.4-py27_1
  conda              pkgs/main/linux-64::conda-4.6.14-py27_0
  cryptography       pkgs/main/linux-64::cryptography-2.7-py27h1ba5d50_0
  cudatoolkit-dev    conda-forge/linux-64::cudatoolkit-dev-10.0-1
  enum34             pkgs/main/linux-64::enum34-1.1.6-py27_1
  futures            pkgs/main/linux-64::futures-3.2.0-py27_0
  idna               pkgs/main/linux-64::idna-2.8-py27_0
  ipaddress          pkgs/main/linux-64::ipaddress-1.0.22-py27_0
  pycosat            pkgs/main/linux-64::pycosat-0.6.3-py27h14c3975_0
  pycparser          pkgs/main/linux-64::pycparser-2.19-py27_0
  pyopenssl          pkgs/main/linux-64::pyopenssl-19.0.0-py27_0
  pysocks            pkgs/main/linux-64::pysocks-1.7.0-py27_0
  requests           pkgs/main/linux-64::requests-2.22.0-py27_0
  ruamel_yaml        pkgs/main/linux-64::ruamel_yaml-0.15.46-py27h14c3975_0
  six                pkgs/main/linux-64::six-1.12.0-py27_0
  urllib3            pkgs/main/linux-64::urllib3-1.24.2-py27_0
  yaml               pkgs/main/linux-64::yaml-0.1.7-had09818_2


Proceed ([y]/n)? y

Preparing transaction: done
Verifying transaction: done
Executing transaction: - ERROR conda.core.link:_execute_post_link_actions(658): An error occurred while installing package 'conda-forge::cudatoolkit-dev-10.0-1'.
LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-10.0-1
running your command again with `-v` will provide additional information
location of failed script: /home/ml/farleylai/Backups/miniconda3/envs/sinet27/bin/.cudatoolkit-dev-post-link.sh
==> script messages <==
<None>

Attempting to roll back.

failed
ERROR conda.core.link:_execute(568): An error occurred while installing package 'conda-forge::cudatoolkit-dev-10.0-1'.
LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-10.0-1
running your command again with `-v` will provide additional information
location of failed script: /home/ml/farleylai/Backups/miniconda3/envs/sinet27/bin/.cudatoolkit-dev-post-link.sh
==> script messages <==
<None>

Attempting to roll back.

Rolling back transaction: done

LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-10.0-1
running your command again with `-v` will provide additional information
location of failed script: /home/ml/farleylai/Backups/miniconda3/envs/sinet27/bin/.cudatoolkit-dev-post-link.sh
==> script messages <==
<None>

When will cudatoolkit-dev 11.8 version be released?

Comment:

Many of the latest deep learning packages and Ada architecture GPUs require version 11.8. Hope version 11.8 will be released soon。

Related: #66

Can this package be installed without a CUDA device?

I tried to install cudatoolkit-dev on a machine without GPU / CUDA enabled device (to test if I can compile something, without running), by creating a new clean env on an Ubuntu 18.04 laptop. The installation seems to work initially (no errors), but the toolkit actually doesn't seem to be installed.

Creation of the env:

``` (base) joris@joris-XPS-13-9380:~/scipy$ conda create -n test-cuda cudatoolkit-dev Collecting package metadata: done Solving environment: done

==> WARNING: A newer version of conda exists. <==
current version: 4.6.14
latest version: 4.7.5

Please update conda by running

$ conda update -n base conda

Package Plan

environment location: /home/joris/miniconda3/envs/test-cuda

added / updated specs:
- cudatoolkit-dev

The following packages will be downloaded:

package                    |            build
---------------------------|-----------------
sqlite-3.29.0              |       hcee41ef_0         2.0 MB  conda-forge
------------------------------------------------------------
                                       Total:         2.0 MB

The following NEW packages will be INSTALLED:

_libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main
asn1crypto conda-forge/linux-64::asn1crypto-0.24.0-py37_1003
bzip2 conda-forge/linux-64::bzip2-1.0.6-h14c3975_1002
ca-certificates conda-forge/linux-64::ca-certificates-2019.6.16-hecc5488_0
certifi conda-forge/linux-64::certifi-2019.6.16-py37_0
cffi conda-forge/linux-64::cffi-1.12.3-py37h8022711_0
chardet conda-forge/linux-64::chardet-3.0.4-py37_1003
conda conda-forge/linux-64::conda-4.7.5-py37_0
conda-package-han~ conda-forge/linux-64::conda-package-handling-1.3.11-py37_0
cryptography conda-forge/linux-64::cryptography-2.7-py37h72c5cf5_0
cudatoolkit-dev conda-forge/linux-64::cudatoolkit-dev-10.0-1
icu conda-forge/linux-64::icu-58.2-hf484d3e_1000
idna conda-forge/linux-64::idna-2.8-py37_1000
libarchive conda-forge/linux-64::libarchive-3.3.3-hb44662c_1005
libffi conda-forge/linux-64::libffi-3.2.1-he1b5a44_1006
libgcc-ng pkgs/main/linux-64::libgcc-ng-9.1.0-hdf63c60_0
libiconv conda-forge/linux-64::libiconv-1.15-h516909a_1005
libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-9.1.0-hdf63c60_0
libxml2 conda-forge/linux-64::libxml2-2.9.9-h13577e0_1
lz4-c conda-forge/linux-64::lz4-c-1.8.3-he1b5a44_1001
lzo conda-forge/linux-64::lzo-2.10-h14c3975_1000
ncurses conda-forge/linux-64::ncurses-6.1-hf484d3e_1002
openssl conda-forge/linux-64::openssl-1.1.1c-h516909a_0
pip conda-forge/linux-64::pip-19.1.1-py37_0
pycosat conda-forge/linux-64::pycosat-0.6.3-py37h14c3975_1001
pycparser conda-forge/linux-64::pycparser-2.19-py37_1
pyopenssl conda-forge/linux-64::pyopenssl-19.0.0-py37_0
pysocks conda-forge/linux-64::pysocks-1.7.0-py37_0
python conda-forge/linux-64::python-3.7.3-h33d41f4_1
python-libarchive~ conda-forge/linux-64::python-libarchive-c-2.8-py37_1004
readline conda-forge/linux-64::readline-8.0-hf8c457e_0
requests conda-forge/linux-64::requests-2.22.0-py37_0
ruamel_yaml conda-forge/linux-64::ruamel_yaml-0.15.71-py37h14c3975_1000
setuptools conda-forge/linux-64::setuptools-41.0.1-py37_0
six conda-forge/linux-64::six-1.12.0-py37_1000
sqlite conda-forge/linux-64::sqlite-3.29.0-hcee41ef_0
tk conda-forge/linux-64::tk-8.6.9-hed695b0_1002
tqdm conda-forge/noarch::tqdm-4.32.2-py_0
urllib3 conda-forge/linux-64::urllib3-1.24.3-py37_0
wheel conda-forge/linux-64::wheel-0.33.4-py37_0
xz conda-forge/linux-64::xz-5.2.4-h14c3975_1001
yaml conda-forge/linux-64::yaml-0.1.7-h14c3975_1001
zlib conda-forge/linux-64::zlib-1.2.11-h14c3975_1004
zstd conda-forge/linux-64::zstd-1.4.0-h3b9ef0a_0

Proceed ([y]/n)?

Downloading and Extracting Packages
sqlite-3.29.0 | 2.0 MB | ######################################################################################################################################################################## | 100%
Preparing transaction: done
Verifying transaction: done
Executing transaction: done

To activate this environment, use

$ conda activate test-cuda

To deactivate an active environment, use

$ conda deactivate

```

Activating the env already case some errors:

(base) joris@joris-XPS-13-9380:~/scipy$ act test-cuda
ln: target '/home/joris/miniconda3/envs/test-cuda/bin/zstdmt' is not a directory
ln: target '/home/joris/miniconda3/envs/test-cuda/lib/xml2Conf.sh' is not a directory
ln: target '/home/joris/miniconda3/envs/test-cuda/bin/zstdmt' is not a directory
ln: target '/home/joris/miniconda3/envs/test-cuda/lib/xml2Conf.sh' is not a directory
ln: target '/home/joris/miniconda3/envs/test-cuda/lib/xml2Conf.sh' is not a directory
ln: target '/home/joris/miniconda3/envs/test-cuda/include/zstd.h' is not a directory

After that, the nvcc compiler is not on the path, the pkgs/cudatoolkit-dev dir is empty except for a md5sum.txt file (although the cudatoolkit-dev-activate.sh script tries to link to bins located there).

So at least it seems the installation was not complete?

Environment (conda list):

$ conda list
# packages in environment at /home/joris/miniconda3/envs/test-cuda:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main  
asn1crypto                0.24.0                py37_1003    conda-forge
bzip2                     1.0.6             h14c3975_1002    conda-forge
ca-certificates           2019.6.16            hecc5488_0    conda-forge
certifi                   2019.6.16                py37_0    conda-forge
cffi                      1.12.3           py37h8022711_0    conda-forge
chardet                   3.0.4                 py37_1003    conda-forge
conda                     4.7.5                    py37_0    conda-forge
conda-package-handling    1.3.11                   py37_0    conda-forge
cryptography              2.7              py37h72c5cf5_0    conda-forge
cudatoolkit-dev           10.0                          1    conda-forge
icu                       58.2              hf484d3e_1000    conda-forge
idna                      2.8                   py37_1000    conda-forge
libarchive                3.3.3             hb44662c_1005    conda-forge
libffi                    3.2.1             he1b5a44_1006    conda-forge
libgcc-ng                 9.1.0                hdf63c60_0  
libiconv                  1.15              h516909a_1005    conda-forge
libstdcxx-ng              9.1.0                hdf63c60_0  
libxml2                   2.9.9                h13577e0_1    conda-forge
lz4-c                     1.8.3             he1b5a44_1001    conda-forge
lzo                       2.10              h14c3975_1000    conda-forge
ncurses                   6.1               hf484d3e_1002    conda-forge
openssl                   1.1.1c               h516909a_0    conda-forge
pip                       19.1.1                   py37_0    conda-forge
pycosat                   0.6.3           py37h14c3975_1001    conda-forge
pycparser                 2.19                     py37_1    conda-forge
pyopenssl                 19.0.0                   py37_0    conda-forge
pysocks                   1.7.0                    py37_0    conda-forge
python                    3.7.3                h33d41f4_1    conda-forge
python-libarchive-c       2.8                   py37_1004    conda-forge
readline                  8.0                  hf8c457e_0    conda-forge
requests                  2.22.0                   py37_0    conda-forge
ruamel_yaml               0.15.71         py37h14c3975_1000    conda-forge
setuptools                41.0.1                   py37_0    conda-forge
six                       1.12.0                py37_1000    conda-forge
sqlite                    3.29.0               hcee41ef_0    conda-forge
tk                        8.6.9             hed695b0_1002    conda-forge
tqdm                      4.32.2                     py_0    conda-forge
urllib3                   1.24.3                   py37_0    conda-forge
wheel                     0.33.4                   py37_0    conda-forge
xz                        5.2.4             h14c3975_1001    conda-forge
yaml                      0.1.7             h14c3975_1001    conda-forge
zlib                      1.2.11            h14c3975_1004    conda-forge
zstd                      1.4.0                h3b9ef0a_0    conda-forge

Details about conda and system ( conda info ):

$ conda info

     active environment : test-cuda
    active env location : /home/joris/miniconda3/envs/test-cuda
            shell level : 2
       user config file : /home/joris/.condarc
 populated config files : /home/joris/.condarc
          conda version : 4.6.14
    conda-build version : not installed
         python version : 3.7.3.final.0
       base environment : /home/joris/miniconda3  (writable)
           channel URLs : https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/free/linux-64
                          https://repo.anaconda.com/pkgs/free/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/joris/miniconda3/pkgs
                          /home/joris/.conda/pkgs
       envs directories : /home/joris/miniconda3/envs
                          /home/joris/.conda/envs
               platform : linux-64
             user-agent : conda/4.6.14 requests/2.22.0 CPython/3.7.3 Linux/4.15.0-1043-oem ubuntu/18.04.2 glibc/2.27
                UID:GID : 1001:1001
             netrc file : None
           offline mode : False

CUDA toolkit version 11.5.1

Will version 11.5.1 of this package be available?

Potential conflict usage of `pkgs` folder?

Hi, I noticed that all CUDA binaries were installed in ~/anaconda3/envs/XXX/pkgs folder. In a recent issue in another conda package (conda/conda-pack#112 (comment)), I noticed that if installed the package in the root environment, it might clobber the package cache directories ~/anaconda3/pkgs. Can this be confirmed? Thanks!

Cannot compile custom extensions due to missing header files

Declaration

• I read the conda-forge documentation and could not find the solution for my problem there.

Issue

The post-link recipe suggests that conda install cudatoolkit-dev will symlink all libraries, binaries and header files to $CONDA_PREFIX/lib, $CONDA_PREFIX/bin and $CONDA_PREFIX/include respectively. That's great, because now I can just use these directories instead of individually specifying each and every directory in $CONDA_PREFIX/pkgs/cuda-toolkit.

However, the issue still remains that I have to manually add these paths to the respective environment variables (CUDA_HOME, LD_LIBRARY_PATH, etc) to be able to fully use them. conda install cudatoolkit-dev doesn't do that for me. As an example, if I wish to compile a custom CUDA extension with pytorch, I can't do this out of the box because GCC will complain about missing header files (cublas_v2.h, etc). I either have to manually specify -I$(CONDA_PREFIX)/include while using GCC, or set the environment variable CPATH (export CPATH=$CONDA_PREFIX/include).

Since the post install script already consolidates all libs, bins and include files, I wonder whether it also intends to modify environment variables? If not, what's the recommended way? Do I have to set environment variables manually, or should conda install cudatoolkit-dev automatically do that for me?


Details about conda environment (conda list):

$ conda list
# packages in environment at /project/venv:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main  
blas                      1.0                         mkl  
ca-certificates           2020.12.8            h06a4308_0  
certifi                   2020.12.5        py37h06a4308_0  
cffi                      1.14.4           py37h261ae71_0  
cudatoolkit               10.0.130                      0  
cudatoolkit-dev           10.1.243             h516909a_3    conda-forge
cudnn                     7.6.5                cuda10.0_0  
intel-openmp              2020.2                      254  
ld_impl_linux-64          2.33.1               h53a641e_7  
libedit                   3.1.20191231         h14c3975_1  
libffi                    3.3                  he6710b0_2  
libgcc-ng                 9.1.0                hdf63c60_0  
libstdcxx-ng              9.1.0                hdf63c60_0  
mkl                       2020.2                      256  
mkl-service               2.3.0            py37he8ac12f_0  
mkl_fft                   1.2.0            py37h23d657b_0  
mkl_random                1.1.1            py37h0573a6f_0  
ncurses                   6.2                  he6710b0_1  
ninja                     1.10.2           py37hff7bd54_0  
numpy                     1.19.2           py37h54aff64_0  
numpy-base                1.19.2           py37hfa32c7d_0  
openssl                   1.1.1i               h27cfd23_0  
pip                       20.3.3           py37h06a4308_0  
pycparser                 2.20                       py_2  
python                    3.7.9                h7579374_0  
pytorch                   1.1.0           cuda100py37he554f03_0  
readline                  8.0                  h7b6447c_0  
setuptools                51.1.2           py37h06a4308_4  
six                       1.15.0           py37h06a4308_0  
sqlite                    3.33.0               h62c20be_0  
tk                        8.6.10               hbc83047_0  
wheel                     0.36.2             pyhd3eb1b0_0  
xz                        5.2.5                h7b6447c_0  
zlib                      1.2.11               h7b6447c_3  

Details about conda and system ( conda info ):

$ conda info
     active environment : /project/venv
    active env location : /project/venv
            shell level : 1
       user config file : /home/me/.condarc
 populated config files : /home/me/.condarc
          conda version : 4.9.2
    conda-build version : not installed
         python version : 3.8.5.final.0
       virtual packages : __cuda=11.1=0
                          __glibc=2.27=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : /opt/conda  (writable)
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
                          https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
          package cache : /opt/conda/pkgs
                          /home/me/.conda/pkgs
       envs directories : /opt/conda/envs
                          /home/me/.conda/envs
               platform : linux-64
             user-agent : conda/4.9.2 requests/2.25.1 CPython/3.8.5 Linux/4.15.0-123-generic ubuntu/18.04.5 glibc/2.27
                UID:GID : 1001:1001
             netrc file : None
           offline mode : False

libcuda.so & libcuda.so.1 & libcuda.so.1.1 not included?

Comment:

I need above-metioned libs for tinycuda-nn but I wasn't able to find these. Are these not included with cudatoolkit-dev?

Windows support?

I am currently using the non-dev version on Windows, but I need PTX which seems to be included here. Is there some particular reason/complication for not supporting Windows right now?

Unable to install toolkit within disconnected environment

Solution to issue cannot be found in the documentation.

• I checked the documentation.

Issue

Even adding cuda binary under BLOB_DIR, the cudatoolkit-dev-post-install.py script still attempts to download cuda binary that yields to a constant failure on disconnected environments. It seems following snippet needs to be shifted one TAB right, as the download invocation should only be called in the else block:

cudatoolkit-dev-feedstock/recipe/cudatoolkit-dev-post-install.py

Line 91 in ab2938d

self.download(dl_url, dl_path)

The error on stdout (see re-using previously downloaded ... prompt):

==> script output <==
stdout: Running Post installation
re-using previously downloaded /opt/conda/pkgs/cudatoolkit-dev/cuda_11.7.0_515.43.04_linux.run
…
subprocess.CalledProcessError: Command '['wget', 'https://developer.download.nvidia.com/compute/cuda/11.7.0/local_installers/cuda_11.7.0_515.43.04_linux.run', '-O', '/opt/conda/pkgs/cudatoolkit-dev/cuda_11.
7.0_515.43.04_linux.run', '-q']' returned non-zero exit status 4. 

Installed packages

# conda list
# packages in environment at /opt/conda:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main    https://repo.anaconda.com/pkgs/main
_openmp_mutex             5.1                       1_gnu    https://repo.anaconda.com/pkgs/main
archspec                  0.2.1              pyhd3eb1b0_0    https://repo.anaconda.com/pkgs/main
boltons                   23.0.0          py311h06a4308_0    https://repo.anaconda.com/pkgs/main
brotli-python             1.0.9           py311h6a678d5_7    https://repo.anaconda.com/pkgs/main
bzip2                     1.0.8                h7b6447c_0    https://repo.anaconda.com/pkgs/main
c-ares                    1.19.1               h5eee18b_0    https://repo.anaconda.com/pkgs/main
ca-certificates           2023.08.22           h06a4308_0    https://repo.anaconda.com/pkgs/main
certifi                   2023.7.22       py311h06a4308_0    https://repo.anaconda.com/pkgs/main
cffi                      1.15.1          py311h5eee18b_3    https://repo.anaconda.com/pkgs/main
charset-normalizer        2.0.4              pyhd3eb1b0_0    https://repo.anaconda.com/pkgs/main
conda                     23.10.0         py311h06a4308_0    https://repo.anaconda.com/pkgs/main
conda-content-trust       0.2.0           py311h06a4308_0    https://repo.anaconda.com/pkgs/main
conda-libmamba-solver     23.11.1         py311h06a4308_0    https://repo.anaconda.com/pkgs/main
conda-package-handling    2.2.0           py311h06a4308_0    https://repo.anaconda.com/pkgs/main
conda-package-streaming   0.9.0           py311h06a4308_0    https://repo.anaconda.com/pkgs/main
cryptography              41.0.3          py311hdda0065_0    https://repo.anaconda.com/pkgs/main
fmt                       9.1.0                hdb19cb5_0    https://repo.anaconda.com/pkgs/main
icu                       73.1                 h6a678d5_0    https://repo.anaconda.com/pkgs/main
idna                      3.4             py311h06a4308_0    https://repo.anaconda.com/pkgs/main
jsonpatch                 1.32               pyhd3eb1b0_0    https://repo.anaconda.com/pkgs/main
jsonpointer               2.1                pyhd3eb1b0_0    https://repo.anaconda.com/pkgs/main
krb5                      1.20.1               h143b758_1    https://repo.anaconda.com/pkgs/main
ld_impl_linux-64          2.38                 h1181459_1    https://repo.anaconda.com/pkgs/main
libarchive                3.6.2                h6ac8c49_2    https://repo.anaconda.com/pkgs/main
libcurl                   8.4.0                h251f7ec_0    https://repo.anaconda.com/pkgs/main
libedit                   3.1.20221030         h5eee18b_0    https://repo.anaconda.com/pkgs/main
libev                     4.33                 h7f8727e_1    https://repo.anaconda.com/pkgs/main
libffi                    3.4.4                h6a678d5_0    https://repo.anaconda.com/pkgs/main
libgcc-ng                 11.2.0               h1234567_1    https://repo.anaconda.com/pkgs/main
libgomp                   11.2.0               h1234567_1    https://repo.anaconda.com/pkgs/main
libmamba                  1.5.3                haf1ee3a_0    https://repo.anaconda.com/pkgs/main
libmambapy                1.5.3           py311h2dafd23_0    https://repo.anaconda.com/pkgs/main
libnghttp2                1.57.0               h2d74bed_0    https://repo.anaconda.com/pkgs/main
libsolv                   0.7.24               he621ea3_0    https://repo.anaconda.com/pkgs/main
libssh2                   1.10.0               hdbd6064_2    https://repo.anaconda.com/pkgs/main
libstdcxx-ng              11.2.0               h1234567_1    https://repo.anaconda.com/pkgs/main
libuuid                   1.41.5               h5eee18b_0    https://repo.anaconda.com/pkgs/main
libxml2                   2.10.4               hf1b16e4_1    https://repo.anaconda.com/pkgs/main
lz4-c                     1.9.4                h6a678d5_0    https://repo.anaconda.com/pkgs/main
ncurses                   6.4                  h6a678d5_0    https://repo.anaconda.com/pkgs/main
openssl                   3.0.12               h7f8727e_0    https://repo.anaconda.com/pkgs/main
packaging                 23.1            py311h06a4308_0    https://repo.anaconda.com/pkgs/main
pcre2                     10.42                hebb0a14_0    https://repo.anaconda.com/pkgs/main
pip                       23.3.1                   pypi_0    pypi
pluggy                    1.0.0           py311h06a4308_1    https://repo.anaconda.com/pkgs/main
pybind11-abi              4                    hd3eb1b0_1    https://repo.anaconda.com/pkgs/main
pycosat                   0.6.6           py311h5eee18b_0    https://repo.anaconda.com/pkgs/main
pycparser                 2.21               pyhd3eb1b0_0    https://repo.anaconda.com/pkgs/main
pyopenssl                 23.2.0          py311h06a4308_0    https://repo.anaconda.com/pkgs/main
pysocks                   1.7.1           py311h06a4308_0    https://repo.anaconda.com/pkgs/main
python                    3.11.5               h955ad1f_0    https://repo.anaconda.com/pkgs/main
readline                  8.2                  h5eee18b_0    https://repo.anaconda.com/pkgs/main
reproc                    14.2.4               h295c915_1    https://repo.anaconda.com/pkgs/main
reproc-cpp                14.2.4               h295c915_1    https://repo.anaconda.com/pkgs/main
requests                  2.31.0          py311h06a4308_0    https://repo.anaconda.com/pkgs/main
ruamel.yaml               0.17.21         py311h5eee18b_0    https://repo.anaconda.com/pkgs/main
setuptools                68.0.0          py311h06a4308_0    https://repo.anaconda.com/pkgs/main
sqlite                    3.41.2               h5eee18b_0    https://repo.anaconda.com/pkgs/main
tk                        8.6.12               h1ccaba5_0    https://repo.anaconda.com/pkgs/main
tqdm                      4.65.0          py311h92b7b1e_0    https://repo.anaconda.com/pkgs/main
truststore                0.8.0           py311h06a4308_0    https://repo.anaconda.com/pkgs/main
tzdata                    2023c                h04d1e81_0    https://repo.anaconda.com/pkgs/main
urllib3                   1.26.18         py311h06a4308_0    https://repo.anaconda.com/pkgs/main
wheel                     0.41.2          py311h06a4308_0    https://repo.anaconda.com/pkgs/main
xz                        5.4.2                h5eee18b_0    https://repo.anaconda.com/pkgs/main
yaml-cpp                  0.8.0                h6a678d5_0    https://repo.anaconda.com/pkgs/main
zlib                      1.2.13               h5eee18b_0    https://repo.anaconda.com/pkgs/main
zstandard                 0.19.0          py311h5eee18b_0    https://repo.anaconda.com/pkgs/main
zstd                      1.5.5                hc292b87_0    https://repo.anaconda.com/pkgs/main

Environment info

# conda info
 
     active environment : base
    active env location : /opt/conda
            shell level : 1
       user config file : /root/.condarc
populated config files : /root/.condarc
          conda version : 23.10.0
    conda-build version : not installed
         python version : 3.11.5.final.0
       virtual packages : __archspec=1=x86_64_v3
                          __glibc=2.31=0
                          __linux=6.4.16=0
                          __unix=0=0
       base environment : /opt/conda  (writable)
      conda av data dir : /opt/conda/etc/conda
  conda av metadata url : None
           channel URLs : <corporate repo>
          package cache : /opt/conda/pkgs
                          /root/.conda/pkgs
       envs directories : /opt/conda/envs
                          /root/.conda/envs
               platform : linux-64
             user-agent : conda/23.10.0 requests/2.31.0 CPython/3.11.5 Linux/6.4.16-linuxkit debian/11 glibc/2.31 solver/libmamba conda-libmamba-solver/23.11.1 libmambapy/1.5.3
                UID:GID : 0:0
             netrc file : None
           offline mode : False

Cannot install through proxy - need to configure download url

I failed to install cudatoolkit-dev behind a corporate firewall (although with a proxy for conda), and only got a cryptic error:

ERROR conda.core.link:_execute(568): An error occurred while installing package 'çonda-forge::cudatoolkit-dev-10.0-1'.
LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-10.0-1
running your command again with `-v` will provide additional information
location of failed script: /opt/conda/bin/.cudatoolkit-dev-post-link.sh
==> script messages <==
<None>

Attempting to roll back

What's not obvious at first is that the cudatoolkit-dev-post-install.py script tries to download files from a given url, which of course is blocked by our firewall:

cudatoolkit-dev-feedstock/recipe/cudatoolkit-dev-post-install.py

Line 316 in 3bae06d

] = f'https://developer.nvidia.com/compute/cuda/{cudatoolkit["version"]}/Prod/'

What I'd need is to modify this URL so I can point it at a proxy (that I can - with some effort - get set up to circumvent the firewall). Will try to prepare a PR shortly.

Not able to install conda toolkit dev due to Permission Error

Hi
I wanted to install the cuda-toolkit dev, but it tries to remove the file from the tmp folder(cuda-installer.log) during the installation., which fails due to permission error. I am not the super user and cannot access the tmp folder. Is there any other way for this to work without being the super user?

The error:

ERROR conda.core.link:_execute(740): An error occurred while installing package 'conda-forge::cudatoolkit-dev-11.7.0-h1de0b5d_6'.
Rolling back transaction: done

LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-11.7.0-h1de0b5d_6
location of failed script: /home/santosh.sanjeev/miniconda3/envs/unixmini/bin/.cudatoolkit-dev-post-link.sh
==> script messages <==

==> script output <==
stdout: Running Post installation
re-using previously downloaded /home/santosh.sanjeev/miniconda3/envs/unixmini/pkgs/cudatoolkit-dev/cuda_11.7.0_515.43.04_linux.run

stderr: Traceback (most recent call last):
File "/home/santosh.sanjeev/miniconda3/envs/unixmini/bin/cudatoolkit-dev-post-install.py", line 118, in extract
os.remove("/tmp/cuda-installer.log")
PermissionError: [Errno 1] Operation not permitted: '/tmp/cuda-installer.log'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/santosh.sanjeev/miniconda3/envs/unixmini/bin/cudatoolkit-dev-post-install.py", line 311, in
_main()
File "/home/santosh.sanjeev/miniconda3/envs/unixmini/bin/cudatoolkit-dev-post-install.py", line 307, in _main
extractor.extract()
File "/home/santosh.sanjeev/miniconda3/envs/unixmini/bin/cudatoolkit-dev-post-install.py", line 120, in extract
raise RuntimeError(
RuntimeError: Failed to remove /tmp/cuda-installer.log

return code: 1

()

/tmp/cuda-installer.log causes subsequent installs of other users to fail

Solution to issue cannot be found in the documentation.

• I checked the documentation.

Issue

This is already described in here: #44
The solution is to remove /tmp/cuda-installer.log created by the user first installing cuda on the system.

However a backport to older cudatoolkit-dev is missing.
To my understanding, @jnooree tried but didn't find a fitting commit.
He mentioned to create another issue to notify maintainers, what I do now.

I use following environment.yml

---
name: tf2
channels:
  - conda-forge
dependencies:
  - python>=3
  - tensorflow==2.11.1=cuda112*
  - cudatoolkit-dev=11.2
  # ## not necessary (all required tools are in cudatoolkit-dev), though otherwise 11.8 is installed which is confusing
  - cudatoolkit=11.2

which fails with

ERROR conda.core.link:_execute(730): An error occurred while installing package 'conda-forge::cudatoolkit-dev-11.2.2-py39h3811e60_0'.

LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-11.2.2-py39h3811e60_0
location of failed script: <some path>/.conda/envs/tf2/bin/.cudatoolkit-dev-post-link.sh
==> script messages <==
<None>
==> script output <==
stdout: Log file not open.
Running Post installation
downloading https://developer.download.nvidia.com/compute/cuda/11.2.2/local_installers/cuda_11.2.2_460.32.03_linux.run to <some path>/.conda/envs/tf2/pkgs/cudatoolkit-dev/cuda_11.2.2_460.32.03_linux.run
Extracting on Linux

stderr: <some path>/.conda/envs/tf2/pkgs/cudatoolkit-dev/cuda_11.2.2_460.32.03_linux.run: line 513: 680866 Segmentation fault
    (core dumped) ./cuda-installer --silent --toolkit --toolkitpath=/data/scratch/62320/tmpj5oiro_4 --override
Traceback (most recent call last):
  File "<some path>/.conda/envs/tf2/bin/cudatoolkit-dev-post-install.py", line 216, in <module>
    _main()
  File "<some path>/.conda/envs/tf2/bin/cudatoolkit-dev-post-install.py", line 212, in _main
    extractor.extract()
  File "<some path>/.conda/envs/tf2/bin/cudatoolkit-dev-post-install.py", line 124, in extract
    subprocess.run(cmd, env=os.environ.copy(), check=True)
  File "<some path>/.conda/envs/tf2/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['<some path>/.conda/envs/tf2/pkgs/cudatoolkit-dev/cuda_11.2.2_460.32.03_linux.run', '--silent', '--toolkit', '--toolkitpath=/data/scratch/62320/tmpj5oiro_4', '--override']' returned non-zero exit status 139.

return code: 1

()

Installed packages

$ conda list
# packages in environment at /cfs/earth/scratch/slurmtest1/.conda/envs/tf2:
#
# Name                    Version                   Build  Channel

Environment info

$ conda info

     active environment : None
            shell level : 0
       user config file : ~/.condarc
 populated config files : <path to global config>/condarc
          conda version : 4.12.0
    conda-build version : not installed
         python version : 3.9.12.final.0
       virtual packages : __linux=4.18.0=0
                          __glibc=2.28=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : <path to spack installed>/miniconda3-4.12.0  (read only)
      conda av data dir : <path to spack installed>/miniconda3-4.12.0/etc/conda  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : <some loc>/.conda/pkgs
       envs directories : <some loc>/.conda/envs
                          ~/.conda/envs
                          <path to spack installed>/miniconda3-4.12.0/envs
               platform : linux-64
             user-agent : conda/4.12.0 requests/2.27.1 CPython/3.9.12 Linux/4.18.0-372.16.1.el8_6.x86_64 rocky/8.6 glibc/2.28
                UID:GID : 529000190:529000190
             netrc file : None
           offline mode : False

difference with pkgs/cudatoolkit?

From the README it's not clear to me what the difference is between this package and cudatoolkit from the main Anaconda channel. Are they the same (just providing different versions at the moment), or is this a superset?

Archive this feedstock

I think this is overdue. It uses script shenanigans to download the cuda drivers, doesn't play well with the rest of the infra, and is just a continuous source of bugs and confusion IMO.

Cc @conda-forge/core
@conda-forge/cudatoolkit

We need cudatoolkit-dev 11.8!

Solution to issue cannot be found in the documentation.

• I checked the documentation.

Issue

With RTX4090 GPU running pytorch CUDAExtension, I find this error, which won't happen using system's default cuda nvcc 11.8 :
ptxas /tmp/tmpxft_001b35eb_00000000-6_gridencoder.ptx, line 9; fatal : Unsupported .version 7.7; current version is '7.6'

Installed packages

_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                  2_kmp_llvm    conda-forge
absl-py                   1.3.0            py38h06a4308_0  
aiohttp                   3.8.3            py38h5eee18b_0  
aiosignal                 1.2.0              pyhd3eb1b0_0  
antlr4-python3-runtime    4.8                      pypi_0    pypi
appdirs                   1.4.4              pyhd3eb1b0_0  
async-timeout             4.0.2            py38h06a4308_0  
attrs                     22.1.0           py38h06a4308_0  
beautifulsoup4            4.11.1                   pypi_0    pypi
blinker                   1.4              py38h06a4308_0  
blosc                     1.21.0               h4ff587b_1  
brotli                    1.0.9                h5eee18b_7  
brotli-bin                1.0.9                h5eee18b_7  
brotlipy                  0.7.0           py38h27cfd23_1003  
brunsli                   0.1                  h2531618_0  
bzip2                     1.0.8                h7b6447c_0  
c-ares                    1.18.1               h7f8727e_0  
ca-certificates           2023.01.10           h06a4308_0  
cachetools                4.2.2              pyhd3eb1b0_0  
certifi                   2022.12.7        py38h06a4308_0  
cffi                      1.15.1           py38h74dc2b5_0  
cfitsio                   3.470                h5893167_7  
charls                    2.2.0                h2531618_0  
charset-normalizer        2.0.4              pyhd3eb1b0_0  
click                     8.0.4            py38h06a4308_0  
cloudpickle               2.0.0              pyhd3eb1b0_0  
contourpy                 1.0.5            py38hdb19cb5_0  
cryptography              38.0.4           py38h9ce1e76_0  
cuda                      11.7.1                        0    nvidia
cuda-cccl                 11.7.91                       0    nvidia
cuda-command-line-tools   11.7.1                        0    nvidia
cuda-compiler             11.7.1                        0    nvidia
cuda-cudart               11.7.99                       0    nvidia
cuda-cudart-dev           11.7.99                       0    nvidia
cuda-cuobjdump            11.7.91                       0    nvidia
cuda-cupti                11.7.101                      0    nvidia
cuda-cuxxfilt             11.7.91                       0    nvidia
cuda-demo-suite           12.0.76                       0    nvidia
cuda-documentation        12.0.76                       0    nvidia
cuda-driver-dev           12.0.107                      0    nvidia
cuda-gdb                  12.0.90                       0    nvidia
cuda-libraries            11.7.1                        0    nvidia
cuda-libraries-dev        11.7.1                        0    nvidia
cuda-memcheck             11.8.86                       0    nvidia
cuda-nsight               12.0.78                       0    nvidia
cuda-nsight-compute       12.0.0                        0    nvidia
cuda-nvcc                 11.7.99                       0    nvidia
cuda-nvdisasm             12.0.76                       0    nvidia
cuda-nvml-dev             12.0.76                       0    nvidia
cuda-nvprof               12.0.90                       0    nvidia
cuda-nvprune              11.7.91                       0    nvidia
cuda-nvrtc                11.7.99                       0    nvidia
cuda-nvrtc-dev            11.7.99                       0    nvidia
cuda-nvtx                 11.7.91                       0    nvidia
cuda-nvvp                 12.0.90                       0    nvidia
cuda-runtime              11.7.1                        0    nvidia
cuda-sanitizer-api        12.0.90                       0    nvidia
cuda-toolkit              11.7.1                        0    nvidia
cuda-tools                11.7.1                        0    nvidia
cuda-visual-tools         11.7.1                        0    nvidia
cudatoolkit               11.6.0               habf752d_9    nvidia
cudatoolkit-dev           11.6.0               h72bdee0_5    conda-forge
cudnn                     8.4.1.50             hed8a83a_0    conda-forge
cycler                    0.11.0             pyhd3eb1b0_0  
cytoolz                   0.12.0           py38h5eee18b_0  
dask-core                 2022.7.0         py38h06a4308_0  
dataclasses               0.8                pyh6d0b6a4_7  
dbus                      1.13.18              hb2f20db_0  
dearpygui                 1.8.0                    pypi_0    pypi
decorator                 5.1.1                    pypi_0    pypi
expat                     2.4.9                h6a678d5_0  
filelock                  3.9.0                    pypi_0    pypi
flit-core                 3.6.0              pyhd3eb1b0_0  
fontconfig                2.14.1               h52c9d5c_1  
fonttools                 4.25.0             pyhd3eb1b0_0  
freetype                  2.12.1               h4a9f257_0  
frozenlist                1.3.3            py38h5eee18b_0  
fsspec                    2022.11.0        py38h06a4308_0  
fvcore                    0.1.5.post20221221    pyhd8ed1ab_0    conda-forge
gdown                     4.6.0                    pypi_0    pypi
gds-tools                 1.5.0.59                      0    nvidia
giflib                    5.2.1                h5eee18b_1  
glib                      2.69.1               h4ff587b_1  
google-auth               2.6.0              pyhd3eb1b0_0  
google-auth-oauthlib      0.4.4              pyhd3eb1b0_0  
grpcio                    1.42.0           py38hce63b2e_0  
gst-plugins-base          1.14.0               hbbd80ab_1  
gstreamer                 1.14.0               h28cd5cc_2  
hydra-core                1.1.1                    pypi_0    pypi
icu                       58.2                 he6710b0_3  
idna                      3.4              py38h06a4308_0  
ignite                    0.5.0.dev20230203            py_0    pytorch-nightly
imagecodecs               2021.8.26        py38hf0132c2_1  
imageio                   2.19.3           py38h06a4308_0  
importlib-metadata        4.11.3           py38h06a4308_0  
importlib-resources       5.10.2                   pypi_0    pypi
iopath                    0.1.9              pyhd8ed1ab_0    conda-forge
jpeg                      9e                   h7f8727e_0  
jxrlib                    1.1                  h7b6447c_2  
kiwisolver                1.4.4            py38h6a678d5_0  
kornia                    0.6.9              pyhd8ed1ab_0    conda-forge
krb5                      1.19.4               h568e23c_0  
lcms2                     2.14                 hfd0df8a_1    conda-forge
ld_impl_linux-64          2.38                 h1181459_1  
lerc                      3.0                  h295c915_0  
libaec                    1.0.4                he6710b0_1  
libblas                   3.9.0           16_linux64_openblas    conda-forge
libbrotlicommon           1.0.9                h5eee18b_7  
libbrotlidec              1.0.9                h5eee18b_7  
libbrotlienc              1.0.9                h5eee18b_7  
libcblas                  3.9.0           16_linux64_openblas    conda-forge
libcublas                 11.10.3.66                    0    nvidia
libcublas-dev             11.10.3.66                    0    nvidia
libcufft                  10.7.2.124           h4fbf590_0    nvidia
libcufft-dev              10.7.2.124           h98a8f43_0    nvidia
libcufile                 1.5.0.59                      0    nvidia
libcufile-dev             1.5.0.59                      0    nvidia
libcurand                 10.3.1.50                     0    nvidia
libcurand-dev             10.3.1.50                     0    nvidia
libcurl                   7.87.0               h91b91d3_0  
libcusolver               11.4.0.1                      0    nvidia
libcusolver-dev           11.4.0.1                      0    nvidia
libcusparse               11.7.4.91                     0    nvidia
libcusparse-dev           11.7.4.91                     0    nvidia
libdeflate                1.8                  h7f8727e_5  
libedit                   3.1.20221030         h5eee18b_0  
libev                     4.33                 h7f8727e_1  
libffi                    3.3                  he6710b0_2  
libgcc-ng                 12.2.0              h65d4601_19    conda-forge
libgfortran-ng            12.2.0              h69a702a_19    conda-forge
libgfortran5              12.2.0              h337968e_19    conda-forge
libjpeg-turbo             2.1.4                h166bdaf_0    conda-forge
liblapack                 3.9.0           16_linux64_openblas    conda-forge
libnghttp2                1.46.0               hce63b2e_0  
libnpp                    11.7.4.75                     0    nvidia
libnpp-dev                11.7.4.75                     0    nvidia
libnvjpeg                 11.8.0.2                      0    nvidia
libnvjpeg-dev             11.8.0.2                      0    nvidia
libopenblas               0.3.21               h043d6bf_0  
libpng                    1.6.39               h753d276_0    conda-forge
libprotobuf               3.21.12              h3eb15da_0    conda-forge
libssh2                   1.10.0               h8f2d780_0  
libstdcxx-ng              12.2.0              h46fd767_19    conda-forge
libtiff                   4.5.0                hecacb30_0  
libuuid                   1.41.5               h5eee18b_0  
libwebp                   1.2.4                h11a3e52_0  
libwebp-base              1.2.4                h5eee18b_0  
libxcb                    1.13                 h1bed415_1  
libxml2                   2.9.14               h74e7548_0  
libzlib                   1.2.13               h166bdaf_4    conda-forge
libzopfli                 1.0.3                he6710b0_0  
llvm-openmp               15.0.6               he0ac6c6_0    conda-forge
locket                    1.0.0            py38h06a4308_0  
lpips                     0.1.4                    pypi_0    pypi
lz4-c                     1.9.4                h6a678d5_0  
magma                     2.6.2                hc72dce7_0    conda-forge
mako                      1.2.4                    pypi_0    pypi
markdown                  3.4.1            py38h06a4308_0  
markdown-it-py            2.1.0                    pypi_0    pypi
markupsafe                2.1.1            py38h7f8727e_0  
matplotlib                3.6.2            py38h578d9bd_0    conda-forge
matplotlib-base           3.6.2            py38h945d387_0  
mdurl                     0.1.2                    pypi_0    pypi
mkl                       2022.2.1         h84fe81f_16997    conda-forge
multidict                 6.0.2            py38h5eee18b_0  
munkres                   1.1.4                      py_0  
mypy_extensions           0.4.3            py38h06a4308_1  
nccl                      2.14.3.1             h0800d71_0    conda-forge
ncurses                   6.4                  h6a678d5_0  
networkx                  2.8.4            py38h06a4308_0  
ninja                     1.11.1                   pypi_0    pypi
ninja-base                1.10.2               hd09550d_5  
nsight-compute            2022.4.0.15                   0    nvidia
numpy                     1.23.0                   pypi_0    pypi
nvidia-cublas-cu11        11.11.3.6                pypi_0    pypi
nvidia-cuda-runtime-cu11  11.8.89                  pypi_0    pypi
nvidia-cudnn-cu11         8.7.0.84                 pypi_0    pypi
oauthlib                  3.2.1            py38h06a4308_0  
omegaconf                 2.1.1                    pypi_0    pypi
opencv-python             4.7.0.68                 pypi_0    pypi
openjpeg                  2.5.0                hfec8fc6_2    conda-forge
openssl                   1.1.1s               h7f8727e_0  
packaging                 22.0             py38h06a4308_0  
pandas                    1.5.3                    pypi_0    pypi
partd                     1.2.0              pyhd3eb1b0_1  
pathspec                  0.10.3           py38h06a4308_0  
pcre                      8.45                 h295c915_0  
pillow                    9.4.0            py38hb32c036_0    conda-forge
pip                       22.3.1             pyhd8ed1ab_0    conda-forge
platformdirs              2.6.2                    pypi_0    pypi
plyfile                   0.7.4                    pypi_0    pypi
pooch                     1.4.0              pyhd3eb1b0_0  
portalocker               2.3.0            py38h06a4308_0  
protobuf                  3.20.1                   pypi_0    pypi
pyasn1                    0.4.8              pyhd3eb1b0_0  
pyasn1-modules            0.2.8                      py_0  
pycparser                 2.21               pyhd3eb1b0_0  
pycuda                    2022.2.2                 pypi_0    pypi
pydeprecate               0.3.2              pyhd8ed1ab_0    conda-forge
pygments                  2.14.0                   pypi_0    pypi
pyjwt                     2.4.0            py38h06a4308_0  
pymcubes                  0.1.4                    pypi_0    pypi
pyopenssl                 22.0.0             pyhd3eb1b0_0  
pyparsing                 3.0.9            py38h06a4308_0  
pyqt                      5.9.2            py38h05f1152_4  
pysdf                     0.1.8                    pypi_0    pypi
pysocks                   1.7.1            py38h06a4308_0  
python                    3.8.11          h12debd9_0_cpython  
python-dateutil           2.8.2              pyhd3eb1b0_0  
python_abi                3.8                      3_cp38    conda-forge
pytools                   2022.1.14                pypi_0    pypi
pytorch                   1.13.0          cuda112py38hd94e077_200    conda-forge
pytorch-cuda              11.7                 h67b0de4_2    pytorch-nightly
pytorch-lightning         1.7.6              pyhd8ed1ab_0    conda-forge
pytorch3d                 0.7.2           py38_cu117_pyt1130    pytorch3d
pytz                      2022.7.1                 pypi_0    pypi
pywavelets                1.4.1            py38h5eee18b_0  
pyyaml                    6.0              py38h5eee18b_1  
qt                        5.9.7                h5867ecd_1  
readline                  8.2                  h5eee18b_0  
requests                  2.28.1           py38h06a4308_0  
requests-oauthlib         1.3.0                      py_0  
rich                      13.3.1                   pypi_0    pypi
rsa                       4.7.2              pyhd3eb1b0_1  
scikit-image              0.19.3           py38h8f669ce_2    conda-forge
scipy                     1.10.0           py38h10c12cc_0    conda-forge
setuptools                59.5.0           py38h578d9bd_0    conda-forge
sip                       4.19.13          py38h295c915_0  
six                       1.16.0             pyhd3eb1b0_1  
sleef                     3.5.1                h9b69904_2    conda-forge
snappy                    1.1.9                h295c915_0  
soupsieve                 2.3.2.post1              pypi_0    pypi
sqlite                    3.40.1               h5082296_0  
tabulate                  0.8.10           py38h06a4308_0  
tbb                       2021.6.0             hdb19cb5_1  
tensorboard               2.10.0           py38h06a4308_0  
tensorboard-data-server   0.6.1            py38h52d8a92_0  
tensorboard-plugin-wit    1.8.1            py38h06a4308_0  
tensorboardx              2.5.1                    pypi_0    pypi
tensorrt                  8.5.2.2                  pypi_0    pypi
termcolor                 2.1.0            py38h06a4308_0  
tifffile                  2021.7.2           pyhd3eb1b0_2  
tinycudann                1.7                      pypi_0    pypi
tk                        8.6.12               h1ccaba5_0  
tomli                     2.0.1            py38h06a4308_0  
toolz                     0.12.0           py38h06a4308_0  
torch-ema                 0.3                      pypi_0    pypi
torchmetrics              0.11.0             pyhd8ed1ab_0    conda-forge
torchvision               0.14.0          cuda112py38hebebe89_0    conda-forge
tornado                   6.2              py38h5eee18b_0  
tqdm                      4.64.1           py38h06a4308_0  
trimesh                   3.18.3                   pypi_0    pypi
typing-extensions         4.4.0            py38h06a4308_0  
typing_extensions         4.4.0            py38h06a4308_0  
urllib3                   1.26.14          py38h06a4308_0  
werkzeug                  2.2.2            py38h06a4308_0  
wheel                     0.37.1             pyhd3eb1b0_0  
xz                        5.2.10               h5eee18b_1  
yacs                      0.1.6              pyhd3eb1b0_1  
yaml                      0.2.5                h7b6447c_0  
yapf                      0.32.0                   pypi_0    pypi
yarl                      1.8.1            py38h5eee18b_0  
zfp                       0.5.5                h295c915_6  
zipp                      3.11.0           py38h06a4308_0  
zlib                      1.2.13               h166bdaf_4    conda-forge
zstd                      1.5.2                ha4553b6_0

Environment info

active environment : hyperreel
    active env location : /home/mjdyx/miniconda3/envs/hyperreel
            shell level : 1
       user config file : /home/mjdyx/.condarc
 populated config files : /home/mjdyx/.condarc
          conda version : 22.11.1
    conda-build version : not installed
         python version : 3.10.8.final.0
       virtual packages : __archspec=1=x86_64
                          __cuda=12.0=0
                          __glibc=2.35=0
                          __linux=5.15.0=0
                          __unix=0=0
       base environment : /home/mjdyx/miniconda3  (writable)
      conda av data dir : /home/mjdyx/miniconda3/etc/conda
  conda av metadata url : None
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/mjdyx/miniconda3/pkgs
                          /home/mjdyx/.conda/pkgs
       envs directories : /home/mjdyx/miniconda3/envs
                          /home/mjdyx/.conda/envs
               platform : linux-64
             user-agent : conda/22.11.1 requests/2.28.1 CPython/3.10.8 Linux/5.15.0-58-generic ubuntu/22.04.1 glibc/2.35
                UID:GID : 1000:1000
             netrc file : None
           offline mode : False

Cannot remove with conda uninstall

Solution to issue cannot be found in the documentation.

• I checked the documentation.

Issue

This package does not completely uninstall when I run 'conda uninstall condatoolkit-dev'.
The package no longer appears under 'conda list', but the 'nvcc' command still works and 'which nvcc' still points to the conda bin directory.

Installed packages

# packages in environment at /opt/miniconda3/envs/dab3:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                  2_kmp_llvm    conda-forge
_sysroot_linux-64_curr_repodata_hack 3                   h5bd9786_13    conda-forge
addict                    2.4.0                    pypi_0    pypi
bzip2                     1.0.8                h7f98852_4    conda-forge
ca-certificates           2021.10.8            ha878542_0    conda-forge
cloudpickle               2.0.0                    pypi_0    pypi
cycler                    0.11.0                   pypi_0    pypi
cython                    0.29.28                  pypi_0    pypi
fonttools                 4.33.2                   pypi_0    pypi
kernel-headers_linux-64   3.10.0              h4a8ded7_13    conda-forge
kiwisolver                1.4.2                    pypi_0    pypi
ld_impl_linux-64          2.36.1               hea4e1c9_2    conda-forge
libffi                    3.2.1             he1b5a44_1007    conda-forge
libgcc-ng                 11.2.0              h1d223b6_16    conda-forge
libstdcxx-ng              11.2.0              he4da1e4_16    conda-forge
libzlib                   1.2.11            h166bdaf_1014    conda-forge
llvm-openmp               13.0.1               he0ac6c6_1    conda-forge
matplotlib                3.5.1                    pypi_0    pypi
ncurses                   6.3                  h27087fc_1    conda-forge
nvcc_linux-64             11.6                hd0b5fcf_16    conda-forge
openssl                   1.1.1n               h166bdaf_0    conda-forge
packaging                 21.3                     pypi_0    pypi
panopticapi               0.1                      pypi_0    pypi
pip                       22.0.4             pyhd8ed1ab_0    conda-forge
pycocotools               2.0                      pypi_0    pypi
pyparsing                 3.0.8                    pypi_0    pypi
python                    3.7.3                h357f687_2    conda-forge
python-dateutil           2.8.2                    pypi_0    pypi
python_abi                3.7                     2_cp37m    conda-forge
readline                  8.1                  h46c0cb4_0    conda-forge
scipy                     1.7.3                    pypi_0    pypi
sed                       4.8                  he412f7d_0    conda-forge
setuptools                62.1.0           py37h89c1867_0    conda-forge
sqlite                    3.38.2               h4ff8645_0    conda-forge
submitit                  1.4.2                    pypi_0    pypi
sysroot_linux-64          2.17                h4a8ded7_13    conda-forge
termcolor                 1.1.0                    pypi_0    pypi
timm                      0.5.4                    pypi_0    pypi
tk                        8.6.12               h27826a3_0    conda-forge
wheel                     0.37.1             pyhd8ed1ab_0    conda-forge
xz                        5.2.5                h516909a_1    conda-forge
yapf                      0.32.0                   pypi_0    pypi
zlib                      1.2.11            h166bdaf_1014    conda-forge

Environment info

active environment : dab3
    active env location : /opt/miniconda3/envs/dab3
            shell level : 2
       user config file : /home/matt/.condarc
 populated config files : /opt/miniconda3/.condarc
                          /home/matt/.condarc
          conda version : 4.11.0
    conda-build version : not installed
         python version : 3.7.12.final.0
       virtual packages : __cuda=10.2=0
                          __linux=5.3.0=0
                          __glibc=2.30=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : /opt/miniconda3  (writable)
      conda av data dir : /opt/miniconda3/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /opt/miniconda3/pkgs
                          /home/matt/.conda/pkgs
       envs directories : /opt/miniconda3/envs
                          /home/matt/.conda/envs
               platform : linux-64
             user-agent : conda/4.11.0 requests/2.27.1 CPython/3.7.12 Linux/5.3.0-64-generic ubuntu/19.10 glibc/2.30
                UID:GID : 1001:1001
             netrc file : /home/matt/.netrc
           offline mode : False

cudatoolkit-dev can't be installed on linux conda-forge CI

Solution to issue cannot be found in the documentation.

• I checked the documentation.

Issue

I'm trying to add cudatoolkit-dev as dependency to get nvcc in conda-forge CI to build OpenVINO plugin that enable deep neural networks inference on NVIDIA GPUs
conda-forge/openvino-feedstock/pull/23

and got following error:

023-07-18T15:58:16.1487476Z Rolling back transaction: ...working... ERROR conda.core.link:_execute(740): An error occurred while installing package 'conda-forge::cudatoolkit-dev-11.7.0-h1de0b5d_6'.
2023-07-18T15:58:19.8912931Z done
2023-07-18T15:58:19.9264885Z Traceback (most recent call last):
2023-07-18T15:58:19.9280044Z   File "/opt/conda/bin/conda-mambabuild", line 10, in <module>
2023-07-18T15:58:19.9280750Z     sys.exit(main())
2023-07-18T15:58:19.9326356Z   File "/opt/conda/lib/python3.10/site-packages/boa/cli/mambabuild.py", line 256, in main
2023-07-18T15:58:19.9327091Z     call_conda_build(action, config)
2023-07-18T15:58:19.9327648Z   File "/opt/conda/lib/python3.10/site-packages/boa/cli/mambabuild.py", line 228, in call_conda_build
2023-07-18T15:58:19.9328026Z     result = api.build(
2023-07-18T15:58:19.9328669Z   File "/opt/conda/lib/python3.10/site-packages/conda_build/api.py", line 253, in build
2023-07-18T15:58:19.9329268Z     return build_tree(
2023-07-18T15:58:19.9337988Z   File "/opt/conda/lib/python3.10/site-packages/conda_build/build.py", line 3799, in build_tree
2023-07-18T15:58:19.9339142Z     packages_from_this = build(
2023-07-18T15:58:19.9339974Z   File "/opt/conda/lib/python3.10/site-packages/conda_build/build.py", line 2572, in build
2023-07-18T15:58:19.9340451Z     create_build_envs(top_level_pkg, notest)
2023-07-18T15:58:19.9341093Z   File "/opt/conda/lib/python3.10/site-packages/conda_build/build.py", line 2412, in create_build_envs
2023-07-18T15:58:19.9341566Z     environ.create_env(
2023-07-18T15:58:19.9342132Z   File "/opt/conda/lib/python3.10/site-packages/conda_build/environ.py", line 1058, in create_env
2023-07-18T15:58:19.9345448Z     execute_actions(actions, index)
2023-07-18T15:58:19.9346131Z   File "/opt/conda/lib/python3.10/site-packages/conda/common/io.py", line 84, in decorated
2023-07-18T15:58:19.9348777Z     return f(*args, **kwds)
2023-07-18T15:58:19.9349448Z   File "/opt/conda/lib/python3.10/site-packages/conda/plan.py", line 322, in execute_actions
2023-07-18T15:58:19.9368003Z     execute_instructions(plan, index, verbose)
2023-07-18T15:58:19.9368912Z   File "/opt/conda/lib/python3.10/site-packages/conda/plan.py", line 532, in execute_instructions
2023-07-18T15:58:19.9369406Z     cmd(state, arg)
2023-07-18T15:58:19.9370004Z   File "/opt/conda/lib/python3.10/site-packages/conda/instructions.py", line 73, in UNLINKLINKTRANSACTION_CMD
2023-07-18T15:58:19.9375100Z     unlink_link_transaction.execute()
2023-07-18T15:58:19.9375885Z   File "/opt/conda/lib/python3.10/site-packages/conda/core/link.py", line 283, in execute
2023-07-18T15:58:19.9376406Z     self._execute(tuple(chain(*chain(*zip(*self.prefix_action_groups.values())))))
2023-07-18T15:58:19.9377031Z   File "/opt/conda/lib/python3.10/site-packages/conda/core/link.py", line 756, in _execute
2023-07-18T15:58:19.9385554Z     raise CondaMultiError(
2023-07-18T15:58:19.9386366Z conda.CondaMultiError: post-link script failed for package conda-forge::cudatoolkit-dev-11.7.0-h1de0b5d_6
2023-07-18T15:58:19.9387251Z location of failed script: /home/conda/feedstock_root/build_artifacts/openvino_1689695384762/_build_env/bin/.cudatoolkit-dev-post-link.sh
2023-07-18T15:58:19.9387771Z ==> script messages <==
2023-07-18T15:58:19.9388112Z <None>
2023-07-18T15:58:19.9388466Z ==> script output <==
2023-07-18T15:58:19.9388820Z stdout: Running Post installation
2023-07-18T15:58:19.9389775Z downloading https://developer.download.nvidia.com/compute/cuda/11.7.0/local_installers/cuda_11.7.0_515.43.04_linux.run to /home/conda/feedstock_root/build_artifacts/openvino_1689695384762/_build_env/pkgs/cudatoolkit-dev/cuda_11.7.0_515.43.04_linux.run
2023-07-18T15:58:19.9390413Z Extracting on Linux
2023-07-18T15:58:19.9390663Z 
2023-07-18T15:58:19.9391611Z stderr: /home/conda/feedstock_root/build_artifacts/openvino_1689695384762/_build_env/bin/cudatoolkit-dev-post-install.py:45: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
2023-07-18T15:58:19.9392307Z   from distutils.dir_util import copy_tree
2023-07-18T15:58:19.9392900Z terminate called after throwing an instance of 'boost::filesystem::filesystem_error'
2023-07-18T15:58:19.9393726Z   what():  boost::filesystem::copy_file: No space left on device: "./builds/nsight_systems/host-linux-x64/libQt5Qml.so.5", "/tmp/tmpfg_ekz50/nsight-systems-2022.1.3/host-linux-x64/libQt5Qml.so.5"
2023-07-18T15:58:19.9394763Z /home/conda/feedstock_root/build_artifacts/openvino_1689695384762/_build_env/pkgs/cudatoolkit-dev/cuda_11.7.0_515.43.04_linux.run: line 533:   655 Aborted                 (core dumped) ./cuda-installer --silent --toolkit --toolkitpath=/tmp/tmpfg_ekz50 --override
2023-07-18T15:58:19.9395383Z Traceback (most recent call last):
2023-07-18T15:58:19.9396016Z   File "/home/conda/feedstock_root/build_artifacts/openvino_1689695384762/_build_env/bin/cudatoolkit-dev-post-install.py", line 311, in <module>
2023-07-18T15:58:19.9396509Z     _main()
2023-07-18T15:58:19.9397110Z   File "/home/conda/feedstock_root/build_artifacts/openvino_1689695384762/_build_env/bin/cudatoolkit-dev-post-install.py", line 307, in _main
2023-07-18T15:58:19.9397942Z     extractor.extract()
2023-07-18T15:58:19.9398608Z   File "/home/conda/feedstock_root/build_artifacts/openvino_1689695384762/_build_env/bin/cudatoolkit-dev-post-install.py", line 135, in extract
2023-07-18T15:58:19.9399274Z     subprocess.run(cmd, env=os.environ.copy(), check=True)
2023-07-18T15:58:19.9399765Z   File "/home/conda/feedstock_root/build_artifacts/openvino_1689695384762/_build_env/lib/python3.11/subprocess.py", line 571, in run
2023-07-18T15:58:19.9400212Z     raise CalledProcessError(retcode, process.args,
2023-07-18T15:58:19.9401115Z subprocess.CalledProcessError: Command '['/home/conda/feedstock_root/build_artifacts/openvino_1689695384762/_build_env/pkgs/cudatoolkit-dev/cuda_11.7.0_515.43.04_linux.run', '--silent', '--toolkit', '--toolkitpath=/tmp/tmpfg_ekz50', '--override']' returned non-zero exit status 134.
2023-07-18T15:58:19.9401637Z 
2023-07-18T15:58:19.9401956Z return code: 1
2023-07-18T15:58:19.9402193Z 
2023-07-18T15:58:19.9402510Z ()

Full log available by link
https://dev.azure.com/conda-forge/84710dde-1620-425b-80d0-4cf5baca359d/_apis/build/builds/746870/logs/33

Installed packages

2023-07-18T15:54:20.2386103Z The following NEW packages will be INSTALLED:
2023-07-18T15:54:20.2386402Z 
2023-07-18T15:54:20.2387121Z     _libgcc_mutex:                        0.1-conda_forge           conda-forge
2023-07-18T15:54:20.2387686Z     _openmp_mutex:                        4.5-2_gnu                 conda-forge
2023-07-18T15:54:20.2388254Z     _sysroot_linux-64_curr_repodata_hack: 3-h69a702a_13             conda-forge
2023-07-18T15:54:20.2388806Z     binutils_impl_linux-64:               2.40-hf600244_0           conda-forge
2023-07-18T15:54:20.2389367Z     binutils_linux-64:                    2.40-hbdbef99_0           conda-forge
2023-07-18T15:54:20.2389889Z     bzip2:                                1.0.8-h7f98852_4          conda-forge
2023-07-18T15:54:20.2390546Z     c-ares:                               1.19.1-hd590300_0         conda-forge
2023-07-18T15:54:20.2391139Z     ca-certificates:                      2023.5.7-hbcca054_0       conda-forge
2023-07-18T15:54:20.2391686Z     cmake:                                3.26.4-hcfe8598_0         conda-forge
2023-07-18T15:54:20.2392243Z     cudatoolkit-dev:                      11.7.0-h1de0b5d_6         conda-forge
2023-07-18T15:54:20.2392784Z     curl:                                 8.1.2-hca28451_1          conda-forge
2023-07-18T15:54:20.2393335Z     expat:                                2.5.0-hcb278e6_1          conda-forge
2023-07-18T15:54:20.2394725Z     flatbuffers:                          23.3.3-hcb278e6_1         conda-forge
2023-07-18T15:54:20.2396788Z     gcc_impl_linux-64:                    12.3.0-he2b93b0_0         conda-forge
2023-07-18T15:54:20.2397595Z     gcc_linux-64:                         12.3.0-h76fc315_0         conda-forge
2023-07-18T15:54:20.2398533Z     gettext:                              0.21.1-h27087fc_0         conda-forge
2023-07-18T15:54:20.2399312Z     git:                                  2.41.0-pl5321h86e50cf_0   conda-forge
2023-07-18T15:54:20.2399878Z     gxx_impl_linux-64:                    12.3.0-he2b93b0_0         conda-forge
2023-07-18T15:54:20.2400452Z     gxx_linux-64:                         12.3.0-h8a814eb_0         conda-forge
2023-07-18T15:54:20.2401035Z     kernel-headers_linux-64:              3.10.0-h4a8ded7_13        conda-forge
2023-07-18T15:54:20.2401589Z     keyutils:                             1.6.1-h166bdaf_0          conda-forge
2023-07-18T15:54:20.2402138Z     krb5:                                 1.21.1-h659d440_0         conda-forge
2023-07-18T15:54:20.2402682Z     ld_impl_linux-64:                     2.40-h41732ed_0           conda-forge
2023-07-18T15:54:20.2403238Z     libcurl:                              8.1.2-hca28451_1          conda-forge
2023-07-18T15:54:20.2403787Z     libedit:                              3.1.20191231-he28a2e2_2   conda-forge
2023-07-18T15:54:20.2404320Z     libev:                                4.33-h516909a_1           conda-forge
2023-07-18T15:54:20.2404883Z     libexpat:                             2.5.0-hcb278e6_1          conda-forge
2023-07-18T15:54:20.2405416Z     libffi:                               3.4.2-h7f98852_5          conda-forge
2023-07-18T15:54:20.2406451Z     libgcc-devel_linux-64:                12.3.0-h8bca6fd_0         conda-forge
2023-07-18T15:54:20.2407238Z     libgcc-ng:                            13.1.0-he5830b7_0         conda-forge
2023-07-18T15:54:20.2407839Z     libgomp:                              13.1.0-he5830b7_0         conda-forge
2023-07-18T15:54:20.2408397Z     libiconv:                             1.17-h166bdaf_0           conda-forge
2023-07-18T15:54:20.2408931Z     libidn2:                              2.3.4-h166bdaf_0          conda-forge
2023-07-18T15:54:20.2409645Z     libnghttp2:                           1.52.0-h61bc06f_0         conda-forge
2023-07-18T15:54:20.2410170Z     libnsl:                               2.0.0-h7f98852_0          conda-forge
2023-07-18T15:54:20.2411341Z     libprotobuf:                          3.20.3-h3eb15da_0         conda-forge
2023-07-18T15:54:20.2411893Z     libsanitizer:                         12.3.0-h0f45ef3_0         conda-forge
2023-07-18T15:54:20.2412423Z     libsqlite:                            3.42.0-h2797004_0         conda-forge
2023-07-18T15:54:20.2412964Z     libssh2:                              1.11.0-h0841786_0         conda-forge
2023-07-18T15:54:20.2413493Z     libstdcxx-devel_linux-64:             12.3.0-h8bca6fd_0         conda-forge
2023-07-18T15:54:20.2414046Z     libstdcxx-ng:                         13.1.0-hfd8a6a1_0         conda-forge
2023-07-18T15:54:20.2414585Z     libunistring:                         0.9.10-h7f98852_0         conda-forge
2023-07-18T15:54:20.2415099Z     libuuid:                              2.38.1-h0b41bf4_0         conda-forge
2023-07-18T15:54:20.2415627Z     libuv:                                1.44.2-h166bdaf_0         conda-forge
2023-07-18T15:54:20.2416157Z     libzlib:                              1.2.13-hd590300_5         conda-forge
2023-07-18T15:54:20.2416697Z     ncurses:                              6.4-hcb278e6_0            conda-forge
2023-07-18T15:54:20.2417412Z     ninja:                                1.11.1-h924138e_0         conda-forge
2023-07-18T15:54:20.2418047Z     openssl:                              3.1.1-hd590300_1          conda-forge
2023-07-18T15:54:20.2418588Z     pcre2:                                10.40-hc3806b6_0          conda-forge
2023-07-18T15:54:20.2419111Z     perl:                                 5.32.1-4_hd590300_perl5   conda-forge
2023-07-18T15:54:20.2419651Z     pkg-config:                           0.29.2-h36c2ea0_1008      conda-forge
2023-07-18T15:54:20.2420180Z     python:                               3.11.4-hab00c5b_0_cpython conda-forge
2023-07-18T15:54:20.2420722Z     readline:                             8.2-h8228510_1            conda-forge
2023-07-18T15:54:20.2421290Z     rhash:                                1.4.3-h166bdaf_0          conda-forge
2023-07-18T15:54:20.2421831Z     sysroot_linux-64:                     2.17-h4a8ded7_13          conda-forge
2023-07-18T15:54:20.2422370Z     tk:                                   8.6.12-h27826a3_0         conda-forge
2023-07-18T15:54:20.2422883Z     tzdata:                               2023c-h71feb2d_0          conda-forge
2023-07-18T15:54:20.2423537Z     wget:                                 1.20.3-ha35d2d1_1         conda-forge
2023-07-18T15:54:20.2424050Z     xz:                                   5.2.6-h166bdaf_0          conda-forge
2023-07-18T15:54:20.2424585Z     zlib:                                 1.2.13-hd590300_5         conda-forge
2023-07-18T15:54:20.2425109Z     zstd:                                 1.5.2-hfc55251_7          conda-forge

Environment info

conda-forge CI

user-agent : conda/23.3.1 requests/2.31.0 CPython/3.10.12 Linux/5.15.0-1041-azure centos/7.9.2009 glibc/2.17

LinkError When Installing cudatoolkit-dev

Comment:

I install cudatoolkit-dev in a Windows environment, but I keep getting connection errors, whether I install with Conda or Mamba
ERROR conda.core.link:_execute(745): An error occurred while installing package 'conda-forge::cudatoolkit-dev-11.7.0-hab45a8e_5'. Rolling back transaction: done class: LinkError message: post-link script failed for package conda-forge::cudatoolkit-dev-11.7.0-hab45a8e_5 location of failed script: C:\Users\-\anaconda3\envs\adop_windows\Scripts\.cudatoolkit-dev-post-link.bat
I haven't found a solution to the problem, please help me.Thanks！！！

Segmentation fault on non-root installation

• I read the conda-forge documentation and could not find the solution for my problem there.

Issue: cudatoolkit-dev throws segmentation fault then aborts, on non-root installation at post-link step. Full error log is as followings:

Collecting package metadata (current_repodata.json): done
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /home/jnooree/anaconda3/envs/test

  added / updated specs:
    - cudatoolkit-dev=11.1
    - python=3.9


The following NEW packages will be INSTALLED:

  _libgcc_mutex      conda-forge/linux-64::_libgcc_mutex-0.1-conda_forge
  _openmp_mutex      conda-forge/linux-64::_openmp_mutex-4.5-1_gnu
  ca-certificates    conda-forge/linux-64::ca-certificates-2021.5.30-ha878542_0
  cudatoolkit-dev    conda-forge/linux-64::cudatoolkit-dev-11.1.1-py39h3811e60_0
  ld_impl_linux-64   conda-forge/linux-64::ld_impl_linux-64-2.36.1-hea4e1c9_2
  libffi             conda-forge/linux-64::libffi-3.3-h58526e2_2
  libgcc-ng          conda-forge/linux-64::libgcc-ng-11.1.0-hc902ee8_8
  libgomp            conda-forge/linux-64::libgomp-11.1.0-hc902ee8_8
  libstdcxx-ng       conda-forge/linux-64::libstdcxx-ng-11.1.0-h56837e0_8
  ncurses            conda-forge/linux-64::ncurses-6.2-h58526e2_4
  openssl            conda-forge/linux-64::openssl-1.1.1l-h7f98852_0
  pip                conda-forge/noarch::pip-21.2.4-pyhd8ed1ab_0
  python             conda-forge/linux-64::python-3.9.7-h49503c6_0_cpython
  python_abi         conda-forge/linux-64::python_abi-3.9-2_cp39
  readline           conda-forge/linux-64::readline-8.1-h46c0cb4_0
  setuptools         conda-forge/linux-64::setuptools-58.0.3-py39hf3d152e_0
  sqlite             conda-forge/linux-64::sqlite-3.36.0-h9cd32fc_0
  tk                 conda-forge/linux-64::tk-8.6.11-h27826a3_1
  tzdata             conda-forge/noarch::tzdata-2021a-he74cb21_1
  wheel              conda-forge/noarch::wheel-0.37.0-pyhd8ed1ab_1
  xz                 conda-forge/linux-64::xz-5.2.5-h516909a_1
  zlib               conda-forge/linux-64::zlib-1.2.11-h516909a_1010


Proceed ([y]/n)?

Preparing transaction: done
Verifying transaction: done
Executing transaction: done
ERROR conda.core.link:_execute(699): An error occurred while installing package 'conda-forge::cudatoolkit-dev-11.1.1-py39h3811e60_0'.
Rolling back transaction: done

LinkError: post-link script failed for package conda-forge::cudatoolkit-dev-11.1.1-py39h3811e60_0
location of failed script: /home/jnooree/anaconda3/envs/test/bin/.cudatoolkit-dev-post-link.sh
==> script messages <==
<None>
==> script output <==
stdout: Log file not open.
Running Post installation
downloading https://developer.download.nvidia.com/compute/cuda/11.1.1/local_installers/cuda_11.1.1_455.32.00_linux.run to /home/jnooree/anaconda3/envs/fgpred/pkgs/cudatoolkit-dev/cuda_11.1.1_455.32.00_linux.run
Extracting on Linux

stderr: Segmentation fault (core dumped)
Traceback (most recent call last):
  File "/home/jnooree/anaconda3/envs/test/bin/cudatoolkit-dev-post-install.py", line 216, in <module>
    _main()
  File "/home/jnooree/anaconda3/envs/test/bin/cudatoolkit-dev-post-install.py", line 212, in _main
    extractor.extract()
  File "/home/jnooree/anaconda3/envs/test/bin/cudatoolkit-dev-post-install.py", line 124, in extract
    subprocess.run(cmd, env=os.environ.copy(), check=True)
  File "/home/jnooree/anaconda3/envs/test/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/home/jnooree/anaconda3/envs/test/pkgs/cudatoolkit-dev/cuda_11.1.1_455.32.00_linux.run', '--silent', '--toolkit', '--toolkitpath=/tmp/tmp09e_7h5l', '--override']' returned non-zero exit status 139.

return code: 1

()

In my other experiment, it succeed with administrator privileges.

Environment (conda list):

$ conda list

Nothing. It was fresh installed via conda create -c conda-forge -n test python=3.9 cudatoolkit-dev=11.1

Details about conda and system ( conda info ):

$ conda info

     active environment : None
            shell level : 0
       user config file : /home/jnooree/.condarc
 populated config files : /home/jnooree/.condarc
          conda version : 4.10.3
    conda-build version : not installed
         python version : 3.9.7.final.0
       virtual packages : __linux=4.4.0=0
                          __glibc=2.23=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : /home/jnooree/anaconda3  (writable)
      conda av data dir : /home/jnooree/anaconda3/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/jnooree/anaconda3/pkgs
                          /home/jnooree/.conda/pkgs
       envs directories : /home/jnooree/anaconda3/envs
                          /home/jnooree/.conda/envs
               platform : linux-64
             user-agent : conda/4.10.3 requests/2.26.0 CPython/3.9.7 Linux/4.4.0-201-generic ubuntu/16.04.7 glibc/2.23
                UID:GID : 1027:500
             netrc file : /home/jnooree/.netrc
           offline mode : False