kokkos / ci-containers

Kokkos: Core Libraries

Kokkos Core implements a programming model in C++ for writing performance portable applications targeting all major HPC platforms. For that purpose it provides abstractions for both parallel execution of code and data management. Kokkos is designed to target complex node architectures with N-level memory hierarchies and multiple types of execution resources. It currently can use CUDA, HIP, SYCL, HPX, OpenMP and C++ threads as backend programming models with several other backends in development.

Kokkos Core is part of the Kokkos C++ Performance Portability Programming Ecosystem.

Kokkos is a Linux Foundation project.

Learning about Kokkos

To start learning about Kokkos:

• Kokkos Lectures: they contain a mix of lecture videos and hands-on exercises covering all the important capabilities.

• Programming guide: contains in "narrative" form a technical description of the programming model, machine model, and the main building blocks like the Views and parallel dispatch.

• API reference: organized by category, i.e., core, algorithms and containers or, if you prefer, in alphabetical order.

• Use cases and Examples: a serie of examples ranging from how to use Kokkos with MPI to Fortran interoperability.

Obtaining Kokkos

The latest release of Kokkos can be obtained from the GitHub releases page.

The current release is 4.3.00.

curl -OJ -L https://github.com/kokkos/kokkos/archive/refs/tags/4.3.00.tar.gz
# Or with wget
wget https://github.com/kokkos/kokkos/archive/refs/tags/4.3.00.tar.gz

To clone the latest development version of Kokkos from GitHub:

git clone -b develop  https://github.com/kokkos/kokkos.git

Building Kokkos

To build Kokkos, you will need to have a C++ compiler that supports C++17 or later. All requirements including minimum and primary tested compiler versions can be found here.

Building and installation instructions are described here.

You can also install Kokkos using Spack: spack install kokkos. Available configuration options can be displayed using spack info kokkos.

For the complete documentation: kokkos.org/kokkos-core-wiki/

Support

For questions find us on Slack: https://kokkosteam.slack.com or open a GitHub issue.

For non-public questions send an email to: crtrott(at)sandia.gov

Contributing

Please see this page for details on how to contribute.

Citing Kokkos

Please see the following page.

License

Under the terms of Contract DE-NA0003525 with NTESS, the U.S. Government retains certain rights in this software.

The full license statement used in all headers is available here or here.

ci-containers's Issues

fedora:latest + icpc: error: attribute "__malloc__" does not take arguments

For example, in https://github.com/kokkos/kokkos/runs/4141626740?check_suite_focus=true we are seeing

In file included from /usr/include/c++/11/cstdio(42),
                 from /__w/kokkos/kokkos/core/src/impl/Kokkos_CPUDiscovery.cpp(54):
/usr/include/stdio.h(183): error: attribute "__malloc__" does not take arguments
    __attribute_malloc__ __attr_dealloc_fclose __wur;
                         ^

In file included from /usr/include/c++/11/cstdio(42),
                 from /__w/kokkos/kokkos/core/src/impl/Kokkos_CPUDiscovery.cpp(54):
/usr/include/stdio.h(195): error: attribute "__malloc__" does not take arguments
     __attribute_malloc__ __attr_dealloc_fclose __wur;
                          ^

In file included from /usr/include/c++/11/cstdio(42),
                 from /__w/kokkos/kokkos/core/src/impl/Kokkos_CPUDiscovery.cpp(54):
/usr/include/stdio.h(217): error: attribute "__malloc__" does not take arguments
     __THROW __attribute_malloc__ __wur __attr_dealloc_free;
                                        ^

In file included from /usr/include/c++/11/cstdio(42),
                 from /__w/kokkos/kokkos/core/src/impl/Kokkos_CPUDiscovery.cpp(54):
/usr/include/stdio.h(254): error: attribute "__malloc__" does not take arguments
    __attribute_malloc__ __attr_dealloc_fclose __wur;
                         ^

In file included from /usr/include/c++/11/cstdio(42),
                 from /__w/kokkos/kokkos/core/src/impl/Kokkos_CPUDiscovery.cpp(54):
/usr/include/stdio.h(279): error: attribute "__malloc__" does not take arguments
    __attribute_malloc__ __attr_dealloc_fclose __wur;
                         ^

In file included from /usr/include/c++/11/cstdio(42),
                 from /__w/kokkos/kokkos/core/src/impl/Kokkos_CPUDiscovery.cpp(54):
/usr/include/stdio.h(288): error: attribute "__malloc__" does not take arguments
    __attribute_malloc__ __attr_dealloc_fclose __wur;
                         ^

In file included from /usr/include/c++/11/cstdio(42),
                 from /__w/kokkos/kokkos/core/src/impl/Kokkos_CPUDiscovery.cpp(54):
/usr/include/stdio.h(297): error: attribute "__malloc__" does not take arguments
    __attribute_malloc__ __attr_dealloc_fclose __wur;
                         ^

                 from /__w/kokkos/kokkos/tpls/gtest/gtest/gtest-all.cc(38):
/usr/include/stdio.h(297): error: attribute "__malloc__" does not take arguments
    __attribute_malloc__ __attr_dealloc_fclose __wur;
                         ^

In file included from /usr/include/c++/11/cstdio(42),
                 from /usr/include/c++/11/ext/string_conversions.h(43),
                 from /usr/include/c++/11/bits/basic_string.h(6607),
                 from /usr/include/c++/11/string(55),
                 from /usr/include/c++/11/bits/locale_classes.h(40),
                 from /usr/include/c++/11/bits/ios_base.h(41),
                 from /usr/include/c++/11/ios(42),
                 from /usr/include/c++/11/ostream(38),
                 from /__w/kokkos/kokkos/tpls/gtest/gtest/gtest.h(58),
                 from /__w/kokkos/kokkos/tpls/gtest/gtest/gtest-all.cc(38):
/usr/include/stdio.h(303): error: attribute "__malloc__" does not take arguments
    __THROW __attribute_malloc__ __attr_dealloc_fclose __wur;
                                 ^

In file included from /usr/include/c++/11/cstdio(42),
                 from /usr/include/c++/11/ext/string_conversions.h(43),
                 from /usr/include/c++/11/bits/basic_string.h(6607),
                 from /usr/include/c++/11/string(55),
                 from /usr/include/c++/11/bits/locale_classes.h(40),
                 from /usr/include/c++/11/bits/ios_base.h(41),
                 from /usr/include/c++/11/ios(42),
                 from /usr/include/c++/11/ostream(38),
                 from /__w/kokkos/kokkos/tpls/gtest/gtest/gtest.h(58),
                 from /__w/kokkos/kokkos/tpls/gtest/gtest/gtest-all.cc(38):
/usr/include/stdio.h(309): error: attribute "__malloc__" does not take arguments
    __attribute_malloc__ __attr_dealloc_fclose __wur;
                         ^

In file included from /usr/include/c++/11/cstdio(42),
                 from /usr/include/c++/11/ext/string_conversions.h(43),
                 from /usr/include/c++/11/bits/basic_string.h(6607),
                 from /usr/include/c++/11/string(55),
                 from /usr/include/c++/11/bits/locale_classes.h(40),
                 from /usr/include/c++/11/bits/ios_base.h(41),
                 from /usr/include/c++/11/ios(42),
                 from /usr/include/c++/11/ostream(38),
                 from /__w/kokkos/kokkos/tpls/gtest/gtest/gtest.h(58),
                 from /__w/kokkos/kokkos/tpls/gtest/gtest/gtest-all.cc(38):
/usr/include/stdio.h(316): error: attribute "__malloc__" does not take arguments
    __attribute_malloc__ __attr_dealloc_fclose;
                         ^

In file included from /usr/include/c++/11/cstdio(42),
                 from /usr/include/c++/11/ext/string_conversions.h(43),
                 from /usr/include/c++/11/bits/basic_string.h(6607),
                 from /usr/include/c++/11/string(55),
                 from /usr/include/c++/11/bits/locale_classes.h(40),
                 from /usr/include/c++/11/bits/ios_base.h(41),
                 from /usr/include/c++/11/ios(42),
                 from /usr/include/c++/11/ostream(38),
                 from /__w/kokkos/kokkos/tpls/gtest/gtest/gtest.h(58),
                 from /__w/kokkos/kokkos/tpls/gtest/gtest/gtest-all.cc(38):
/usr/include/stdio.h(824): error: attribute "__malloc__" does not take arguments
    __attribute_malloc__ __attr_dealloc (pclose, 1) __wur;
                         ^

compilation aborted for /__w/kokkos/kokkos/core/src/impl/Kokkos_CPUDiscovery.cpp (code 2)
gmake[2]: *** [core/src/CMakeFiles/kokkoscore.dir/build.make:76: core/src/CMakeFiles/kokkoscore.dir/impl/Kokkos_CPUDiscovery.cpp.o] Error 2
gmake[1]: *** [CMakeFiles/Makefile2:1658: core/src/CMakeFiles/kokkoscore.dir/all] Error 2
gmake[1]: *** Waiting for unfinished jobs....
compilation aborted for /__w/kokkos/kokkos/tpls/gtest/gtest/gtest-all.cc (code 2)
gmake[2]: *** [core/unit_test/CMakeFiles/kokkos_gtest.dir/build.make:76: core/unit_test/CMakeFiles/kokkos_gtest.dir/__/__/tpls/gtest/gtest/gtest-all.cc.o] Error 2
gmake[1]: *** [CMakeFiles/Makefile2:1934: core/unit_test/CMakeFiles/kokkos_gtest.dir/all] Error 2
gmake: *** [Makefile:146: all] Error 2
Error: Process completed with exit code 2

Looking at https://stackoverflow.com/questions/69404834/intel-compiler-fails-c14-check-with-attribute-malloc-does-not-take-argu there might be an issue with gcc-11 and icpc.

Build `kokkos` against `hpx` package in Fedora

          Can we test against the `hpx` package in Fedora as well?

Originally posted by @junghans in #38 (comment)

Install hpx-devel package in fedora container and test with HPX backend enabled.

Container deploy failed

From https://github.com/kokkos/ci-containers/actions/runs/3908560664

#11 exporting to image
#11 pushing layers 1.0s done
#11 ERROR: failed to push ghcr.io/kokkos/ci-containers/opensuse:latest: failed to copy: io: read/write on closed pipe
------
 > exporting to image:
------
ERROR: failed to solve: failed to push ghcr.io/kokkos/ci-containers/opensuse:latest: failed to copy: io: read/write on closed pipe
Error: buildx failed with: ERROR: failed to solve: failed to push ghcr.io/kokkos/ci-containers/opensuse:latest: failed to copy: io: read/write on closed pipe

I don't a 100% understand what the problem is.

`fedora:intel` image using `icpc` cannot compile C++17 code

This is already showing up in kokkos CI:

 In file included from /kokkos/cmake/compile_tests/cplusplus17.cpp(17):

  /usr/include/c++/13/type_traits(3363): error: identifier "__is_convertible"
  is undefined

      inline constexpr bool is_convertible_v = __is_convertible(_From, _To);
                                               ^

Looking at the compiler version, it doesn't seem like there was an update recently, maybe some other components 🤔

-- The CXX compiler identification is Intel 2021.10.0.20230609

Go back to F37 to fix kokkos CI

Looks like this broke our CI again, see https://github.com/kokkos/kokkos/actions/runs/5661994926/job/15341048991?pr=6200,

CMake Error at cmake/kokkos_test_cxx_std.cmake:91 (MESSAGE):
  C++17-compliant compiler detected, but unable to compile C++17 or later
  program.  Verify that Intel:2021.10.0.20230609 is set up correctly (e.g.,
  check that correct library headers are being used).

  Failing output:

   Change Dir: '/__w/kokkos/kokkos/builddir/corner_cases/CMakeFiles/CMakeTmp'

  

  Run Build Command(s): /usr/bin/cmake -E env VERBOSE=1 /usr/bin/gmake -f
  Makefile cmTC_4c411/fast

  /usr/bin/gmake -f CMakeFiles/cmTC_4c411.dir/build.make
  CMakeFiles/cmTC_4c411.dir/build

  gmake[1]: Entering directory
  '/__w/kokkos/kokkos/builddir/corner_cases/CMakeFiles/CMakeTmp'

  Building CXX object CMakeFiles/cmTC_4c411.dir/cplusplus17.cpp.o

  /opt/intel/oneapi/compiler/latest/linux/bin/intel64/icpc -Werror
  -diag-disable=177,10441 -std=gnu++17 -MD -MT
  CMakeFiles/cmTC_4c411.dir/cplusplus17.cpp.o -MF
  CMakeFiles/cmTC_4c411.dir/cplusplus17.cpp.o.d -o
  CMakeFiles/cmTC_4c411.dir/cplusplus17.cpp.o -c
  /__w/kokkos/kokkos/cmake/compile_tests/cplusplus17.cpp

  In file included from
  /__w/kokkos/kokkos/cmake/compile_tests/cplusplus17.cpp(17):

  /usr/include/c++/13/type_traits(3363): error: type name is not allowed

      inline constexpr bool is_convertible_v = __is_convertible(_From, _To);
                                                                ^

  

  In file included from
  /__w/kokkos/kokkos/cmake/compile_tests/cplusplus17.cpp(17):

  /usr/include/c++/13/type_traits(3363): error: type name is not allowed

      inline constexpr bool is_convertible_v = __is_convertible(_From, _To);
                                                                       ^

  

  In file included from
  /__w/kokkos/kokkos/cmake/compile_tests/cplusplus17.cpp(17):

  /usr/include/c++/13/type_traits(3363): error: identifier "__is_convertible"
  is undefined

      inline constexpr bool is_convertible_v = __is_convertible(_From, _To);
                                               ^

  

  compilation aborted for
  /__w/kokkos/kokkos/cmake/compile_tests/cplusplus17.cpp (code 2)

  gmake[1]: *** [CMakeFiles/cmTC_4c411.dir/build.make:79:
  CMakeFiles/cmTC_4c411.dir/cplusplus17.cpp.o] Error 2

  gmake[1]: Leaving directory
  '/__w/kokkos/kokkos/builddir/corner_cases/CMakeFiles/CMakeTmp'

  gmake: *** [Makefile:127: cmTC_4c411/fast] Error 2



Call Stack (most recent call first):
  cmake/kokkos_tribits.cmake:202 (INCLUDE)
  CMakeLists.txt:226 (KOKKOS_SETUP_BUILD_ENVIRONMENT)


-- Configuring incomplete, errors occurred!
Error: Process completed with exit code 1.

Originally posted by @masterleinad in #39 (comment)

rawhide deploy currently broken

due to actions/runner-images#3812

undefined reference to `std::__failed_assertion() with icpc

I can reproduce this:

$ docker run -it ghcr.io/kokkos/ci-containers/fedora:intel /bin/bash
<in container>
$ cat exe.cpp
#include <vector>

int main ()
{
  std::vector<int> foo (3,100);
  std::vector<int> bar (5,200);
  foo.swap(bar);
  return 0;
}
$ icpc -g -std=c++14 exe.cpp
ld: /tmp/icpcKut7mX.o: in function `std::vector<int, std::allocator<int> >::swap(std::vector<int, std::allocator<int> >&)':
/usr/include/c++/11/bits/stl_vector.h:1483: undefined reference to `std::__failed_assertion()'