llnl / apollo Goto Github PK

hey apollo team! I think it would be good to come up with a slightly tweaked description for the project, because it technically isn't online (incremental) learning. I was chatting in Mattermost with @davidbeckingsale about it. I don't know the project well enough to make a suggestion - but is it some kind of batch ML server perhaps?

I think this one would be pretty easy. Just add an "end" method to region that takes in a float/double. Instead of using the time the region took, use that float. It should be a user error if they call end with a value one time and not another in a Region.

Allow for regions to have tailored settings for such components as:

• training frequency
• re-training sensitivity
• tree-depth in the model

On an x86+V100 system, using CUDA 11.0 and the develop branch of Apollo (currently 917cd5e ), Apollo breaks when used as a Kokkos tool if HPCToolkit is in use (a spack install of it). The app was ExaMiniMD, but it should work with just about anything. There are five configurations:

1. ./the_application
2. KOKKOS_PROFILE_LIBRARY=/path/to/libapollo-tuner.so ./the_application
3. hpcrun ./the_application
4. KOKKOS_PROFILE_LIBRARY=/some/other/kokkos-tool.so hpcrun ./the_application
5. KOKKOS_PROFILE_LIBRARY=/path/to/libapollo-tuner.so hpcrun ./the_application

And every one of them works except number 5. Just bizarre.