OpenCL Implementation for Android about llama.rn

[Vali-98]

Likely not yet, I've heard word that many mobile GPUs still are not functional.

I will be closing this issue, as now its simply waiting until vulkan's mobile implementation is done.

[jhen0409]

In my understanding, not all Android devices supported OpenCL, for example the Google Pixel does not.

I think a better solution is to use Vulkan, which llama.cpp should support soon. But I think their support for iGPU is not enough (currently Vulkan features for Android devices are usually limited).

[Vali-98]

Though I would prefer a mature solution in OpenCL, Vulkan does seem to be a bit more future proofed. Perhaps this is simply some impatience from my end to have improved prompt processing, but Vulkan does seem to be a still far out. As it stands, some users for my project would also like to see improved processing on Android.

Granted, I am not the repo maintainer so your perspective on implementation is far more valid. I suppose I will continue working on a forked version to get opencl functional, thanks for the response.

[Ar57m]

vulkan is now merged, is it possible to bring for android as an option?