dan,cztomsik

dan's People

Contributors

Stargazers

Watchers

dan's Issues

Metal broken

There's PR here and it should work but unfortunately, it fails during the metal compilation.

ggml_metal_init: allocating
ggml_metal_init: using MPS
ggml_metal_init: loading '/Users/cztomsik/Desktop/dan/zig-out/bin/ggml-metal.metal'
ggml_metal_init: error: Error Domain=MTLLibraryErrorDomain Code=3 "program_source:24:5: error: use of undeclared identifier 'assert'
    assert(k % qk == 0);
    ^
program_source:44:5: error: use of undeclared identifier 'assert'
    assert(k % qk == 0);
    ^
program_source:84:9: error: invalid type 'const constant int64_t &' (aka 'const constant long &') for buffer declaration
        constant   int64_t & ne00,
        ^~~~~~~~~~~~~~~~~~~~~~~~~
program_source:84:20: note: type 'int64_t' (aka 'long') cannot be used in buffer pointee type
        constant   int64_t & ne00,
                   ^
program_source:126:9: error: invalid type 'const constant int64_t &' (aka 'const constant long &') for buffer declaration
        constant   int64_t & ne00,
        ^~~~~~~~~~~~~~~~~~~~~~~~~
program_source:126:20: note: type 'int64_t' (aka 'long') cannot be used in buffer pointee type
        constant   int64_t & ne00,
                   ^
program_source:127:9: error: invalid type 'const constant int64_t &' (aka 'const constant long &') for buffer declaration
        constant   int64_t & ne01,

It's super-weird because I'm using exactly the same code as the original C++ impl, and it's compiled in runtime so it should work.

I've also checked with DYLD_PRINT_LIBRARIES=1 and they are the same...

Recommend Projects