Inconsistent embeddings between LlamaCppEmbeddings and llama.cpp about langchain

[r3v1]

Finally, this bug is related to abetlen/llama-cpp-python#1288, downgrading to llama-cpp-python==0.2.55 fixes de issue

[r3v1]

Related issue on llama.cpp

Maybe it has to be some pooling_type parameter value in LlamaCpp object. However, the value 1 (mean) returns in error.

GGML_ASSERT: /tmp/pip-install-51da47p5/llama-cpp-python_a140e7d57e1a4b0cb6ef2bf4c1230991/vendor/llama.cpp/llama.cpp:11092: lctx.inp_mean
ptrace: Operación no permitida.
No stack.
The program is not being run.

[OKHand-Zy]

I meet same error
Mycode:

from langchain.embeddings import LlamaCppEmbeddings

llm = LlamaCppEmbeddings(model_path="./model/gte-qwen1.5-7b-instruct.Q6_K/gte-qwen1.5-7b-instruct.Q6_K.gguf")

text = "This is a test document."
print(llm.embed_query(text))

Error Message:

llama_print_timings:        load time =      99.15 ms
llama_print_timings:      sample time =       0.00 ms /     1 runs   (    0.00 ms per token,      inf tokens per second)
llama_print_timings: prompt eval time =      95.23 ms /     8 tokens (   11.90 ms per token,    84.00 tokens per second)
llama_print_timings:        eval time =       0.00 ms /     1 runs   (    0.00 ms per token,      inf tokens per second)
llama_print_timings:       total time =      99.32 ms /     9 tokens
Traceback (most recent call last):
  File "/root/RAG/ST/st-gte-Qwen1.5-7B-Q6.py", line 19, in <module>
    print(llm.embed_query(text))
  File "/root/miniconda3/envs/llama/lib/python3.10/site-packages/langchain_community/embeddings/llamacpp.py", line 126, in embed_query
    return list(map(float, embedding))
TypeError: float() argument must be a string or a real number, not 'list'