zjunlp / knowledgecircuits Goto Github PK

Hi,

I ran your code and this gave me 100 circuits and a pickle file. I do not understand how I can detect from this which the best circuit is. Thanks!

When I run component.ipynb to analyse tinyllama, I encounter the following error:
transformer_lens/HookedTransformer.py", line 1838, in refactor_factored_attn_matrices self.cfg.positional_embedding_type != "rotary" AssertionError: You can't refactor the QK circuit when using rotary embeddings (as the QK matrix depends on the position of the query and key)

How should I analyse the experimental results of tinyllama? Thank you for your help.