Comments (3)
delip
commented on July 22, 2024
The fix for this is trivial. It involves changing this import line to this:
from langchain.vectorstores.faiss import FAISSHowever, doing this surfaces another test failure:
tests/integration_tests/test_faiss.py .. [ 12%]
tests/integration_tests/chains/test_react.py F [ 18%]
tests/integration_tests/chains/test_self_ask_with_search.py F [ 25%]
tests/integration_tests/chains/test_serpapi.py F [ 31%]
tests/integration_tests/chains/test_sql_database.py F [ 37%]
tests/integration_tests/embeddings/test_huggingface.py Fatal Python error: Aborted
Current thread 0x00000002031512c0 (most recent call first):
File "<frozen importlib._bootstrap>", line 228 in _call_with_frames_removed
File "<frozen importlib._bootstrap_external>", line 1173 in create_module
File "<frozen importlib._bootstrap>", line 565 in module_from_spec
....
File "/Users/delip/opt/anaconda3/bin/pytest", line 11 in <module>
make: *** [integration_tests] Abort trap: 6
I was able to reproduce this behavior in iPython. As of now, I cannot instantiate HuggingFaceEmbeddings object, and I don't yet know why.
Python 3.9.12 (main, Apr 5 2022, 01:53:17)
Type 'copyright', 'credits' or 'license' for more information
IPython 8.2.0 -- An enhanced Interactive Python. Type '?' for help.
In [1]: from langchain.embeddings.huggingface import HuggingFaceEmbeddings
In [2]: embedding = HuggingFaceEmbeddings()
Downloading: 100%|██████████████████████████| 1.18k/1.18k [00:00<00:00, 436kB/s]
Downloading: 100%|██████████████████████████████| 190/190 [00:00<00:00, 299kB/s]
Downloading: 100%|█████████████████████████| 10.6k/10.6k [00:00<00:00, 4.76MB/s]
Downloading: 100%|██████████████████████████████| 571/571 [00:00<00:00, 199kB/s]
Downloading: 100%|█████████████████████████████| 116/116 [00:00<00:00, 42.8kB/s]
Downloading: 100%|█████████████████████████| 39.3k/39.3k [00:00<00:00, 2.52MB/s]
Downloading: 100%|███████████████████████████| 438M/438M [00:05<00:00, 82.1MB/s]
Downloading: 100%|███████████████████████████| 53.0/53.0 [00:00<00:00, 64.9kB/s]
Downloading: 100%|██████████████████████████████| 239/239 [00:00<00:00, 118kB/s]
Downloading: 100%|███████████████████████████| 466k/466k [00:00<00:00, 6.64MB/s]
Downloading: 100%|██████████████████████████████| 363/363 [00:00<00:00, 133kB/s]
Downloading: 100%|█████████████████████████| 13.1k/13.1k [00:00<00:00, 4.14MB/s]
Downloading: 100%|███████████████████████████| 232k/232k [00:00<00:00, 3.46MB/s]
Downloading: 100%|██████████████████████████████| 349/349 [00:00<00:00, 171kB/s]
[1] 76242 segmentation fault ipython
/Users/delip/opt/anaconda3/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d 'from langchain.
delip
commented on July 22, 2024
output from pip list
Package Version
----------------------------- --------------------
aiohttp 3.8.1
aiosignal 1.2.0
alabaster 0.7.12
anaconda-client 1.9.0
anaconda-navigator 2.1.4
anaconda-project 0.10.2
anyio 3.5.0
appdirs 1.4.4
applaunchservices 0.2.1
appnope 0.1.2
appscript 1.1.2
argon2-cffi 21.3.0
argon2-cffi-bindings 21.2.0
arrow 1.2.2
astroid 2.6.6
astropy 5.0.4
asttokens 2.0.5
async-timeout 4.0.1
atomicwrites 1.4.0
attrs 21.4.0
Automat 20.2.0
autopep8 1.6.0
Babel 2.9.1
backcall 0.2.0
backports.functools-lru-cache 1.6.4
backports.tempfile 1.0
backports.weakref 1.0.post1
bcrypt 3.2.0
beautifulsoup4 4.11.1
binaryornot 0.4.4
bitarray 2.4.1
bkcharts 0.2
black 19.10b0
bleach 4.1.0
blis 0.7.9
bokeh 2.4.2
boto3 1.21.32
botocore 1.24.32
Bottleneck 1.3.4
brotlipy 0.7.0
cachetools 4.2.2
catalogue 2.0.8
certifi 2021.10.8
cffi 1.15.0
chardet 4.0.0
charset-normalizer 2.0.4
click 8.0.4
cloudpickle 2.0.0
clyent 1.2.2
cohere 2.8.0
colorama 0.4.4
colorcet 2.0.6
conda 4.12.0
conda-build 3.21.8
conda-content-trust 0+unknown
conda-pack 0.6.0
conda-package-handling 1.8.1
conda-repo-cli 1.0.4
conda-token 0.3.0
conda-verify 3.4.2
confection 0.0.3
constantly 15.1.0
cookiecutter 1.7.3
cryptography 3.4.8
cssselect 1.1.0
cycler 0.11.0
cymem 2.0.7
Cython 0.29.28
cytoolz 0.11.0
daal4py 2021.5.0
dask 2022.2.1
datashader 0.13.0
datashape 0.5.4
debugpy 1.5.1
decorator 5.1.1
defusedxml 0.7.1
diff-match-patch 20200713
distributed 2022.2.1
docopt 0.6.2
docutils 0.17.1
elastic-transport 8.4.0
elasticsearch 8.5.0
emoji 2.2.0
emot 3.1
en-core-web-sm 3.4.1
entrypoints 0.4
et-xmlfile 1.1.0
executing 0.8.3
faiss-cpu 1.7.2
fastjsonschema 2.15.1
filelock 3.6.0
flake8 3.9.2
flake8-docstrings 1.6.0
Flask 1.1.2
fonttools 4.25.0
frozenlist 1.2.0
fsspec 2022.2.0
future 0.18.2
gensim 4.1.2
glob2 0.7
gmpy2 2.1.2
google-api-core 1.25.1
google-auth 1.33.0
google-cloud-core 1.7.1
google-cloud-storage 1.31.0
google-crc32c 1.1.2
google-resumable-media 1.3.1
google-search-results 2.4.1
googleapis-common-protos 1.53.0
greenlet 1.1.3
grpcio 1.42.0
h5py 3.6.0
HeapDict 1.0.1
holoviews 1.14.8
huggingface-hub 0.10.1
hvplot 0.7.3
hyperlink 21.0.0
idna 3.3
imagecodecs 2021.8.26
imageio 2.9.0
imagesize 1.3.0
importlib-metadata 4.11.3
incremental 21.3.0
inflection 0.5.1
iniconfig 1.1.1
intake 0.6.5
intervaltree 3.1.0
ipykernel 6.9.1
ipython 8.2.0
ipython-genutils 0.2.0
ipywidgets 7.6.5
isort 5.9.3
itemadapter 0.3.0
itemloaders 1.0.4
itsdangerous 2.0.1
jdcal 1.4.1
jedi 0.18.1
Jinja2 2.11.3
jinja2-time 0.2.0
jmespath 0.10.0
joblib 1.1.0
json5 0.9.6
jsonlines 3.1.0
jsonschema 4.4.0
jupyter 1.0.0
jupyter-client 6.1.12
jupyter-console 6.4.0
jupyter-core 4.9.2
jupyter-server 1.13.5
jupyterlab 3.3.2
jupyterlab-pygments 0.1.2
jupyterlab-server 2.10.3
jupyterlab-widgets 1.0.0
keyring 23.4.0
kiwisolver 1.3.2
langchain 0.0.10
langcodes 3.3.0
lazy-object-proxy 1.6.0
libarchive-c 2.9
llvmlite 0.38.0
locket 0.2.1
lxml 4.8.0
Markdown 3.3.4
MarkupSafe 2.0.1
matplotlib 3.5.1
matplotlib-inline 0.1.2
mccabe 0.6.1
mistune 0.8.4
mkl-fft 1.3.1
mkl-random 1.2.2
mkl-service 2.4.0
mock 4.0.3
mpmath 1.2.1
msgpack 1.0.2
multidict 5.2.0
multipledispatch 0.6.0
munkres 1.1.4
murmurhash 1.0.9
mypy 0.990
mypy-extensions 0.4.3
navigator-updater 0.2.1
nbclassic 0.3.5
nbclient 0.5.13
nbconvert 6.4.4
nbformat 5.3.0
nest-asyncio 1.5.5
networkx 2.7.1
nlpcloud 1.0.34
nltk 3.7
nose 1.3.7
notebook 6.4.8
numba 0.55.1
numexpr 2.8.1
numpy 1.21.5
numpydoc 1.2
olefile 0.46
openai 0.23.1
openpyxl 3.0.9
orjson 3.8.0
packaging 21.3
pandas 1.4.2
pandas-stubs 1.5.0.221012
pandocfilters 1.5.0
panel 0.13.0
param 1.12.0
parsel 1.6.0
parso 0.8.3
partd 1.2.0
pathspec 0.7.0
pathy 0.6.2
patsy 0.5.2
pep8 1.7.1
pexpect 4.8.0
pickleshare 0.7.5
Pillow 9.0.1
pip 21.2.4
pipreqs 0.4.11
pkginfo 1.8.2
playwright 1.27.1
plotly 5.6.0
pluggy 1.0.0
poyo 0.5.0
preshed 3.0.8
prometheus-client 0.13.1
prompt-toolkit 3.0.20
Protego 0.1.16
protobuf 3.19.1
psutil 5.8.0
ptyprocess 0.7.0
pure-eval 0.2.2
py 1.11.0
pyasn1 0.4.8
pyasn1-modules 0.2.8
pycodestyle 2.7.0
pycosat 0.6.3
pycparser 2.21
pyct 0.4.6
pycurl 7.44.1
pydantic 1.10.2
PyDispatcher 2.0.5
pydocstyle 6.1.1
pyee 8.1.0
pyerfa 2.0.0
pyflakes 2.3.1
Pygments 2.11.2
PyHamcrest 2.0.2
PyJWT 2.1.0
pylint 2.9.6
pyls-spyder 0.4.0
pyodbc 4.0.32
pyOpenSSL 21.0.0
pyparsing 3.0.4
pyrsistent 0.18.0
PySocks 1.7.1
pytest 7.1.1
pytest-dotenv 0.5.2
python-dateutil 2.8.2
python-dotenv 0.21.0
python-lsp-black 1.0.0
python-lsp-jsonrpc 1.0.0
python-lsp-server 1.2.4
python-slugify 5.0.2
python-snappy 0.6.0
pytz 2021.3
pyviz-comms 2.0.2
PyWavelets 1.3.0
PyYAML 6.0
pyzmq 22.3.0
QDarkStyle 3.0.2
qstylizer 0.1.10
QtAwesome 1.0.3
qtconsole 5.3.0
QtPy 2.0.1
queuelib 1.5.0
regex 2022.3.15
requests 2.27.1
requests-file 1.5.1
rope 0.22.0
rsa 4.7.2
Rtree 0.9.7
ruamel-yaml-conda 0.15.100
s3transfer 0.5.0
scikit-image 0.19.2
scikit-learn 1.0.2
scikit-learn-intelex 2021.20220215.132722
scipy 1.7.3
Scrapy 2.6.1
seaborn 0.11.2
Send2Trash 1.8.0
sentence-transformers 2.2.2
sentencepiece 0.1.97
service-identity 18.1.0
setuptools 61.2.0
sip 4.19.13
six 1.16.0
smart-open 5.2.1
sniffio 1.2.0
snowballstemmer 2.2.0
sortedcollections 2.1.0
sortedcontainers 2.4.0
soupsieve 2.3.1
spacy 3.4.2
spacy-legacy 3.0.10
spacy-loggers 1.0.3
Sphinx 4.4.0
sphinxcontrib-applehelp 1.0.2
sphinxcontrib-devhelp 1.0.2
sphinxcontrib-htmlhelp 2.0.0
sphinxcontrib-jsmath 1.0.1
sphinxcontrib-qthelp 1.0.3
sphinxcontrib-serializinghtml 1.1.5
spyder 5.1.5
spyder-kernels 2.1.3
SQLAlchemy 1.4.32
srsly 2.4.5
stack-data 0.2.0
statsmodels 0.13.2
sympy 1.10.1
tables 3.6.1
tabulate 0.8.9
TBB 0.2
tblib 1.7.0
tenacity 8.0.1
terminado 0.13.1
testpath 0.5.0
text-unidecode 1.3
textdistance 4.2.1
thinc 8.1.5
threadpoolctl 2.2.0
three-merge 0.1.1
tifffile 2021.7.2
tinycss 0.4
tldextract 3.2.0
tokenizers 0.13.2
toml 0.10.2
tomli 1.2.2
toolz 0.11.2
torch 1.13.0
torchvision 0.14.0
tornado 6.1
tqdm 4.64.0
traitlets 5.1.1
transformers 4.24.0
Twisted 22.2.0
typed-ast 1.4.3
typer 0.4.2
types-pytz 2022.5.0.0
typing_extensions 4.1.1
ujson 5.1.0
Unidecode 1.2.0
urllib3 1.26.9
w3lib 1.21.0
wasabi 0.10.1
watchdog 2.1.6
wcwidth 0.2.5
webencodings 0.5.1
websocket-client 0.58.0
Werkzeug 2.0.3
wheel 0.37.1
widgetsnbextension 3.5.2
wikipedia 1.4.0
wrapt 1.12.1
wurlitzer 3.0.2
xarray 0.20.1
xlrd 2.0.1
XlsxWriter 3.0.3
xlwings 0.24.9
yapf 0.31.0
yarg 0.1.9
yarl 1.6.3
zict 2.0.0
zipp 3.7.0
zope.interface 5.4.0
from langchain.
hwchase17
commented on July 22, 2024
not 100% sure why this segfaults for you... works for me locally. gonna close this issue (since landed your pr) but open a different one to look into the segfault and fix the skip
from langchain.
Related Issues (20)
- [FEATURE REQUEST] langchain-openai - max_tokens (vs max_context?) ability to use full LLM contexts and account for user-messages automatically. HOT 2
- with_structured_output format depends on whether we're using pydantic proper or pydantic.v1 namespace HOT 2
- hunyuan message include chinese signature error
- DOC: <Issue related to /v0.2/docs/tutorials/sql_qa/> HOT 1
- ChatGoogleGenerativeAI does not support streaming HOT 2
- ChatHuggingFace using local model with HuggingFacePipeline wrongly checks for available inference endpoints HOT 7
- I am getting this error HOT 4
- Prepare for pydantic 2 migration by refactoring vanilla @root_validator() usage HOT 1
- DOC: <Issue related to /v0.2/docs/tutorials/rag/> HOT 11
- Add Document ID back to AzureSearch Documents HOT 1
- Spec out API for all required vs. all possible input variables HOT 1
- RedisChatMessageHistory encountering issues in Redis standalone mode on Windows.
- Standardize DocumentLoader docstrings and integration docs
- Standardize DocumentLoader docstrings and integration do HOT 1
- When using langchain-community, some PDF images will report errors during OCR
- [E:onnxruntime:Default, env.cc:228 ThreadMain] pthread_setaffinity_np failed for thread: 8353, index: 0, mask: {1, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
- RPC error: [create_index], <MilvusException: (code=1100, message=create index on 104 field is not supported: invalid parameter[expected=supported field][actual=create index on 104 field])>, <Time:{'RPC start': '2024-06-14 13:38:35.242645', 'RPC error': '2024-06-14 13:38:35.247294'}> HOT 1
- DOC: <Issue related to /v0.2/docs/integrations/chat/> Ollama JSON mode seems to be marked incorrectly as NO HOT 1
- MistralAI Extraction How-To (with examples) throws an error HOT 2
- Wrong spell in DOC: <Issue related to /v0.2/docs/how_to/streaming/>
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from langchain.