Comments (2)
Observations:
- When checked by enabling debug mode,
langchain_community.document_loaders.pebblo
is giving warning when it is timing out(timeout in code is 20 seconds).WARNING:langchain_community.document_loaders.pebblo:Unable to reach pebblo server.
- The logs also say that
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:8000
, this means that the connection is established with Pebblo Server and server has accepted the request. Note that, "Unable to reach pebblo server" is custom message which is misleading here. - The exception is raised when timeout of 20 seconds is reached and in parallel, Pebblo Server is finished processing request with it's speed few seconds later if the payload is larger and generating report.
Issue is not on the Pebblo Server side, its the way connection timeout is handled on Pebblo Safe Loader side.
from pebblo.
Below is the scenario when /loader/doc api server is busy classifying or generating report and pebblo langchain client waits for its response.
- Reduced timeout to 5 seconds: reduced processing time by half, the plugin will not really wait for the response. (Earlier loading time was ~30 secs now it takes 15 secs to finish the loading(On my machine.))
- Assumed pebblo-server and pebblo client relationship as async for now, hence changed warning logs to debug logs, this will suppress the unable to connect to pebblo server output and will now appear in debug mode.
@srics , can we reduce it even further? please share your thoughts.
PR: daxa-ai/langchain-rel-0.1.12#21
from pebblo.
Related Issues (20)
- OSError: cannot load library 'pango-1.0-0' HOT 2
- [Enhancement][Report]: Replace Runtime:local with OS:MAC/Linux HOT 1
- [Enhancement][Entity Classifier]: Enhance Entity Classifier using words context (Presidio) HOT 1
- Pebblo --help should not show empty progress bar HOT 1
- [Enhancement][Timezone, Topics and Entities][Report]: Separate findings for entity and topics
- [Enhancement] Support for Multiple Data Sources HOT 2
- Dockerize Pebblo HOT 2
- Anonymize document snippets in the report HOT 1
- [Enhancement]: Display Pebblo version and Pebblo client versions on JSON Schema and Reports
- [Enhancement] LlamaIndex support
- Linter for UI code
- [Refactor] Introduce sqlite-db based pebblo application state
- Add make command to format all/changed files
- Pebblo Safe Retriever details in Local UI HOT 1
- [Local UI] Add delete app
- Capture and display topic classification confidence score
- Improving field validation error for /v1/prompt API
- [Enhancement] LlamaIndex SafeRetriever support
- Local UI is not loading for host 0.0.0.0 and reports cannot be be downloaded
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pebblo.