Comments (8)
Are you suggesting something like saving the compiled optimized json programs that DSPy creates to langfuse? (at your prompt management). Or something else? Can you give some more details of what you see happening?
Yes, after the dspy optimization prompt, I hope to be able to easily observe what changes have been made. In this way, we can do some comparisons and cost statistics.
Of course, we can also use a similar method
inspect_history
, but it would be better if there is a more intuitive management page to observe.Thank you for your reply.
from dspy.
Langfuse is a good prompt management project. I would like to know if dspy has plans to support langfuse. and I have written some code for this and am currently verifying them Thank you all🙏
Hi , @xucailiang I was still not able to see any traces of my azure model's cost on locally hosted langfuse dashboard
hi,The PR for integrating langfuse is under review by @arnavsinghvi11 and we are all looking forward to this feature!
from dspy.
Are you suggesting something like saving the compiled optimized json programs that DSPy creates to langfuse? (at your prompt management). Or something else? Can you give some more details of what you see happening?
from dspy.
That´s a good suggestion. On my side, I would want DSPy integration with Langfuse. That is, I want to see the calls that DSPy makes to LLM, grouped into traces and spans.
I see there was a PR for this: #200
from dspy.
That´s a good suggestion. On my side, I would want DSPy integration with Langfuse. That is, I want to see the calls that DSPy makes to LLM, grouped into traces and spans.
I see there was a PR for this: #200
I also noticed this PR, unfortunately,it was submitted on Oct 31, 2023, and has not been merged yet, dspy and langfuse have been updated for many versions.
So far, I have completed part of the code for chat_request
and completions_request
, If necessary, I will submit these changes and try to connect langfuse elsewhere.
from dspy.
Feel free to build on #200 @xucailiang (will need to be updated with latest DSPy and/or Langfuse changes) or open a new PR for this integration!
from dspy.
Feel free to build on #200 @xucailiang (will need to be updated with latest DSPy and/or Langfuse changes) or open a new PR for this integration!
As you said, I have submitted the relevant code, PR thank you everyone🙏
from dspy.
Langfuse is a good prompt management project. I would like to know if dspy has plans to support langfuse. and I have written some code for this and am currently verifying them Thank you all🙏
Hi , @xucailiang I was still not able to see any traces of my azure model's cost on locally hosted langfuse dashboard
from dspy.
Related Issues (20)
- Predictors with Ollama return input prompt in answer HOT 2
- Using TypedChainOfThough caused reasoning to be replaced by output schema
- How to view the optimized prompt ? HOT 1
- ReAct Fails on minimal Examples HOT 1
- max_tokens error for google's models HOT 2
- Improper response with multiple output fields HOT 3
- Field descriptions for individual items in a Pydantic model HOT 1
- Bootstrap temperature (0.7) overrides user temperature and LM temperature
- COPRO: doc fix
- Default top_p=1 everywhere. Why? HOT 1
- LlamaIndexRM returning Example with attribute `text` instead of `long_text`
- MIPRO compile ERROR HOT 1
- Integrate dspy with qwen 72B model
- KeyError: 'max_tokens'. HOT 1
- Integrating XML Validation Feedback into Optimization Processes
- How to handle Exceptions when calling Azure OpenAI model API
- HTTP_PROXY
- Getting dependency issues with Microsoft GraphRAG HOT 1
- QdrantRM do not support passages HOT 4
- Examples create legal risk
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dspy.