Langfuse
Is it possible to use tools calling and structured output in the Prompts UI and Playground? #3735
-
|
There is a "config" field but I can't find any information about how to use it. |
Beta Was this translation helpful? Give feedback.
Replies: 6 comments 7 replies
-
|
Yes, you can use tools calling and structured output in the Prompts UI by utilizing the "config" field. This field allows you to store structured data like model parameters, function/tool parameters, and JSON schemas. This data is versioned with the prompt, enabling flexible management and iteration without code changes or redeployment [1][2]. |
Beta Was this translation helpful? Give feedback.
-
|
When fetching a prompt via the SDKs, the config is available on the prompt object. |
Beta Was this translation helpful? Give feedback.
-
|
It would be super useful if non-devs could iterate on the prompts with e.g. Structured Output right in the playground. |
Beta Was this translation helpful? Give feedback.
-
|
That's right, structured output and tool calling is not yet available in the playground |
Beta Was this translation helpful? Give feedback.
-
|
Is this feature planned in the roadmap? Playground becomes less useful without:
|
Beta Was this translation helpful? Give feedback.
-
|
There are open idea threads for this, this is on the mid-term roadmap |
Beta Was this translation helpful? Give feedback.
-
|
While tools and structured outputs can now be executed in the Playground, I'm still having a very hard time understanding how to pass them as params in/with the SDKs... None of the support bots have been able to help, and there's no chatter about this neither on Discord nor on Github, just making the whole thing infuriating and frustrating... |
Beta Was this translation helpful? Give feedback.
-
|
Any updates ? This is a deal breaker sadly |
Beta Was this translation helpful? Give feedback.
-
|
Just ran into this. The reason I brought on langfuse is because I need to debug why my tool functions don't get called, and to test out various prompts to try to improve that success. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for the feedback everyone. Tool/functions/structured-output are now supported on the playground: https://langfuse.com/changelog/2025-03-28-tool-calling-structured-output-playground Support for prompt management is planned. |
Beta Was this translation helpful? Give feedback.
-
|
can we only use openai supported tools? why i got error message: Completion failed: Failed to parse LLM tool call result |
Beta Was this translation helpful? Give feedback.
-
|
We use Llama models and works great, no need for ClosedAI models. |
Beta Was this translation helpful? Give feedback.
When fetching a prompt via the SDKs, the config is available on the prompt object.