Tool calling support in Gemma 2
I am waiting tool calling support in Gemma 2 to provide it with some grounding/context for help with my studies. It is already very useful without it but sometimes and very rarely it can hallucinate.
For tool calling, I suggest to have the chat template integrated in such a way so that it becomes easier for us to separate the action (i.e the tool calling json to be prefixed and suffixed with two single tokens which will be easier to capture and separate it). It would be even better if Gemma is allowed to have some sort of short "reasoning" on what tool to choose or not/how to respond before calling a tool/responding to a query.
All these things can be very easily integrated in the current chat template.
Thank you for providing these models for free!
Hi @qnixsynapse ,
Thank you for sharing your valuable feedback and suggestions.
You are welcome and likewise thank you for your response. Also, I wish to see this wholesome personality in future Gemma models. 😄
And happy new year!
Closing this discussion.