TheDrummer/Big-Tiger-Gemma-27B-v1-GGUF
Updated
ā¢
2.29k
ā¢
61
Andrey
DIvAndrey
AI & ML interests
None yet
Recent Activity
liked
a model
about 2 months ago
TheDrummer/Big-Tiger-Gemma-27B-v1-GGUF
Organizations
None yet
DIvAndrey's activity
liked
a
model
about 2 months ago
reacted to
jeffboudier's
post with š„
4 months ago
Post
4038
Pro Tip - if you're a Firefox user, you can set up Hugging Chat as integrated AI Assistant, with contextual links to summarize or simplify any text - handy!
In this short video I show how to set it up
In this short video I show how to set it up
- 3 replies
liked
4
models
4 months ago
reacted to
singhsidhukuldeep's
post with š„
4 months ago
Post
1897
Google's Chain-of-Thought (CoT) is one of the most effective ways to improve LLMs' reasoning.
Researchers have now developed a novel approach called Strategic Chain-of-Thought (SCoT) to enhance the reasoning capabilities of large language models even further.
š§ SCoT uses a two-stage process within a single prompt:
- Strategy Elicitation: The model first identifies and determines an effective problem-solving strategy for the given task. This becomes the strategic knowledge that guides the reasoning process.
- Strategy Application: The model then applies the identified strategic knowledge to solve the problem and generate the final answer.
Essentially, SCoT integrates strategic knowledge to guide reasoning without relying on external knowledge sources or multiple queries.
According to the research, SCoT showed significant improvements over standard CoT across various datasets, including a 21.05% increase on the GSM8K math dataset and a 24.13% increase on the Tracking_Objects spatial reasoning task.
Changes in the Prompt Structure:
The SCoT prompt typically consists of five components:
- Role: Defines the expert role the model should assume.
- Workflow: Outlines the steps for strategy identification and application.
- Rules: Specifies guidelines for generating answers.
- Initialization: Sets up the task.
- Task Input: Provides the specific problem to solve.
Strategy Generation:
The model is prompted to generate strategic knowledge relevant to the problem domain. For example, in mathematics, it might favor elegant solutions like using arithmetic series formulas over brute-force calculations.
Guided Reasoning:
Using the elicited strategy, the model then generates a chain-of-thought reasoning path. This approach aims to produce more stable and higher-quality outputs compared to standard chain-of-thought methods.
Read the full paper: https://arxiv.org/abs/2409.03271
Researchers have now developed a novel approach called Strategic Chain-of-Thought (SCoT) to enhance the reasoning capabilities of large language models even further.
š§ SCoT uses a two-stage process within a single prompt:
- Strategy Elicitation: The model first identifies and determines an effective problem-solving strategy for the given task. This becomes the strategic knowledge that guides the reasoning process.
- Strategy Application: The model then applies the identified strategic knowledge to solve the problem and generate the final answer.
Essentially, SCoT integrates strategic knowledge to guide reasoning without relying on external knowledge sources or multiple queries.
According to the research, SCoT showed significant improvements over standard CoT across various datasets, including a 21.05% increase on the GSM8K math dataset and a 24.13% increase on the Tracking_Objects spatial reasoning task.
Changes in the Prompt Structure:
The SCoT prompt typically consists of five components:
- Role: Defines the expert role the model should assume.
- Workflow: Outlines the steps for strategy identification and application.
- Rules: Specifies guidelines for generating answers.
- Initialization: Sets up the task.
- Task Input: Provides the specific problem to solve.
Strategy Generation:
The model is prompted to generate strategic knowledge relevant to the problem domain. For example, in mathematics, it might favor elegant solutions like using arithmetic series formulas over brute-force calculations.
Guided Reasoning:
Using the elicited strategy, the model then generates a chain-of-thought reasoning path. This approach aims to produce more stable and higher-quality outputs compared to standard chain-of-thought methods.
Read the full paper: https://arxiv.org/abs/2409.03271
- 1 reply
liked
a
model
4 months ago
liked
a
dataset
4 months ago
liked
a
model
4 months ago
liked
a
dataset
4 months ago
liked
3
models
4 months ago
liked
2
models
5 months ago
liked
2
datasets
5 months ago
liked
2
models
5 months ago
