benhaotang
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -14,6 +14,69 @@ datasets:
|
|
14 |
This model was converted to GGUF format from [`benhaotang/phi4-qwq-sky-t1`](https://huggingface.co/benhaotang/phi4-qwq-sky-t1) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
15 |
Refer to the [original model card](https://huggingface.co/benhaotang/phi4-qwq-sky-t1) for more details on the model.
|
16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
## Use with llama.cpp
|
18 |
Install llama.cpp through brew (works on Mac and Linux)
|
19 |
|
|
|
14 |
This model was converted to GGUF format from [`benhaotang/phi4-qwq-sky-t1`](https://huggingface.co/benhaotang/phi4-qwq-sky-t1) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
15 |
Refer to the [original model card](https://huggingface.co/benhaotang/phi4-qwq-sky-t1) for more details on the model.
|
16 |
|
17 |
+
## Use with ollama
|
18 |
+
|
19 |
+
```go
|
20 |
+
FROM ./phi4-qwq-sky-t1-Q6_K-GGUF/phi4-qwq-sky-t1-q6_k.gguf
|
21 |
+
TEMPLATE """{{- range $i, $_ := .Messages }}
|
22 |
+
{{- $last := eq (len (slice $.Messages $i)) 1 -}}
|
23 |
+
<|im_start|>{{ .Role }}<|im_sep|>
|
24 |
+
{{ .Content }}{{ if not $last }}<|im_end|>
|
25 |
+
{{ end }}
|
26 |
+
{{- if and (ne .Role "assistant") $last }}<|im_end|>
|
27 |
+
<|im_start|>assistant<|im_sep|>
|
28 |
+
{{ end }}
|
29 |
+
{{- end }}"""
|
30 |
+
PARAMETER stop <|im_start|>
|
31 |
+
PARAMETER stop <|im_end|>
|
32 |
+
PARAMETER stop <|im_sep|>
|
33 |
+
PARAMETER num_ctx 16384
|
34 |
+
SYSTEM """Your role as an assistant involves thoroughly exploring questions through a systematic long thinking process before providing the final precise and accurate solutions. This requires engaging in a comprehensive cycle of analysis, summarizing, exploration, reassessment, reflection, backtracing, and iteration to develop well-considered thinking process.
|
35 |
+
|
36 |
+
Please structure your response into two main sections: Thought and Solution.
|
37 |
+
|
38 |
+
In the Thought section, detail your reasoning process using the specified format:
|
39 |
+
|
40 |
+
ββ
|
41 |
+
<|begin_of_thought|>
|
42 |
+
{thought with steps separated with "\n\n"}
|
43 |
+
<|end_of_thought|>
|
44 |
+
ββ
|
45 |
+
|
46 |
+
Each step should include detailed considerations such as analisying questions, summarizing relevant findings, brainstorming new ideas, verifying the accuracy of the current steps, refining any errors, and revisiting previous steps.
|
47 |
+
|
48 |
+
In the Solution section, based on various attempts, explorations, and reflections from the Thought section, systematically present the final solution that you deem correct. The solution should remain a logical, accurate, concise expression style and detail necessary step needed to reach the conclusion, formatted as follows:
|
49 |
+
ββ
|
50 |
+
<|begin_of_solution|>
|
51 |
+
{final formatted, precise, and clear solution}
|
52 |
+
<|end_of_solution|>
|
53 |
+
ββ
|
54 |
+
Now, try to solve the following question through the above guidelines:
|
55 |
+
"""
|
56 |
+
LICENSE """Microsoft.
|
57 |
+
Copyright (c) Microsoft Corporation.
|
58 |
+
|
59 |
+
MIT License
|
60 |
+
|
61 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
62 |
+
of this software and associated documentation files (the "Software"), to deal
|
63 |
+
in the Software without restriction, including without limitation the rights
|
64 |
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
65 |
+
copies of the Software, and to permit persons to whom the Software is
|
66 |
+
furnished to do so, subject to the following conditions:
|
67 |
+
|
68 |
+
The above copyright notice and this permission notice shall be included in all
|
69 |
+
copies or substantial portions of the Software.
|
70 |
+
|
71 |
+
THE SOFTWARE IS PROVIDED *AS IS*, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
72 |
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
73 |
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
74 |
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
75 |
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
76 |
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
77 |
+
SOFTWARE."""
|
78 |
+
```
|
79 |
+
|
80 |
## Use with llama.cpp
|
81 |
Install llama.cpp through brew (works on Mac and Linux)
|
82 |
|