Update README.md
Browse files
README.md
CHANGED
@@ -3,8 +3,15 @@ license: mit
|
|
3 |
datasets:
|
4 |
- nbertagnolli/counsel-chat
|
5 |
---
|
6 |
-
|
|
|
|
|
|
|
7 |
|
|
|
|
|
|
|
|
|
8 |
In an era where mental health support is of paramount importance, A large language
|
9 |
model fine-tuned on mental health counseling conversations stands as a pioneering solution. This
|
10 |
approach aims to elevate natural language understanding and generation within the realm of mental
|
@@ -14,4 +21,23 @@ depression, stress, and more. The fine-tuning process incorporates ethical consi
|
|
14 |
concerns, and sensitivity to the nuances of mental health conversations. The resulting model will
|
15 |
demonstrate an intricate understanding of mental health issues and provide empathetic and
|
16 |
supportive responses, offering a valuable tool for individuals seeking guidance, mental health
|
17 |
-
professionals, and the broader healthcare community.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
datasets:
|
4 |
- nbertagnolli/counsel-chat
|
5 |
---
|
6 |
+
# MelloGPT
|
7 |
+
<p align="center">
|
8 |
+
<img width="150" height="150" src="https://raw.githubusercontent.com/steve-cse/mello/master/public/logo.png" alt="Logo">
|
9 |
+
</p>
|
10 |
|
11 |
+
**NOTE: This model should not be regarded as a replacement for professional mental health assistance. It is essential to seek support from qualified professionals for personalized and appropriate care.**
|
12 |
+
|
13 |
+
A fine tuned version of [Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) on [counsel-chat](https://huggingface.co/datasets/nbertagnolli/counsel-chat) dataset for mental health counseling conversations.
|
14 |
+
## Motivation
|
15 |
In an era where mental health support is of paramount importance, A large language
|
16 |
model fine-tuned on mental health counseling conversations stands as a pioneering solution. This
|
17 |
approach aims to elevate natural language understanding and generation within the realm of mental
|
|
|
21 |
concerns, and sensitivity to the nuances of mental health conversations. The resulting model will
|
22 |
demonstrate an intricate understanding of mental health issues and provide empathetic and
|
23 |
supportive responses, offering a valuable tool for individuals seeking guidance, mental health
|
24 |
+
professionals, and the broader healthcare community.
|
25 |
+
## Prompt Template
|
26 |
+
```
|
27 |
+
<s>[INST] {prompt} [/INST]
|
28 |
+
```
|
29 |
+
## Quantized Model
|
30 |
+
The quantized model can be found [here](https://huggingface.co/TheBloke/MelloGPT-GGUF). Thanks to [@TheBloke](https://huggingface.co/TheBloke).
|
31 |
+
|
32 |
+
## Contributions
|
33 |
+
This project is open for contributions. Feel free to use the community tab.
|
34 |
+
|
35 |
+
## Inspiration
|
36 |
+
This project was inspired by the project(s) listed below:
|
37 |
+
|
38 |
+
[companion_cube](https://huggingface.co/KnutJaegersberg/companion_cube_ggml) by [@KnutJaegersberg](https://huggingface.co/KnutJaegersberg)
|
39 |
+
|
40 |
+
## Credits
|
41 |
+
This is my first attempt at fine-tuning a large language model. It wouldn't be possible without [Axolotl](https://github.com/OpenAccess-AI-Collective/axolotl) and [Runpod](runpod.io). The axolotl config file can be found [here](https://github.com/steve-cse/mello/blob/master/mello.yml).
|
42 |
+
|
43 |
+
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|