Vily1998
commited on
Commit
·
0eb243b
1
Parent(s):
d7102c3
first commit
Browse files- ._.gitattributes +0 -0
- Baichuan2-7B-Base/truthx_model.fold1.pt +3 -0
- Baichuan2-7B-Base/truthx_model.fold2.pt +3 -0
- Baichuan2-7B-Chat/truthx_model.fold1.pt +3 -0
- Baichuan2-7B-Chat/truthx_model.fold2.pt +3 -0
- Llama-2-7b-chat-hf/truthx_model.fold1.pt +3 -0
- Llama-2-7b-chat-hf/truthx_model.fold2.pt +3 -0
- Llama-2-7b-hf/truthx_model.fold1.pt +3 -0
- Llama-2-7b-hf/truthx_model.fold2.pt +3 -0
- Llama-7b-hf/truthx_model.fold1.pt +3 -0
- Llama-7b-hf/truthx_model.fold2.pt +3 -0
- Mistral-7B-Instruct-v0.1/truthx_model.fold1.pt +3 -0
- Mistral-7B-Instruct-v0.1/truthx_model.fold2.pt +3 -0
- Mistral-7B-Instruct-v0.2/truthx_model.fold1.pt +3 -0
- Mistral-7B-Instruct-v0.2/truthx_model.fold2.pt +3 -0
- Mistral-7B-v0.1/truthx_model.fold1.pt +3 -0
- Mistral-7B-v0.1/truthx_model.fold2.pt +3 -0
- README.md +16 -0
- alpaca-native/truthx_model.fold1.pt +3 -0
- alpaca-native/truthx_model.fold2.pt +3 -0
- chatglm3-6b-base/truthx_model.fold1.pt +3 -0
- chatglm3-6b-base/truthx_model.fold2.pt +3 -0
- chatglm3-6b/truthx_model.fold1.pt +3 -0
- chatglm3-6b/truthx_model.fold2.pt +3 -0
- vicuna-7b-v1.5/truthx_model.fold1.pt +3 -0
- vicuna-7b-v1.5/truthx_model.fold2.pt +3 -0
._.gitattributes
ADDED
Binary file (4.1 kB). View file
|
|
Baichuan2-7B-Base/truthx_model.fold1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a0ec95acafa61429455c3c05adc4ed37aed895d67789c6e8d6219736ea50d09f
|
3 |
+
size 143270939
|
Baichuan2-7B-Base/truthx_model.fold2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c59c53040241812e22c4dbd1323aa2a6b95e5c38f5655a31d1eaa847b642b45c
|
3 |
+
size 143270939
|
Baichuan2-7B-Chat/truthx_model.fold1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e00fbae2460190b0886547addcb11f3e2f52044d2302d14c7588af8dfb539cb9
|
3 |
+
size 143270939
|
Baichuan2-7B-Chat/truthx_model.fold2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1b6c9a10e6149d1db06f95dc5cda46e8d44bc00f9ec2b152d491f8bfdcb1ad5b
|
3 |
+
size 143270939
|
Llama-2-7b-chat-hf/truthx_model.fold1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bca7803bd2cec9f2a425436ac3baed9af8b5e263b854cce753199cc939946802
|
3 |
+
size 143270939
|
Llama-2-7b-chat-hf/truthx_model.fold2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:64a9642053fc8255a58b15fcf07a1ea2ab40c9b3b547ef0d8daeae2c8dbea7b1
|
3 |
+
size 143270939
|
Llama-2-7b-hf/truthx_model.fold1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:eb9df3f76e9dbc83253ec6d1e02a2b4dc08ff4b622c12980f1cf967e03db7cf2
|
3 |
+
size 143270939
|
Llama-2-7b-hf/truthx_model.fold2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:476a044aade7251809cfded0527c3a8efb67403b0843a9b189c051e70134fa4b
|
3 |
+
size 143270939
|
Llama-7b-hf/truthx_model.fold1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5162c5abd121876474a6955eefce193f436e0ff7ef259af4bcb3e6a53963763a
|
3 |
+
size 143270939
|
Llama-7b-hf/truthx_model.fold2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e477e4e9acc3812087e55f6cea29eab60a52038767089d770aff63dfbdda0fa6
|
3 |
+
size 143270939
|
Mistral-7B-Instruct-v0.1/truthx_model.fold1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:40ba921323f12a0c1f673242ed8ac573686d787eaa2093c9e38aedd497cac0ec
|
3 |
+
size 143270939
|
Mistral-7B-Instruct-v0.1/truthx_model.fold2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a99914bb26c899886315ab9c7bb69812d1f8f92054d6f6def43f8183daaac78e
|
3 |
+
size 143270939
|
Mistral-7B-Instruct-v0.2/truthx_model.fold1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0e3e5f836ab4285b8f3b91adfeec342587fa0c52643e03714b1cd0a2a4906fb0
|
3 |
+
size 143270939
|
Mistral-7B-Instruct-v0.2/truthx_model.fold2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9f165d5d5dd98e14a40793c2ca440e6c7f4f51ef6a3292db8ce8f2b6711d254a
|
3 |
+
size 143270939
|
Mistral-7B-v0.1/truthx_model.fold1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:df5a862987737151f6592c12d7034b2afa30b10e422a748134f8f090fefcc3c9
|
3 |
+
size 143270939
|
Mistral-7B-v0.1/truthx_model.fold2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:543795dcd10478373a3b26e7d84892808ce90c87925998f90d2b1b2ab2407a9d
|
3 |
+
size 143270939
|
README.md
CHANGED
@@ -1,3 +1,19 @@
|
|
1 |
---
|
2 |
license: gpl-3.0
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: gpl-3.0
|
3 |
---
|
4 |
+
|
5 |
+
# TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space
|
6 |
+
|
7 |
+
[Shaolei Zhang](), Tian Yu, Yang Feng*
|
8 |
+
|
9 |
+
|
10 |
+
TruthX is an inference-time method to elicit the truthfulness of LLMs by editing their internal representations in truthful space, thereby mitigating the hallucinations of LLMs. On the TruthfulQA benchmark, TruthX yields an average enhancement of 20% in truthfulness across various LLMs.
|
11 |
+
|
12 |
+
This repository provides TruthX models trained on a variety of LLMs:
|
13 |
+
- Llama-1-7B, Alpaca-7B
|
14 |
+
- Llama-2-7B, Llama-2-7B-Chat, Vicuna-7B-v1.5
|
15 |
+
- Mistral-7B-v0.1, Mistral-7B-Instruct-v0.1, Mistral-7B-Instruct-v0.2
|
16 |
+
- Baichuan2-7B-Base, Baichuan2-7B-Chat
|
17 |
+
- Chatglm3-6B-Base, Chatglm3-6B
|
18 |
+
|
19 |
+
Please refer to [GitHub repo](https://github.com/ictnlp/TruthX) for specific usage scripts.
|
alpaca-native/truthx_model.fold1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f6a19b45ccd99be2be025620703fe21ff9eed8d51281dbe9360143064bd7f331
|
3 |
+
size 143270939
|
alpaca-native/truthx_model.fold2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:92ead75cb338c2d514084d7854eb0f1639c2d21118e0483aa964feec3ac9a7ac
|
3 |
+
size 143270939
|
chatglm3-6b-base/truthx_model.fold1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7a2080a64db2c433ab8744b82eb93626a95230f36c8539d31d2ffb1a095512c4
|
3 |
+
size 143205403
|
chatglm3-6b-base/truthx_model.fold2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:48095f0903a3aae7310cd84e3a926d8fac842127d7537afea393041ec0790f7e
|
3 |
+
size 143205403
|
chatglm3-6b/truthx_model.fold1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ee3fd1bf564a5d96404bb7335b0d4bce95a33660b53b068f9bb8715c04afacec
|
3 |
+
size 143205403
|
chatglm3-6b/truthx_model.fold2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:37c854e231e043743aa1235cfdf00cc1a91cdc3c55e6c457b77793e3687812eb
|
3 |
+
size 143205403
|
vicuna-7b-v1.5/truthx_model.fold1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5f0631cb9bf3842b76e7334be8303651a351abb5d6eec0dacb7a3fdb68a05a95
|
3 |
+
size 143270939
|
vicuna-7b-v1.5/truthx_model.fold2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a1e7eebe14d89f924ce3edf1b09bec7bbce43f14771a37e6a7a5e88c98dc70fe
|
3 |
+
size 143270939
|