teknium commited on
Commit
9206f0f
·
1 Parent(s): 74edb1a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -69,6 +69,14 @@ GPT-4All Benchmark Set
69
  Average: 0.679
70
  ```
71
 
 
 
 
 
 
 
 
 
72
  ## Training procedure
73
 
74
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6317aade83d8d2fd903192d9/Vzy7Z4Qcwj4hGJcQ2BT20.png)
 
69
  Average: 0.679
70
  ```
71
 
72
+ TruthfulQA:
73
+ ```
74
+ hf-causal-experimental (pretrained=teknium/OpenHermes-7B,dtype=float16), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
75
+ | Task |Version|Metric|Value | |Stderr|
76
+ |-------------|------:|------|-----:|---|-----:|
77
+ |truthfulqa_mc| 1|mc2 |0.4542|± |0.0148|
78
+ ```
79
+
80
  ## Training procedure
81
 
82
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6317aade83d8d2fd903192d9/Vzy7Z4Qcwj4hGJcQ2BT20.png)