Update README.md
Browse files
README.md
CHANGED
|
@@ -38,6 +38,7 @@ With the utilization of [MonsterAPI](https://monsterapi.ai)'s [no-code LLM finet
|
|
| 38 |
- **Learning Rate:** 0.0001
|
| 39 |
- **Gradient Accumulation Steps:** 32
|
| 40 |
- **lora_alpha:** 128
|
|
|
|
| 41 |
|
| 42 |
#### Benchmarking Performance Details:
|
| 43 |
### Finetuned Gemma-2B using MonsterAPI achieved a **remarkable score of 20.02** on the GSM Plus benchmark.
|
|
|
|
| 38 |
- **Learning Rate:** 0.0001
|
| 39 |
- **Gradient Accumulation Steps:** 32
|
| 40 |
- **lora_alpha:** 128
|
| 41 |
+
- **lora_r:** 64
|
| 42 |
|
| 43 |
#### Benchmarking Performance Details:
|
| 44 |
### Finetuned Gemma-2B using MonsterAPI achieved a **remarkable score of 20.02** on the GSM Plus benchmark.
|