Update README.md
Browse files
README.md
CHANGED
|
@@ -61,7 +61,7 @@ print(response)
|
|
| 61 |
## That sounds like a great quality to have! A love for adventure can lead to exciting experiences and personal growth. What kind of adventures does she enjoy? Does she like exploring new places, trying new activities, or seeking out thrilling experiences? Knowing more about her interests can help suggest specific ideas or activities that might appeal to her adventurous spirit.
|
| 62 |
|
| 63 |
prompt = "9.11和9.8哪个数字大"
|
| 64 |
-
##
|
| 65 |
## 9.11比9.8大。因为9.11 = 9 + 0.11，而9.8 = 9 + 0.8，0.11比0.8小，所以9.11 > 9.8。但是，实际上9.11和9.8的大小比较是基于它们的小数部分，9.11的小数部分0.11大于9.8的小数部分0.8，因此9.11大于9.8。
|
| 66 |
|
| 67 |
##BF16:
|
|
@@ -75,7 +75,7 @@ prompt = "9.11和9.8哪个数字大"
|
|
| 75 |
## 因此，9.8 大于 9.11。
|
| 76 |
|
| 77 |
prompt = "Once upon a time,"
|
| 78 |
-
##
|
| 79 |
## Once upon a time, in a land far, far away, there was a magical kingdom. This kingdom was known for its vast forests, rolling hills, and a grand castle that stood at the center. The people of this kingdom lived in peace and prosperity, but one day, a dark cloud began to loom over their land.
|
| 80 |
## A powerful sorcerer, who had once been a friend to the king, had turned against the kingdom. He sought to take control and rule with an iron fist. The king, along with his loyal advisors and brave knights, set out to stop the sorcerer and protect their people.
|
| 81 |
## The story of their journey, filled with adventure, courage, and friendship, is one that has been told and retold for generations. It is a tale of heroes and villains, of love and sacrifice, and of the unyielding spirit of those who stand up for what is right.
|
|
@@ -88,7 +88,7 @@ prompt = "Once upon a time,"
|
|
| 88 |
## Princess Elara, determined to help, decided to venture into the forest herself. Her father was hesitant, but he saw the determination in her eyes and knew
|
| 89 |
|
| 90 |
prompt = "请简短介绍一下阿里巴巴公司"
|
| 91 |
-
##
|
| 92 |
## 阿里巴巴（Alibaba）是一家中国的 multinational technology company headquartered in Hangzhou, Zhejiang, China. It was founded in 1999 by former English teacher Jack Ma and his partners. Alibaba is best known for its e-commerce platforms such as Taobao, Tmall, and AliExpress, but it also has extensive business interests in areas like cloud computing, artificial intelligence, and financial services. The company is one of the largest and most valuable in the world, and it has played a significant role in the growth of China's internet economy.
|
| 93 |
|
| 94 |
##BF16:
|
|
@@ -105,7 +105,7 @@ pip3 install lm-eval==0.4.5
|
|
| 105 |
auto-round --model "OPEA/Qwen2.5-72B-Instruct-int2-sym-inc" --eval --eval_bs 16 --tasks leaderboard_ifeval,leaderboard_mmlu_pro,gsm8k,lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,cmmlu,ceval-valid
|
| 106 |
```
|
| 107 |
|
| 108 |
-
| Metric | BF16 |
|
| 109 |
| :----------------------------------------- | :----: | :----: |
|
| 110 |
| Avg | 0.7413 | 0.6835 |
|
| 111 |
| leaderboard_mmlu_pro 5 shots | 0.5919 | 0.4602 |
|
|
|
|
| 61 |
## That sounds like a great quality to have! A love for adventure can lead to exciting experiences and personal growth. What kind of adventures does she enjoy? Does she like exploring new places, trying new activities, or seeking out thrilling experiences? Knowing more about her interests can help suggest specific ideas or activities that might appeal to her adventurous spirit.
|
| 62 |
|
| 63 |
prompt = "9.11和9.8哪个数字大"
|
| 64 |
+
##INT2:
|
| 65 |
## 9.11比9.8大。因为9.11 = 9 + 0.11，而9.8 = 9 + 0.8，0.11比0.8小，所以9.11 > 9.8。但是，实际上9.11和9.8的大小比较是基于它们的小数部分，9.11的小数部分0.11大于9.8的小数部分0.8，因此9.11大于9.8。
|
| 66 |
|
| 67 |
##BF16:
|
|
|
|
| 75 |
## 因此，9.8 大于 9.11。
|
| 76 |
|
| 77 |
prompt = "Once upon a time,"
|
| 78 |
+
##INT2:
|
| 79 |
## Once upon a time, in a land far, far away, there was a magical kingdom. This kingdom was known for its vast forests, rolling hills, and a grand castle that stood at the center. The people of this kingdom lived in peace and prosperity, but one day, a dark cloud began to loom over their land.
|
| 80 |
## A powerful sorcerer, who had once been a friend to the king, had turned against the kingdom. He sought to take control and rule with an iron fist. The king, along with his loyal advisors and brave knights, set out to stop the sorcerer and protect their people.
|
| 81 |
## The story of their journey, filled with adventure, courage, and friendship, is one that has been told and retold for generations. It is a tale of heroes and villains, of love and sacrifice, and of the unyielding spirit of those who stand up for what is right.
|
|
|
|
| 88 |
## Princess Elara, determined to help, decided to venture into the forest herself. Her father was hesitant, but he saw the determination in her eyes and knew
|
| 89 |
|
| 90 |
prompt = "请简短介绍一下阿里巴巴公司"
|
| 91 |
+
##INT2:
|
| 92 |
## 阿里巴巴（Alibaba）是一家中国的 multinational technology company headquartered in Hangzhou, Zhejiang, China. It was founded in 1999 by former English teacher Jack Ma and his partners. Alibaba is best known for its e-commerce platforms such as Taobao, Tmall, and AliExpress, but it also has extensive business interests in areas like cloud computing, artificial intelligence, and financial services. The company is one of the largest and most valuable in the world, and it has played a significant role in the growth of China's internet economy.
|
| 93 |
|
| 94 |
##BF16:
|
|
|
|
| 105 |
auto-round --model "OPEA/Qwen2.5-72B-Instruct-int2-sym-inc" --eval --eval_bs 16 --tasks leaderboard_ifeval,leaderboard_mmlu_pro,gsm8k,lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,cmmlu,ceval-valid
|
| 106 |
```
|
| 107 |
|
| 108 |
+
| Metric | BF16 | INT2 |
|
| 109 |
| :----------------------------------------- | :----: | :----: |
|
| 110 |
| Avg | 0.7413 | 0.6835 |
|
| 111 |
| leaderboard_mmlu_pro 5 shots | 0.5919 | 0.4602 |
|