Update README.md

README.md

@@ -52,7 +52,7 @@ pipeline_tag: text-generation
 ---
 
 
-# Model Card for nano-phi-v0.1
+# Model Card for nano-phi-115M-v0.1
 
 Inspired by [Phi2](https://huggingface.co/microsoft/phi-2), and open source small language model attempts like [smol_llama-101M-GQA](https://huggingface.co/BEE-spoke-data/smol_llama-101M-GQA).  
 Pre-trained with training 7B token from scratch, with a high quality dataset of 0.6B token.  
@@ -60,6 +60,19 @@ It just took 2d 4h to train in Colab with a A100 40GB (~USD$ 100).
 It achieves quite competitive results in evaluation given its training token, and training data size.  
 No alignment has been done yet.  
 
+## Some metrics
+- model
+  - hidden_size: 768
+  - num_key_value_heads: 8 (grouped query attention)
+  - num_attention_heads: 24
+  - num_hidden_layers: 6
+  - context length: 1024
+  - total params: 115M
+- training:
+  - global steps: 14,000
+
+
+
 ## [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
 
 | Metric                | Value                     |