Hugging Face's logo

NickyNicky
/
StaticEmbedding-MatryoshkaLoss-gemma-2-2b-gooaq-en

Sentence Similarity
sentence-transformers
Safetensors
English
feature-extraction
Generated from Trainer
dataset_size:3012496
loss:MatryoshkaLoss
loss:MultipleNegativesRankingLoss
Inference Endpoints
Model card Files Community
NickyNicky commited on
Commit
a637885
·
verified ·
1 Parent(s): d2bcf61

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +215 -0
README.md CHANGED
@@ -432,6 +432,221 @@ You can finetune this model on your own dataset.
432
  - Datasets: 3.2.0
433
  - Tokenizers: 0.21.0
434
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
435
  ## Citation
436
 
437
  ### BibTeX
 
432
  - Datasets: 3.2.0
433
  - Tokenizers: 0.21.0
434
 
435
+ ## NanoBEIREvaluator
436
+
437
+ ```bibtext
438
+ {'NanoClimateFEVER_cosine_accuracy@1': 0.28,
439
+ 'NanoClimateFEVER_cosine_accuracy@3': 0.44,
440
+ 'NanoClimateFEVER_cosine_accuracy@5': 0.54,
441
+ 'NanoClimateFEVER_cosine_accuracy@10': 0.72,
442
+ 'NanoClimateFEVER_cosine_precision@1': 0.28,
443
+ 'NanoClimateFEVER_cosine_precision@3': 0.15333333333333332,
444
+ 'NanoClimateFEVER_cosine_precision@5': 0.124,
445
+ 'NanoClimateFEVER_cosine_precision@10': 0.08999999999999998,
446
+ 'NanoClimateFEVER_cosine_recall@1': 0.145,
447
+ 'NanoClimateFEVER_cosine_recall@3': 0.205,
448
+ 'NanoClimateFEVER_cosine_recall@5': 0.264,
449
+ 'NanoClimateFEVER_cosine_recall@10': 0.36200000000000004,
450
+ 'NanoClimateFEVER_cosine_ndcg@10': 0.2957527689242254,
451
+ 'NanoClimateFEVER_cosine_mrr@10': 0.3996666666666668,
452
+ 'NanoClimateFEVER_cosine_map@100': 0.23258384801937396,
453
+ 'NanoDBPedia_cosine_accuracy@1': 0.68,
454
+ 'NanoDBPedia_cosine_accuracy@3': 0.86,
455
+ 'NanoDBPedia_cosine_accuracy@5': 0.92,
456
+ 'NanoDBPedia_cosine_accuracy@10': 0.96,
457
+ 'NanoDBPedia_cosine_precision@1': 0.68,
458
+ 'NanoDBPedia_cosine_precision@3': 0.56,
459
+ 'NanoDBPedia_cosine_precision@5': 0.5120000000000001,
460
+ 'NanoDBPedia_cosine_precision@10': 0.43800000000000006,
461
+ 'NanoDBPedia_cosine_recall@1': 0.07601531530835434,
462
+ 'NanoDBPedia_cosine_recall@3': 0.1438904710839341,
463
+ 'NanoDBPedia_cosine_recall@5': 0.20681359525684506,
464
+ 'NanoDBPedia_cosine_recall@10': 0.319966975132044,
465
+ 'NanoDBPedia_cosine_ndcg@10': 0.5501100350453579,
466
+ 'NanoDBPedia_cosine_mrr@10': 0.7855000000000001,
467
+ 'NanoDBPedia_cosine_map@100': 0.39476156890024533,
468
+ 'NanoFEVER_cosine_accuracy@1': 0.68,
469
+ 'NanoFEVER_cosine_accuracy@3': 0.86,
470
+ 'NanoFEVER_cosine_accuracy@5': 0.92,
471
+ 'NanoFEVER_cosine_accuracy@10': 0.96,
472
+ 'NanoFEVER_cosine_precision@1': 0.68,
473
+ 'NanoFEVER_cosine_precision@3': 0.29333333333333333,
474
+ 'NanoFEVER_cosine_precision@5': 0.19199999999999995,
475
+ 'NanoFEVER_cosine_precision@10': 0.10199999999999998,
476
+ 'NanoFEVER_cosine_recall@1': 0.6266666666666666,
477
+ 'NanoFEVER_cosine_recall@3': 0.8133333333333332,
478
+ 'NanoFEVER_cosine_recall@5': 0.8833333333333333,
479
+ 'NanoFEVER_cosine_recall@10': 0.9233333333333333,
480
+ 'NanoFEVER_cosine_ndcg@10': 0.7933479848498471,
481
+ 'NanoFEVER_cosine_mrr@10': 0.7780793650793651,
482
+ 'NanoFEVER_cosine_map@100': 0.7406571665049926,
483
+ 'NanoFiQA2018_cosine_accuracy@1': 0.46,
484
+ 'NanoFiQA2018_cosine_accuracy@3': 0.64,
485
+ 'NanoFiQA2018_cosine_accuracy@5': 0.7,
486
+ 'NanoFiQA2018_cosine_accuracy@10': 0.72,
487
+ 'NanoFiQA2018_cosine_precision@1': 0.46,
488
+ 'NanoFiQA2018_cosine_precision@3': 0.2866666666666666,
489
+ 'NanoFiQA2018_cosine_precision@5': 0.22399999999999998,
490
+ 'NanoFiQA2018_cosine_precision@10': 0.12999999999999998,
491
+ 'NanoFiQA2018_cosine_recall@1': 0.23924603174603173,
492
+ 'NanoFiQA2018_cosine_recall@3': 0.4251031746031746,
493
+ 'NanoFiQA2018_cosine_recall@5': 0.5099603174603174,
494
+ 'NanoFiQA2018_cosine_recall@10': 0.566015873015873,
495
+ 'NanoFiQA2018_cosine_ndcg@10': 0.4774545077577204,
496
+ 'NanoFiQA2018_cosine_mrr@10': 0.5475555555555556,
497
+ 'NanoFiQA2018_cosine_map@100': 0.4125452702654584,
498
+ 'NanoHotpotQA_cosine_accuracy@1': 0.64,
499
+ 'NanoHotpotQA_cosine_accuracy@3': 0.82,
500
+ 'NanoHotpotQA_cosine_accuracy@5': 0.84,
501
+ 'NanoHotpotQA_cosine_accuracy@10': 0.88,
502
+ 'NanoHotpotQA_cosine_precision@1': 0.64,
503
+ 'NanoHotpotQA_cosine_precision@3': 0.3533333333333333,
504
+ 'NanoHotpotQA_cosine_precision@5': 0.23599999999999993,
505
+ 'NanoHotpotQA_cosine_precision@10': 0.128,
506
+ 'NanoHotpotQA_cosine_recall@1': 0.32,
507
+ 'NanoHotpotQA_cosine_recall@3': 0.53,
508
+ 'NanoHotpotQA_cosine_recall@5': 0.59,
509
+ 'NanoHotpotQA_cosine_recall@10': 0.64,
510
+ 'NanoHotpotQA_cosine_ndcg@10': 0.5959681682828366,
511
+ 'NanoHotpotQA_cosine_mrr@10': 0.723888888888889,
512
+ 'NanoHotpotQA_cosine_map@100': 0.5262469568756968,
513
+ 'NanoMSMARCO_cosine_accuracy@1': 0.36,
514
+ 'NanoMSMARCO_cosine_accuracy@3': 0.52,
515
+ 'NanoMSMARCO_cosine_accuracy@5': 0.58,
516
+ 'NanoMSMARCO_cosine_accuracy@10': 0.8,
517
+ 'NanoMSMARCO_cosine_precision@1': 0.36,
518
+ 'NanoMSMARCO_cosine_precision@3': 0.1733333333333333,
519
+ 'NanoMSMARCO_cosine_precision@5': 0.11599999999999999,
520
+ 'NanoMSMARCO_cosine_precision@10': 0.08,
521
+ 'NanoMSMARCO_cosine_recall@1': 0.36,
522
+ 'NanoMSMARCO_cosine_recall@3': 0.52,
523
+ 'NanoMSMARCO_cosine_recall@5': 0.58,
524
+ 'NanoMSMARCO_cosine_recall@10': 0.8,
525
+ 'NanoMSMARCO_cosine_ndcg@10': 0.5539831330912274,
526
+ 'NanoMSMARCO_cosine_mrr@10': 0.47960317460317464,
527
+ 'NanoMSMARCO_cosine_map@100': 0.4907628900864195,
528
+ 'NanoNFCorpus_cosine_accuracy@1': 0.42,
529
+ 'NanoNFCorpus_cosine_accuracy@3': 0.56,
530
+ 'NanoNFCorpus_cosine_accuracy@5': 0.6,
531
+ 'NanoNFCorpus_cosine_accuracy@10': 0.7,
532
+ 'NanoNFCorpus_cosine_precision@1': 0.42,
533
+ 'NanoNFCorpus_cosine_precision@3': 0.3466666666666666,
534
+ 'NanoNFCorpus_cosine_precision@5': 0.32800000000000007,
535
+ 'NanoNFCorpus_cosine_precision@10': 0.286,
536
+ 'NanoNFCorpus_cosine_recall@1': 0.03391318439564492,
537
+ 'NanoNFCorpus_cosine_recall@3': 0.06311668492872162,
538
+ 'NanoNFCorpus_cosine_recall@5': 0.08191277059586696,
539
+ 'NanoNFCorpus_cosine_recall@10': 0.13476845853527392,
540
+ 'NanoNFCorpus_cosine_ndcg@10': 0.3322933792371396,
541
+ 'NanoNFCorpus_cosine_mrr@10': 0.4983333333333333,
542
+ 'NanoNFCorpus_cosine_map@100': 0.13985354018581944,
543
+ 'NanoNQ_cosine_accuracy@1': 0.44,
544
+ 'NanoNQ_cosine_accuracy@3': 0.64,
545
+ 'NanoNQ_cosine_accuracy@5': 0.66,
546
+ 'NanoNQ_cosine_accuracy@10': 0.76,
547
+ 'NanoNQ_cosine_precision@1': 0.44,
548
+ 'NanoNQ_cosine_precision@3': 0.22,
549
+ 'NanoNQ_cosine_precision@5': 0.14,
550
+ 'NanoNQ_cosine_precision@10': 0.08199999999999999,
551
+ 'NanoNQ_cosine_recall@1': 0.42,
552
+ 'NanoNQ_cosine_recall@3': 0.62,
553
+ 'NanoNQ_cosine_recall@5': 0.64,
554
+ 'NanoNQ_cosine_recall@10': 0.75,
555
+ 'NanoNQ_cosine_ndcg@10': 0.5903874296113161,
556
+ 'NanoNQ_cosine_mrr@10': 0.5456349206349206,
557
+ 'NanoNQ_cosine_map@100': 0.5437440035864959,
558
+ 'NanoQuoraRetrieval_cosine_accuracy@1': 0.88,
559
+ 'NanoQuoraRetrieval_cosine_accuracy@3': 0.96,
560
+ 'NanoQuoraRetrieval_cosine_accuracy@5': 1.0,
561
+ 'NanoQuoraRetrieval_cosine_accuracy@10': 1.0,
562
+ 'NanoQuoraRetrieval_cosine_precision@1': 0.88,
563
+ 'NanoQuoraRetrieval_cosine_precision@3': 0.3933333333333333,
564
+ 'NanoQuoraRetrieval_cosine_precision@5': 0.256,
565
+ 'NanoQuoraRetrieval_cosine_precision@10': 0.13599999999999998,
566
+ 'NanoQuoraRetrieval_cosine_recall@1': 0.784,
567
+ 'NanoQuoraRetrieval_cosine_recall@3': 0.9186666666666667,
568
+ 'NanoQuoraRetrieval_cosine_recall@5': 0.976,
569
+ 'NanoQuoraRetrieval_cosine_recall@10': 0.9933333333333334,
570
+ 'NanoQuoraRetrieval_cosine_ndcg@10': 0.9367841595958026,
571
+ 'NanoQuoraRetrieval_cosine_mrr@10': 0.9246666666666666,
572
+ 'NanoQuoraRetrieval_cosine_map@100': 0.913554834054834,
573
+ 'NanoSCIDOCS_cosine_accuracy@1': 0.52,
574
+ 'NanoSCIDOCS_cosine_accuracy@3': 0.68,
575
+ 'NanoSCIDOCS_cosine_accuracy@5': 0.82,
576
+ 'NanoSCIDOCS_cosine_accuracy@10': 0.92,
577
+ 'NanoSCIDOCS_cosine_precision@1': 0.52,
578
+ 'NanoSCIDOCS_cosine_precision@3': 0.3933333333333333,
579
+ 'NanoSCIDOCS_cosine_precision@5': 0.33599999999999997,
580
+ 'NanoSCIDOCS_cosine_precision@10': 0.21600000000000003,
581
+ 'NanoSCIDOCS_cosine_recall@1': 0.10966666666666666,
582
+ 'NanoSCIDOCS_cosine_recall@3': 0.24466666666666664,
583
+ 'NanoSCIDOCS_cosine_recall@5': 0.34566666666666657,
584
+ 'NanoSCIDOCS_cosine_recall@10': 0.44266666666666665,
585
+ 'NanoSCIDOCS_cosine_ndcg@10': 0.4328110226758414,
586
+ 'NanoSCIDOCS_cosine_mrr@10': 0.6317222222222222,
587
+ 'NanoSCIDOCS_cosine_map@100': 0.34997841607847063,
588
+ 'NanoArguAna_cosine_accuracy@1': 0.2,
589
+ 'NanoArguAna_cosine_accuracy@3': 0.56,
590
+ 'NanoArguAna_cosine_accuracy@5': 0.76,
591
+ 'NanoArguAna_cosine_accuracy@10': 0.92,
592
+ 'NanoArguAna_cosine_precision@1': 0.2,
593
+ 'NanoArguAna_cosine_precision@3': 0.18666666666666668,
594
+ 'NanoArguAna_cosine_precision@5': 0.15200000000000002,
595
+ 'NanoArguAna_cosine_precision@10': 0.092,
596
+ 'NanoArguAna_cosine_recall@1': 0.2,
597
+ 'NanoArguAna_cosine_recall@3': 0.56,
598
+ 'NanoArguAna_cosine_recall@5': 0.76,
599
+ 'NanoArguAna_cosine_recall@10': 0.92,
600
+ 'NanoArguAna_cosine_ndcg@10': 0.5499071039525992,
601
+ 'NanoArguAna_cosine_mrr@10': 0.43229365079365073,
602
+ 'NanoArguAna_cosine_map@100': 0.43523820792684886,
603
+ 'NanoSciFact_cosine_accuracy@1': 0.6,
604
+ 'NanoSciFact_cosine_accuracy@3': 0.72,
605
+ 'NanoSciFact_cosine_accuracy@5': 0.8,
606
+ 'NanoSciFact_cosine_accuracy@10': 0.88,
607
+ 'NanoSciFact_cosine_precision@1': 0.6,
608
+ 'NanoSciFact_cosine_precision@3': 0.25333333333333335,
609
+ 'NanoSciFact_cosine_precision@5': 0.18,
610
+ 'NanoSciFact_cosine_precision@10': 0.09799999999999999,
611
+ 'NanoSciFact_cosine_recall@1': 0.58,
612
+ 'NanoSciFact_cosine_recall@3': 0.7,
613
+ 'NanoSciFact_cosine_recall@5': 0.8,
614
+ 'NanoSciFact_cosine_recall@10': 0.87,
615
+ 'NanoSciFact_cosine_ndcg@10': 0.7265348054031264,
616
+ 'NanoSciFact_cosine_mrr@10': 0.6841031746031746,
617
+ 'NanoSciFact_cosine_map@100': 0.6810233866101422,
618
+ 'NanoTouche2020_cosine_accuracy@1': 0.5102040816326531,
619
+ 'NanoTouche2020_cosine_accuracy@3': 0.8367346938775511,
620
+ 'NanoTouche2020_cosine_accuracy@5': 0.9183673469387755,
621
+ 'NanoTouche2020_cosine_accuracy@10': 0.9387755102040817,
622
+ 'NanoTouche2020_cosine_precision@1': 0.5102040816326531,
623
+ 'NanoTouche2020_cosine_precision@3': 0.5374149659863945,
624
+ 'NanoTouche2020_cosine_precision@5': 0.5061224489795918,
625
+ 'NanoTouche2020_cosine_precision@10': 0.43265306122448977,
626
+ 'NanoTouche2020_cosine_recall@1': 0.03546508562664911,
627
+ 'NanoTouche2020_cosine_recall@3': 0.11189238805791148,
628
+ 'NanoTouche2020_cosine_recall@5': 0.1673503566176574,
629
+ 'NanoTouche2020_cosine_recall@10': 0.2818808841266296,
630
+ 'NanoTouche2020_cosine_ndcg@10': 0.47479704449085264,
631
+ 'NanoTouche2020_cosine_mrr@10': 0.6714285714285714,
632
+ 'NanoTouche2020_cosine_map@100': 0.3438320372291555,
633
+ 'NanoBEIR_mean_cosine_accuracy@1': 0.5130926216640502,
634
+ 'NanoBEIR_mean_cosine_accuracy@3': 0.6997488226059654,
635
+ 'NanoBEIR_mean_cosine_accuracy@5': 0.7737205651491367,
636
+ 'NanoBEIR_mean_cosine_accuracy@10': 0.8583673469387756,
637
+ 'NanoBEIR_mean_cosine_precision@1': 0.5130926216640502,
638
+ 'NanoBEIR_mean_cosine_precision@3': 0.31928833071690216,
639
+ 'NanoBEIR_mean_cosine_precision@5': 0.2540094191522763,
640
+ 'NanoBEIR_mean_cosine_precision@10': 0.1777425431711146,
641
+ 'NanoBEIR_mean_cosine_recall@1': 0.302305611570001,
642
+ 'NanoBEIR_mean_cosine_recall@3': 0.4504361065646467,
643
+ 'NanoBEIR_mean_cosine_recall@5': 0.5234643876869758,
644
+ 'NanoBEIR_mean_cosine_recall@10': 0.6156896557033196,
645
+ 'NanoBEIR_mean_cosine_ndcg@10': 0.5623178109936842,
646
+ 'NanoBEIR_mean_cosine_mrr@10': 0.6232673992673993,
647
+ 'NanoBEIR_mean_cosine_map@100': 0.47729093279415025}
648
+ ```
649
+
650
  ## Citation
651
 
652
  ### BibTeX