sbrzz's picture
Update README.md
75f6e14 verified
metadata
license: apache-2.0
language:
  - en
base_model:
  - HuggingFaceTB/SmolLM2-135M-Instruct
  - facebook/dinov2-small
pipeline_tag: visual-question-answering

Pretrained, 500 epochs

MMMU

Category # Samples Accuracy
Overall 900 0.251
Overall-Art and Design 120 0.225
Art 30 0.200
Art Theory 30 0.233
Design 30 0.233
Music 30 0.233
Overall-Business 150 0.267
Accounting 30 0.300
Economics 30 0.267
Finance 30 0.200
Management 30 0.267
Marketing 30 0.300
Overall-Science 150 0.207
Biology 30 0.200
Chemistry 30 0.233
Geography 30 0.233
Math 30 0.167
Physics 30 0.200
Overall-Health and Medicine 150 0.273
Basic Medical Science 30 0.233
Clinical Medicine 30 0.333
Diagnostics and Laboratory Med. 30 0.267
Pharmacy 30 0.367
Public Health 30 0.167
Overall-Humanities and Soc. Sci. 120 0.225
History 30 0.167
Literature 30 0.167
Sociology 30 0.300
Psychology 30 0.267
Overall-Tech and Engineering 210 0.286
Agriculture 30 0.200
Architecture and Engineering 30 0.400
Computer Science 30 0.200
Electronics 30 0.167
Energy and Power 30 0.333
Materials 30 0.300
Mechanical Engineering 30 0.400