[Eval Results] smollm2-360m-instruct on smalleval/mmlu-nano:mmlu_high_school_physics.jsonl - 23.8% Accuracy

[sauravpanda]

Evaluation Results

Metadata

• Dataset: smalleval/mmlu-nano:mmlu_high_school_physics.jsonl
• Model: smollm2-360m-instruct
• Evaluation Type: evaluation

Performance Metrics

• Accuracy: 23.8%
• Total Questions: 151
• Average Latency: 0.00ms
• Tokens/Second: 0.00
• Memory Usage: 269.19MB

System Information

• Browser: chrome 131
• OS: MacIntel
• CPU: 10 cores
• RAM: 8GB
• GPU: Not Available
• Timestamp: 2025-01-21 05:35:04

Evaluation Results Jan 21 2025 (1).json