[Eval Results] smollm2-360m-instruct on smalleval/mmlu-nano:mmlu_high_school_mathematics.jsonl - 26.8% Accuracy

[sauravpanda]

Evaluation Results

Metadata

• Dataset: smalleval/mmlu-nano:mmlu_high_school_mathematics.jsonl
• Model: smollm2-360m-instruct

Performance Metrics

• Accuracy: 26.8%
• Average Latency: 455.14ms
• Tokens/Second: 455.14
• Memory Usage: 398.24MB

System Information

• Browser: chrome 131
• OS: MacIntel
• CPU: 10 cores
• RAM: 8GB
• GPU: Not Available
• Timestamp: 2025-01-23 06:34:54

[sauravpanda]

insert

[sauravpanda]

insert

[sauravpanda]

insert

[github-actions]

Failed to create PR. Error: [Errno 2] No such file or directory: 'public/main.csv'