SvelteBench Visualization

Note: OpenAI thinking models (o3, o4) do not support temperature adjustments. o1-pro models use "medium" reasoning effort setting.

← Back to All Results

Google

▼

gemma-3-27b-it

▼

Test	Status	pass@1	pass@10	Passing Samples	Errors	Actions
counter	❌ FAIL	0.0000	0.0000	0/10	10	View Prompt View Tests
derived	❌ FAIL	0.0000	0.0000	0/10	10	View Prompt View Tests
derived-by	❌ FAIL	0.0000	0.0000	0/10	10	View Prompt View Tests
each	❌ FAIL	0.0000	0.0000	0/10	10	View Prompt View Tests
effect	❌ FAIL	0.0000	0.0000	0/10	10	View Prompt View Tests
hello-world	✅ PASS	1.0000	1.0000	10/10	0	View Prompt View Tests
inspect	❌ FAIL	0.0000	0.0000	0/10	10	View Prompt View Tests
props	❌ FAIL	0.0000	0.0000	0/10	10	View Prompt View Tests
snippets	❌ FAIL	0.0000	0.0000	0/10	10	View Prompt View Tests