Skip to content

Conversation

@arjunguha
Copy link
Member

I am not confident in this code. FWIW, pass@1 goes up slightly. The model is Qwen 3 Next 80B A3B

Pass@1 before: 0.5900621118 (humaneval-pl-boa-issue66-before-0.2-reworded)
Pass@1 after: 0.6211180124 (humaneval-pl-boa-issue66-perlonly-v2-0.2-reworded)

- revert the boolean-assert routing change in the shared translator\n- treat Perl boolean-false literals as a dedicated false expression and assert via Perl truthiness\n\n✨ Made with Codex
- revert generic translator changes so only the Perl translator handles false comparisons\n- keep Perl-specific boolean handling unchanged\n\n✨ Made with Codex
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants