Skip to content

Add RepetitionN metric#276

Merged
junya-takayama merged 2 commits intomainfrom
add_repetition_n_metric
Jan 28, 2026
Merged

Add RepetitionN metric#276
junya-takayama merged 2 commits intomainfrom
add_repetition_n_metric

Conversation

@junya-takayama
Copy link
Collaborator

@junya-takayama junya-takayama commented Jan 28, 2026

Add Repetition-N metric that calculates the n-gram repetition ratio in the model's output.
$\text{Repetition-N} = 1 - \frac{\text{Number of unique n-grams}}{\text{Number of total n-grams}}$

Reference: https://aclanthology.org/2020.acl-main.428

@junya-takayama junya-takayama changed the title [WIP] Add RepetitionN metric Add RepetitionN metric Jan 28, 2026
@junya-takayama junya-takayama marked this pull request as ready for review January 28, 2026 06:15
Copy link

@ryosukeiri ryosukeiri left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!!

@junya-takayama junya-takayama merged commit 811ebc9 into main Jan 28, 2026
7 checks passed
@junya-takayama junya-takayama deleted the add_repetition_n_metric branch January 28, 2026 06:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants