Skip to content

Conversation

@777lefty
Copy link
Collaborator

@777lefty 777lefty commented Jan 8, 2026

Description

Added final exam of cs107 in fall 2023, modified the regular expression match when extracting json metadata of exams, as current one can't deal with situations where answer field of a question's metadata contains code block with '`'

Changes

  • Added cs107 fall 2023 exam
  • Modified regular expressions match in prepare_dataset.py

Testing

Ran benchmarks/courseexam_bench/tests/test_data_schema.py

Checklist

  • Tests pass locally
  • Code follows project style guidelines
  • Documentation updated (if needed)

@tareknaser tareknaser self-requested a review January 8, 2026 16:55
@tareknaser
Copy link
Collaborator

Could you also share the original exam?

@xuafeng xuafeng requested a review from qimcis January 8, 2026 18:17
@777lefty
Copy link
Collaborator Author

777lefty commented Jan 8, 2026

@tareknaser Would you like me to upload the pdf to the same directory of exam.md or not?

@tareknaser
Copy link
Collaborator

Would you like me to upload the pdf to the same directory of exam.md or not?

Yes please

@777lefty
Copy link
Collaborator Author

777lefty commented Jan 8, 2026

@tareknaser it's done

Copy link
Collaborator

@tareknaser tareknaser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you! I reviewed this and everything makes sense. it’s clear that it’s well thought out. I have minor comments and a couple of questions but I think this is very close to be merged

@777lefty
Copy link
Collaborator Author

777lefty commented Jan 8, 2026

@tareknaser a new commit dealing with the comments above is pushed

Copy link
Collaborator

@tareknaser tareknaser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the nice work

@tareknaser tareknaser merged commit dba91ed into refactor_course_exam_bench Jan 9, 2026
1 check passed
tareknaser pushed a commit that referenced this pull request Jan 9, 2026
* modified the regular expression match

* added cs107_fall_2023_final

* updated one wrong tag

* Added pdf of the paper

* solved all the comments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants