-
Notifications
You must be signed in to change notification settings - Fork 8
[exam] Add UW Madison CS537 Fall 2021 Exam #55
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: refactor_course_exam_bench
Are you sure you want to change the base?
Conversation
tareknaser
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for putting this together! I left a few comments but it's in good shape overall
| "score_max": 60.0, | ||
| "score_avg": 51.86, | ||
| "score_median": 52.5, | ||
| "score_standard_deviation": 9.69, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I may have missed this but I’m not sure where these numbers originated. I couldn’t find them in the PDF
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Originally I had gotten them from this website, where data was collected from the UW-Madison's Registrar Office, however looking back at it again now, these are the final grades of the students in that given year, not the grades from this the final exam that year.
I don't think it will be possible to find these values for any of the UWM exams, would it be okay to exclude them for the time being? Or should I look for a more suitable exam to add that has this information available?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes, Chi. If you cannot find it, you can ignore it. @tareknaser Should we set it blank or some other default value?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can ignore the fields completely. See benchmarks/courseexam_bench/data/cs107_computer_organization_&_systems_fall_2023_final/exam.md for a similar case
| "tags": [ | ||
| "operating-systems" | ||
| ], | ||
| "answer": "B" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm curious where did you get the ground truth for the answers here? The exam PDF doesn’t seem to have the answers
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That's great. @qimcis can you please also upload that the pdf with solution? Then, we can double check the exam.md together. Thanks a lot!
| Given the disk to the right (which rotates counter-clockwise), and assuming FIFO disk scheduling, what request would be serviced last, assuming the requests are: 13, 4, 35, 34, 5 | ||
| A) 13 | ||
| B) 4 | ||
| C) 35 | ||
| D) 34 | ||
| E) 5 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Questions 5 to 8 seem to rely on the figure on page 3 which language models cannot access. Could you take a look at the guidelines here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I've provided a verbose textual description of the figure now for questions 5-8 according to guidelines, lmk if this works!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for that. I still think it’s a bit confusing. mostly because the figure is hard to describe.
For these questions, let’s just leave them out and make sure to update the exam metadata to adjust the total score and question count
| Thus, we can conclude that the maximum bandwidth obtained during sequential writing to a 2-way mirrored array is ______ [Assume here there are N disks, and that a single disk delivers S MB/s of disk bandwidth] | ||
| A) S MB/s | ||
| B) 2 x S MB/s | ||
| C) N x S MB/s | ||
| D) N x S / 2 MB/s | ||
| E) N x S x S MB/s |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Questions like 13 seem to be continuations from previous questions. In such cases, we should either include the full context in each question or treat them as a single question
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I've opted to treat them as a single question
|
If #61 gets merged first, we’ll need some small updates to |
Description
Added cs537 fall 2021 final, find the original exam here
Testing
Ran
benchmarks/courseexam_bench/tests/test_data_schema.pyChecklist