Skip to content

Remove the evaluation overview figure from the writing guide #12

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
VinodAnbalagan merged 1 commit into from
Oct 26, 2026
Merged

Remove the evaluation overview figure from the writing guide #12

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 0 additions & 2 deletions docs/writing-riddles.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,8 +8,6 @@ A cultural riddle describes something without naming it. Someone who grew up in

Good riddles draw on lived experience: the food at home, the games children play in the street, the jokes everyone knows, the small rituals around festivals. These are the things a model can only get right if it truly carries your culture's knowledge.

![Overview of the benchmark. Panel A shows example riddles from Canada and Thailand and the topics they cover. Panel B shows how answers are scored: rules first, then native speakers, then an LLM jury. Panel C summarizes the results: accuracy falls with fewer language resources, and models more often hallucinate than admit that they don't know.](assets/overview.png)

## What makes a good riddle

- **It never names the answer.** Describe it through clues, wordplay, or the experience around it.
Expand Down
Loading