Rubrics for Evaluating Terms

Q1.02–Q1.04: Similar Terms

Score	Rubric Item	Example: Dangerous	Why
0	Blank or unrelated	Beautify; Danger	Does not relate at all
1	Poor match to the original term or too similar	Expensive; Danger	Shares minimal overlap; essentially the same as Dangerous
2	Different term but still too close to the original term	Difficult	Describes challenges but lacks harm/risk element
3	Adequate match with some errors	Risky	Conceptual relationship but misses immediacy of harm
4	Strong match with minimal errors	Deadly	Captures harm but emphasizes fatal outcomes
5	Excellent match	Hazardous	Perfect synonym preserving meaning of potential harm

Q2.02–Q2.04: Associated Terms

Score	Rubric Item	Example	Why
0	Blank or unrelated	Banana	No association with harm or risk
1	Major issues or too similar	Carpet; Danger	Very weak link; too close to original
2	Too distant	Competition	Implies struggle, not inherently harmful
3	Adequate with some issues	Storm	Associated with risk but not always harmful
4	Strong connection	Snake	Commonly linked to danger (venom, fear)
5	Excellent association	Fire	Universally recognized as dangerous, immediate threat

Q3.01: Hierarchical Terms – Top Level

Score	Rubric Item
0	Blank or unrelated
1	More specific, not broader
2	Too close to original
3	Broader than original but narrower than others
4	Strong broadening, generalizes well
5	Fully generalized, abstract concept

Q3.02: Hierarchical Terms – Two Levels Up

Score	Rubric Item
0	No broadening or blank
1	More specific, not broader
2	Too close to original
3	Broader but less broad than prior
4	Significant broadening
5	Excellent broadening, higher-level concept

Q3.03: Hierarchical Terms – One Level Up

Score	Rubric Item	Example (Danger)	Why
0	No broadening or blank	Flower	No link to hierarchy
1	More specific, not broader	Box jellyfish sting	Narrow event, not general concept
2	Too close to original	Risky	Near-duplicate, not clearly broader
3	Adequate broadening	Threat	Broader than “dangerous” but still situational
4	Significant broadening	Unsafe condition	Generalizes beyond immediate threat
5	Excellent broadening	Harm	Fully generalized abstraction of risk

Q3.04: Hierarchical Terms – More Specific Term, Level 1

Score	Rubric Item	Example (Danger)	Why
0	No attempt or broader term	Harm	Broader abstraction, not narrower
1	No match	Chair	No semantic link
2	Broader, not narrower	Risk	General potential, less specific
3	Unclear term	Problem	Vague, not clearly linked
4	Clearly narrower	Explosion	Specific hazardous event
5	Highly precise	Venomous snake attack	Clear, detailed instance

Q3.05: Hierarchical Terms – More Specific Subterm 2

Score	Rubric Item
0	No attempt or broader term
1	No match
2	Broader, not narrower
3	More focused but broad elements remain
4	Much more focused, clear subcategory
5	Highly precise, well-defined subcategory

Q3.06: Hierarchical Terms – More Specific Subterm 3

Score	Rubric Item
0	No attempt or broader term
1	No match
2	Broader, not narrower
3	More focused but broad elements remain
4	Much more focused, clear subcategory
5	Highly precise, well-defined subcategory