[ { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "question", "anchor_id": "RRP-P01-relation-en-r1", "field": "prompt", "quote": "relative to the named reference", "severity": "high", "category": "learner_wording", "comment": "Every relation prompt is the same abstract, meta-linguistic sentence ('Describe the position/movement relative to the named reference') and never names the object or the reference. Early learners cannot act on 'relative to' or 'named reference', and 'Describe' presumes a spoken description although pointing, gesture and AAC are valid.", "suggestion": "Write a concrete per-case question that names the target and the reference without naming the relation, e.g. P01: \"Look at the box. Where is the ball?\"; path cases, e.g. P13: \"Watch the box. Where did the ball go?\"", "also_in": [ "RRP-P02-relation-en-r1", "RRP-P03-relation-en-r1", "RRP-P04-relation-en-r1", "RRP-P05-relation-en-r1", "RRP-P06-relation-en-r1", "RRP-P07-relation-en-r1", "RRP-P08-relation-en-r1", "RRP-P09-relation-en-r1", "RRP-P10-relation-en-r1", "RRP-P11-relation-en-r1", "RRP-P12-relation-en-r1", "RRP-P13-relation-en-r1", "RRP-P14-relation-en-r1", "RRP-P15-relation-en-r1", "RRP-P16-relation-en-r1", "RRP-P17-relation-en-r1", "RRP-P18-relation-en-r1", "RRP-P19-relation-en-r1", "RRP-P20-relation-en-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "question", "anchor_id": "RRP-P08-relation-en-r1", "field": "prompt", "quote": "the named reference", "severity": "high", "category": "scene_ambiguity", "comment": "This scene is built so the ball is both under the table and beside the box, and the setup says to name the table explicitly, but the prompt never names any reference. A child who answers \"beside the box\" has answered correctly, yet the key expects only \"under the table\"; the same happens in P01 (also far from the chair) and P09 (box also on the tray).", "suggestion": "Name the intended reference in the prompt: P08 \"Look at the table. Where is the ball?\"; P01 \"Look at the box. Where is the ball?\"; P09 \"Look at the box. Where is the spoon?\"", "also_in": [ "RRP-P01-relation-en-r1", "RRP-P09-relation-en-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "key", "anchor_id": "RRP-P08-where-en-r1", "field": "accepted_meaning", "quote": "under the table", "severity": "medium", "category": "key_error", "comment": "The where question ('Where is the ball now?') names no reference, so in this two-relation scene \"beside the box\" is an equally true, complete answer, but the key lists only \"under the table\". Treating it as a relevance problem is unfair when the question itself did not specify a reference.", "suggestion": "Add the other true answers as accepted for the unqualified where item (P08: \"beside the box\"; P01: \"far from the chair\"; P09: \"on the tray, in the box\"), or name the reference in the where prompt.", "also_in": [ "RRP-P01-where-en-r1", "RRP-P09-where-en-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "question", "anchor_id": "RRP-P01-message-en-r1", "field": "prompt", "quote": "make the reference clear", "severity": "medium", "category": "learner_wording", "comment": "The message prompt is identical in all 20 cases, calls the item 'the object' instead of naming it, and adds a meta-linguistic second clause ('make the reference clear') that an early learner cannot act on. The reference requirement belongs in the scoring note, not in the child-facing instruction.", "suggestion": "Name the item per case and drop the meta clause, e.g. P01: \"Tell your partner where the ball is.\"", "also_in": [ "RRP-P02-message-en-r1", "RRP-P03-message-en-r1", "RRP-P04-message-en-r1", "RRP-P05-message-en-r1", "RRP-P06-message-en-r1", "RRP-P07-message-en-r1", "RRP-P08-message-en-r1", "RRP-P09-message-en-r1", "RRP-P10-message-en-r1", "RRP-P11-message-en-r1", "RRP-P12-message-en-r1", "RRP-P13-message-en-r1", "RRP-P14-message-en-r1", "RRP-P15-message-en-r1", "RRP-P16-message-en-r1", "RRP-P17-message-en-r1", "RRP-P18-message-en-r1", "RRP-P19-message-en-r1", "RRP-P20-message-en-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "question", "anchor_id": "RRP-P01-ask-en-r1", "field": "prompt", "quote": "Find out its location from the partner", "severity": "medium", "category": "learner_wording", "comment": "'Find out its location from the partner' is indirect and abstract: 'its' has no antecedent because the item is hidden and unnamed, and 'location' is not early vocabulary. The same wording repeats in every case.", "suggestion": "Name the item and keep a neutral invitation without a where-word, e.g. P01: \"The ball is hidden. You can ask me.\"", "also_in": [ "RRP-P02-ask-en-r1", "RRP-P03-ask-en-r1", "RRP-P04-ask-en-r1", "RRP-P05-ask-en-r1", "RRP-P06-ask-en-r1", "RRP-P07-ask-en-r1", "RRP-P08-ask-en-r1", "RRP-P09-ask-en-r1", "RRP-P10-ask-en-r1", "RRP-P11-ask-en-r1", "RRP-P12-ask-en-r1", "RRP-P13-ask-en-r1", "RRP-P14-ask-en-r1", "RRP-P15-ask-en-r1", "RRP-P16-ask-en-r1", "RRP-P17-ask-en-r1", "RRP-P18-ask-en-r1", "RRP-P19-ask-en-r1", "RRP-P20-ask-en-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "case", "anchor_id": "RRP-P01", "field": "asking_setup", "quote": "the object in one of two familiar, accessible locations", "severity": "medium", "category": "learner_wording", "comment": "The asking setup is the same generic paragraph in all 20 cases; it never names the object or the two candidate locations, so the practitioner has to invent them and the information gap is not tied to the case's relation. 'Do not conceal essential items' is also vague.", "suggestion": "Write a short case-specific setup, e.g. P01: \"Out of the child's sight, put the ball either beside the box or under the chair. Answer the child's question and show where it is. Keep the child's AAC and other needed items in reach.\"", "also_in": [ "RRP-P02", "RRP-P03", "RRP-P04", "RRP-P05", "RRP-P06", "RRP-P07", "RRP-P08", "RRP-P09", "RRP-P10", "RRP-P11", "RRP-P12", "RRP-P13", "RRP-P14", "RRP-P15", "RRP-P16", "RRP-P17", "RRP-P18", "RRP-P19", "RRP-P20" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "question", "anchor_id": "RRP-P01-follow-en-r1", "field": "prompt", "quote": "Put the ball beside the box.", "severity": "medium", "category": "answer_leak", "comment": "As listed, the follow instruction states the exact relation and reference ('beside the box') immediately before the message item asks the child to say where the ball is, so the message answer is modelled word-for-word. This happens in every case, including path cases (e.g. P13 'into the box' before 'The ball is in the box').", "suggestion": "Present the message item before the follow instruction, or rebuild the scene with a different arrangement between them, and record any preceding model as exposure/help.", "also_in": [ "RRP-P02-follow-en-r1", "RRP-P03-follow-en-r1", "RRP-P04-follow-en-r1", "RRP-P05-follow-en-r1", "RRP-P06-follow-en-r1", "RRP-P07-follow-en-r1", "RRP-P08-follow-en-r1", "RRP-P09-follow-en-r1", "RRP-P10-follow-en-r1", "RRP-P11-follow-en-r1", "RRP-P12-follow-en-r1", "RRP-P13-follow-en-r1", "RRP-P14-follow-en-r1", "RRP-P15-follow-en-r1", "RRP-P16-follow-en-r1", "RRP-P17-follow-en-r1", "RRP-P18-follow-en-r1", "RRP-P19-follow-en-r1", "RRP-P20-follow-en-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "question", "anchor_id": "RRP-P08-follow-en-r1", "field": "prompt", "quote": "it may also be beside the box", "severity": "medium", "category": "learner_wording", "comment": "A practitioner note has been placed inside a child-directed instruction. For an early learner a second clause with a different relation reads as a second task (also put it beside the box); P10's 'it need not be exactly in the middle' has the same problem.", "suggestion": "P08: \"Put the ball under the table.\" P10: \"Put the block between the cups.\" Move the notes to the setup or scoring guidance.", "also_in": [ "RRP-P10-follow-en-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "question", "anchor_id": "RRP-P11-where-en-r1", "field": "prompt", "quote": "Where is the basket now?", "severity": "medium", "category": "scene_ambiguity", "comment": "In this case the basket stays still and only the chair moves, so 'Where is the basket now?' implies the basket moved and invites answers like \"same place\" or \"there\". The child is not told that the answer should use the chair.", "suggestion": "\"Look at the chair. Where is the basket?\"", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "question", "anchor_id": "RRP-P11-follow-en-r1", "field": "prompt", "quote": "so the basket is beside it", "severity": "medium", "category": "learner_wording", "comment": "'Move the chair so the basket is beside it' is a purpose clause with a pronoun, which is hard for early learners, and moving a chair is a heavy motor task.", "suggestion": "\"Put the chair next to the basket.\" (the child may tell the adult where to move it)", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "key", "anchor_id": "RRP-P06-relation-en-r1", "field": "accepted_meaning", "quote": "without touching it", "severity": "medium", "category": "key_error", "comment": "The accepted meaning requires the clause 'without touching it', which early learners will rarely produce; \"above the box\" or \"over the box\" fully expresses the relation. A reviewer reading the printed example may mark a correct short answer as incomplete.", "suggestion": "Use \"above the box\" as the accepted meaning, list \"over the box\" as an alternative, and keep 'not touching' as a scene check (message example: \"The toy plane is above the box.\").", "also_in": [ "RRP-P06-where-en-r1", "RRP-P06-message-en-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "case", "anchor_id": "RRP-P01", "field": "setup", "quote": "then use a fresh turn for the chair", "severity": "medium", "category": "key_error", "comment": "The setup describes a second turn with a different relation, but no question or key exists for it. P01 (ball far from the chair), P04 (book above the box without contact) and P12 (book under the block) all do this, so those responses cannot be recorded against a key. The Hindi pack has the same gap.", "suggestion": "Either add question and key entries for the second turn (P01 \"far from the chair\", P04 \"above the box\", P12 \"under the block\") or remove the second turn from the setup.", "also_in": [ "RRP-P04", "RRP-P12" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "case", "anchor_id": "RRP-P04", "field": "setup", "quote": "A separate comparison uses a supported book above it without contact.", "severity": "medium", "category": "scene_ambiguity", "comment": "'A supported book above it without contact' does not say what holds the book or whether both displays are shown together. If the comparison is on view during 'Where is the book now?', it is unclear which book is meant.", "suggestion": "\"Put the book on the closed box. On a separate turn, an adult holds the same book just above the box without touching it; show only one arrangement at a time.\"", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "key", "anchor_id": "RRP-P18-message-en-r1", "field": "accepted_meaning", "quote": "on the marked mat", "severity": "low", "category": "key_error", "comment": "The message prompt asks the child to make the reference clear, but the accepted meaning mentions only the mat and not the case's reference object (the box), unlike P14, P16, P17 and P20.", "suggestion": "\"The toy car is on the mat past the box.\"", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "question", "anchor_id": "RRP-P03-where-en-r1", "field": "prompt", "quote": "toy car", "severity": "low", "category": "learner_wording", "comment": "Object names change within a case ('car' in setup and follow, 'toy car' in where, message and ask; 'plane' vs 'toy plane' in P06). The lesson asks for stable AAC symbols, and switching labels can confuse children who match words to symbols.", "suggestion": "Use one name per object throughout each case (e.g. \"car\" everywhere, or \"toy car\" everywhere).", "also_in": [ "RRP-P06-where-en-r1", "RRP-P17-where-en-r1", "RRP-P18-where-en-r1", "RRP-P19-where-en-r1", "RRP-P20-where-en-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "case", "anchor_id": "RRP-P08", "field": "variation", "quote": "one_object,_two_true_relations", "severity": "low", "category": "technical_text", "comment": "Variation values are machine slugs, several with stray punctuation from the title (',_', ':_', '/'). If shown on the review or practitioner page they read as internal tokens.", "suggestion": "Show the human-readable title instead, or regenerate clean slugs (e.g. one_object_two_true_relations, into_boundary_crossing, away_is_not_a_fixed_left_right_direction).", "also_in": [ "RRP-P13", "RRP-P14", "RRP-P15", "RRP-P16", "RRP-P17", "RRP-P20" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "question", "anchor_id": "RRP-P09-follow-en-r1", "field": "prompt", "quote": "in the box on the tray", "severity": "low", "category": "learner_wording", "comment": "'Put the spoon in the box on the tray' has two prepositional phrases in a row; an early learner may put the spoon on the tray. The Hindi version avoids this.", "suggestion": "\"The box is on the tray. Put the spoon in the box.\"", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "question", "anchor_id": "RRP-P06-follow-en-r1", "field": "prompt", "quote": "without touching it", "severity": "low", "category": "access", "comment": "The child is asked to hold a toy steadily in mid-air, which many children with motor needs cannot do, and 'it' is ambiguous (the plane touching the box, or the child touching the box).", "suggestion": "\"Show me where the plane goes: over the box, not touching the box.\" (accept directing the adult who holds the plane)", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "en", "anchor_type": "lesson", "anchor_id": null, "field": "lesson", "quote": "heldout_cases.json and heldout_keys.json", "severity": "low", "category": "technical_text", "comment": "Internal file names are shown in practitioner-facing lesson text.", "suggestion": "\"Four assessor-only routines and their keys are kept separately and are not part of this lesson.\"", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "question", "anchor_id": "RRP-P01-relation-hi-r1", "field": "prompt", "quote": "तय संदर्भ के अनुसार", "severity": "high", "category": "learner_wording", "comment": "Every relation prompt is the abstract, meta-linguistic phrase 'तय संदर्भ के अनुसार जगह/चलने का रास्ता बताओ' ('according to the fixed reference'), which early learners cannot understand. It never names the object or the reference, and 'बताओ' presumes speech although pointing and AAC are valid.", "suggestion": "Write a concrete per-case question that names the target and reference without naming the relation, e.g. P01: \"डिब्बा देखो। गेंद कहाँ है?\"; path cases, e.g. P13: \"डिब्बा देखो। गेंद कहाँ गई?\"", "also_in": [ "RRP-P02-relation-hi-r1", "RRP-P03-relation-hi-r1", "RRP-P04-relation-hi-r1", "RRP-P05-relation-hi-r1", "RRP-P06-relation-hi-r1", "RRP-P07-relation-hi-r1", "RRP-P08-relation-hi-r1", "RRP-P09-relation-hi-r1", "RRP-P10-relation-hi-r1", "RRP-P11-relation-hi-r1", "RRP-P12-relation-hi-r1", "RRP-P13-relation-hi-r1", "RRP-P14-relation-hi-r1", "RRP-P15-relation-hi-r1", "RRP-P16-relation-hi-r1", "RRP-P17-relation-hi-r1", "RRP-P18-relation-hi-r1", "RRP-P19-relation-hi-r1", "RRP-P20-relation-hi-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "question", "anchor_id": "RRP-P08-relation-hi-r1", "field": "prompt", "quote": "तय संदर्भ के अनुसार जगह बताओ।", "severity": "high", "category": "scene_ambiguity", "comment": "The ball is both under the table and beside the box, and the setup says to name the table, but the prompt names no reference. A child saying \"डिब्बे के बगल में\" is correct yet does not match the key; P01 (also far from the chair) and P09 (box on the tray) have the same problem.", "suggestion": "P08: \"मेज़ देखो। गेंद कहाँ है?\"; P01: \"डिब्बा देखो। गेंद कहाँ है?\"; P09: \"डिब्बा देखो। चम्मच कहाँ है?\"", "also_in": [ "RRP-P01-relation-hi-r1", "RRP-P09-relation-hi-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "key", "anchor_id": "RRP-P08-where-hi-r1", "field": "accepted_meaning", "quote": "मेज़ के नीचे", "severity": "medium", "category": "key_error", "comment": "'गेंद अब कहाँ है?' names no reference, so in this scene \"डिब्बे के बगल में\" is an equally true, complete answer, but only \"मेज़ के नीचे\" is listed.", "suggestion": "Add the other true answers for the unqualified where item (P08: \"डिब्बे के बगल में\"; P01: \"कुर्सी से दूर\"; P09: \"ट्रे पर रखे डिब्बे में\"), or name the reference in the where prompt.", "also_in": [ "RRP-P01-where-hi-r1", "RRP-P09-where-hi-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "question", "anchor_id": "RRP-P13-relation-hi-r1", "field": "prompt", "quote": "चलने का रास्ता", "severity": "medium", "category": "translation", "comment": "'चलने का रास्ता' means a walking route; a ball or car that is moved by hand does not 'walk', so the phrase is unnatural and adult-like for describing into/out of/through/toward.", "suggestion": "Ask what happened to the object, e.g. P13: \"गेंद कहाँ गई?\"; P19: \"गाड़ी किधर गई?\"", "also_in": [ "RRP-P14-relation-hi-r1", "RRP-P15-relation-hi-r1", "RRP-P16-relation-hi-r1", "RRP-P17-relation-hi-r1", "RRP-P18-relation-hi-r1", "RRP-P19-relation-hi-r1", "RRP-P20-relation-hi-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "question", "anchor_id": "RRP-P01-message-hi-r1", "field": "prompt", "quote": "संदर्भ साफ़ बताओ", "severity": "medium", "category": "learner_wording", "comment": "The message prompt is identical in all cases, calls the item 'चीज़' instead of naming it, and adds 'संदर्भ साफ़ बताओ', a meta-linguistic instruction early learners cannot act on.", "suggestion": "Name the item per case, e.g. P01: \"साथी को बताओ, गेंद कहाँ है।\"", "also_in": [ "RRP-P02-message-hi-r1", "RRP-P03-message-hi-r1", "RRP-P04-message-hi-r1", "RRP-P05-message-hi-r1", "RRP-P06-message-hi-r1", "RRP-P07-message-hi-r1", "RRP-P08-message-hi-r1", "RRP-P09-message-hi-r1", "RRP-P10-message-hi-r1", "RRP-P11-message-hi-r1", "RRP-P12-message-hi-r1", "RRP-P13-message-hi-r1", "RRP-P14-message-hi-r1", "RRP-P15-message-hi-r1", "RRP-P16-message-hi-r1", "RRP-P17-message-hi-r1", "RRP-P18-message-hi-r1", "RRP-P19-message-hi-r1", "RRP-P20-message-hi-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "question", "anchor_id": "RRP-P01-ask-hi-r1", "field": "prompt", "quote": "उसकी जगह पूछकर पता करो", "severity": "medium", "category": "learner_wording", "comment": "'चाहो तो साथी से उसकी जगह पूछकर पता करो' is long and indirect; 'उसकी' has no antecedent because the item is hidden and unnamed. The same wording repeats in every case.", "suggestion": "Name the item and keep a neutral invitation, e.g. P01: \"गेंद छिपी है। तुम साथी से पूछ सकते हो।\"", "also_in": [ "RRP-P02-ask-hi-r1", "RRP-P03-ask-hi-r1", "RRP-P04-ask-hi-r1", "RRP-P05-ask-hi-r1", "RRP-P06-ask-hi-r1", "RRP-P07-ask-hi-r1", "RRP-P08-ask-hi-r1", "RRP-P09-ask-hi-r1", "RRP-P10-ask-hi-r1", "RRP-P11-ask-hi-r1", "RRP-P12-ask-hi-r1", "RRP-P13-ask-hi-r1", "RRP-P14-ask-hi-r1", "RRP-P15-ask-hi-r1", "RRP-P16-ask-hi-r1", "RRP-P17-ask-hi-r1", "RRP-P18-ask-hi-r1", "RRP-P19-ask-hi-r1", "RRP-P20-ask-hi-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "case", "anchor_id": "RRP-P01", "field": "asking_setup", "quote": "छिपकर रखे", "severity": "medium", "category": "translation", "comment": "'साथी चीज़ ... छिपकर रखे' means the partner hides himself/herself while placing it, not that the object is placed out of the child's sight, and it clashes with 'आवश्यक वस्तुएँ न छिपाएँ'. The paragraph is also identical in all cases, never names the object or locations, and uses formal words ('सुलभ', 'चयन').", "suggestion": "Per case, e.g. P01: \"अलग बारी में साथी बच्चे को दिखाए बिना गेंद को डिब्बे के बगल में या कुर्सी के नीचे रखे। बच्चा पूछे तो बताएँ और दिखाएँ। बच्चे का AAC और ज़रूरी चीज़ें पास रखें।\"", "also_in": [ "RRP-P02", "RRP-P03", "RRP-P04", "RRP-P05", "RRP-P06", "RRP-P07", "RRP-P08", "RRP-P09", "RRP-P10", "RRP-P11", "RRP-P12", "RRP-P13", "RRP-P14", "RRP-P15", "RRP-P16", "RRP-P17", "RRP-P18", "RRP-P19", "RRP-P20" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "case", "anchor_id": "RRP-P01", "field": "setup", "quote": "कुर्सी से दूर रखो", "severity": "medium", "category": "register", "comment": "Setup text is addressed to the adult but uses the informal child-style imperative (रखो, पूछो, लो, दिखाओ), while the asking setup and lesson address the same adult with आप-forms (दिखाएँ, छिपाएँ, जाँचें); P06 setup uses yet another form (रखे). Adult instructions read as if spoken to the child and the register is inconsistent.", "suggestion": "Use one adult register for all practitioner text, e.g. \"गेंद डिब्बे के बगल में और कुर्सी से दूर रखें। पहले डिब्बे के बारे में पूछें; कुर्सी के बारे में अलग बारी में पूछें।\"", "also_in": [ "RRP-P02", "RRP-P03", "RRP-P04", "RRP-P05", "RRP-P07", "RRP-P08", "RRP-P09", "RRP-P10", "RRP-P11", "RRP-P12", "RRP-P13", "RRP-P14", "RRP-P15", "RRP-P16", "RRP-P17", "RRP-P18", "RRP-P19", "RRP-P20" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "question", "anchor_id": "RRP-P01-follow-hi-r1", "field": "prompt", "quote": "गेंद डिब्बे के बगल में रखो।", "severity": "medium", "category": "answer_leak", "comment": "As listed, the follow instruction states the exact relation and reference immediately before the message item asks the child to say where the ball is, so the message answer is modelled word-for-word in every case.", "suggestion": "Present the message item before the follow instruction, or rebuild the scene differently between them, and record any preceding model as exposure/help.", "also_in": [ "RRP-P02-follow-hi-r1", "RRP-P03-follow-hi-r1", "RRP-P04-follow-hi-r1", "RRP-P05-follow-hi-r1", "RRP-P06-follow-hi-r1", "RRP-P07-follow-hi-r1", "RRP-P08-follow-hi-r1", "RRP-P09-follow-hi-r1", "RRP-P10-follow-hi-r1", "RRP-P11-follow-hi-r1", "RRP-P12-follow-hi-r1", "RRP-P13-follow-hi-r1", "RRP-P14-follow-hi-r1", "RRP-P15-follow-hi-r1", "RRP-P16-follow-hi-r1", "RRP-P17-follow-hi-r1", "RRP-P18-follow-hi-r1", "RRP-P19-follow-hi-r1", "RRP-P20-follow-hi-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "question", "anchor_id": "RRP-P08-follow-hi-r1", "field": "prompt", "quote": "वह डिब्बे के बगल में भी हो सकती है", "severity": "medium", "category": "learner_wording", "comment": "A practitioner note is inside a child-directed instruction, and a second clause with another relation reads as a second task. P10's 'बिल्कुल बीच के केंद्र में होना ज़रूरी नहीं है' has the same problem and 'बीच के केंद्र' is redundant.", "suggestion": "P08: \"गेंद मेज़ के नीचे रखो।\" P10: \"ब्लॉक दोनों कपों के बीच रखो।\" Move the notes to setup or scoring guidance.", "also_in": [ "RRP-P10-follow-hi-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "question", "anchor_id": "RRP-P11-where-hi-r1", "field": "prompt", "quote": "टोकरी अब कहाँ है?", "severity": "medium", "category": "scene_ambiguity", "comment": "Only the chair moves in this case; asking where the basket is 'अब' implies the basket moved and invites answers like \"वहीं\". The child is not told to use the chair.", "suggestion": "\"कुर्सी देखो। टोकरी कहाँ है?\"", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "question", "anchor_id": "RRP-P11-follow-hi-r1", "field": "prompt", "quote": "कुर्सी ऐसी जगह रखो कि टोकरी उसके बगल में हो।", "severity": "medium", "category": "learner_wording", "comment": "The 'ऐसी जगह ... कि' purpose clause with a pronoun is hard for early learners, and moving a chair is a heavy motor task.", "suggestion": "\"कुर्सी टोकरी के बगल में रखो।\" (बच्चा वयस्क को बताकर भी करवा सकता है)", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "question", "anchor_id": "RRP-P06-follow-hi-r1", "field": "prompt", "quote": "जहाज़ डिब्बे के ऊपर पकड़ो", "severity": "medium", "category": "translation", "comment": "'जहाज़' on its own means a ship; the object is a toy plane ('खिलौना हवाई जहाज़' in the where and message items). The setup has the same shortened word, so the child hears a different object name.", "suggestion": "\"हवाई जहाज़ डिब्बे के ऊपर पकड़ो, डिब्बे को छूना नहीं।\" and in setup \"वयस्क खिलौना हवाई जहाज़ को डिब्बे के ठीक ऊपर पकड़ें...\"", "also_in": [ "RRP-P06" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "key", "anchor_id": "RRP-P06-message-hi-r1", "field": "accepted_meaning", "quote": "डिब्बे के ऊपर, उसे छुए बिना है।", "severity": "medium", "category": "translation", "comment": "'... डिब्बे के ऊपर, उसे छुए बिना है।' is awkward, unnatural Hindi (the adverbial 'उसे छुए बिना' dangles before 'है'), so it is a poor model sentence to score a child's message against.", "suggestion": "\"खिलौना हवाई जहाज़ डिब्बे के ऊपर है।\" (optional: \"वह डिब्बे को छू नहीं रहा।\")", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "key", "anchor_id": "RRP-P06-relation-hi-r1", "field": "accepted_meaning", "quote": "उसे छुए बिना", "severity": "medium", "category": "key_error", "comment": "The accepted meaning requires 'उसे छुए बिना', which early learners will rarely say; \"डिब्बे के ऊपर\" fully expresses the relation. A reviewer may mark a correct short answer as incomplete.", "suggestion": "Use \"डिब्बे के ऊपर\" as the accepted meaning and keep 'not touching' as a scene check, not a required phrase.", "also_in": [ "RRP-P06-where-hi-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "key", "anchor_id": "RRP-P04-relation-hi-r1", "field": "accepted_meaning", "quote": "डिब्बे पर", "severity": "medium", "category": "key_error", "comment": "In Hindi the most natural answer for a book resting on a box is \"डिब्बे के ऊपर\", which is also the answer for the hovering plane in P06, but it is not listed. The on/above contact contrast cannot be shown by the phrase alone in Hindi, so the keys should list 'के ऊपर' and require the contact check separately.", "suggestion": "Add \"डिब्बे के ऊपर\" (P12: \"किताब के ऊपर\"; P15: \"डिब्बे के ऊपर\") as accepted, and note that contact is judged from the scene or a follow-up, not from पर vs ऊपर.", "also_in": [ "RRP-P04-where-hi-r1", "RRP-P12-relation-hi-r1", "RRP-P12-where-hi-r1", "RRP-P15-where-hi-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "key", "anchor_id": "RRP-P15-relation-hi-r1", "field": "accepted_meaning", "quote": "डिब्बे की ऊपरी सतह पर", "severity": "medium", "category": "consistency", "comment": "The English key is the path meaning 'onto the box', but the Hindi key is a static, formal location ('on the upper surface of the box'), so the Hindi item no longer tests the movement. 'ऊपरी सतह' is also not early-learner vocabulary.", "suggestion": "\"मेज़ से डिब्बे के ऊपर\" (alternatives: \"डिब्बे के ऊपर रख दिया\", \"डिब्बे पर\")", "also_in": [ "RRP-P15-follow-hi-r1" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "case", "anchor_id": "RRP-P08", "field": "setup", "quote": "मेज़ का संदर्भ साफ़ दो", "severity": "low", "category": "translation", "comment": "'संदर्भ देना / संदर्भ पूछना' is a literal calque of 'give/ask the reference' and reads unnaturally (P09 'डिब्बे का संदर्भ पूछो', P10 'दोनों कपों का संदर्भ दो', P12 'किताब के संदर्भ में ब्लॉक पूछो'). 'नया अवसर लो' in P01 is a similar calque of 'fresh turn'.", "suggestion": "P08: \"प्रश्न में मेज़ का नाम साफ़ लें।\" P09: \"चम्मच के बारे में डिब्बे का नाम लेकर पूछें, ट्रे का नहीं।\" P12: \"किताब का नाम लेकर ब्लॉक के बारे में पूछें।\" P01: \"कुर्सी के बारे में अलग बारी में पूछें।\"", "also_in": [ "RRP-P01", "RRP-P09", "RRP-P10", "RRP-P12" ] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "case", "anchor_id": "RRP-P04", "field": "setup", "quote": "बिना छुए सहारे पर रखो", "severity": "medium", "category": "translation", "comment": "'अलग तुलना में किताब डिब्बे के ऊपर बिना छुए सहारे पर रखो' is garbled ('in a separate comparison place the book above the box on support without touching'); it does not say what holds the book, or that it is a separate turn with one arrangement visible.", "suggestion": "\"अलग बारी में वयस्क वही किताब डिब्बे के ठीक ऊपर पकड़ें, डिब्बे को छुए बिना; एक समय में एक ही व्यवस्था दिखाएँ।\"", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "lesson", "anchor_id": null, "field": "lesson", "quote": "प्रश्न elicited है", "severity": "medium", "category": "translation", "comment": "An English technical term ('elicited') is left inside the Hindi guidance sentence.", "suggestion": "\"सामान्य आमंत्रण के बाद पूछा गया प्रश्न 'प्रेरित' प्रश्न माना जाए; कहाँ का संकेत या पूरा नमूना अतिरिक्त मदद है।\"", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "lesson", "anchor_id": null, "field": "lesson", "quote": "Four assessor-only routines and keys", "severity": "medium", "category": "translation", "comment": "The whole 'Reserved assessment' section of the Hindi lesson is still in English and shows internal file names (heldout_cases.json, heldout_keys.json) to practitioners.", "suggestion": "\"आरक्षित मूल्यांकन: चार प्रसंग और उनकी कुंजियाँ केवल मूल्यांकनकर्ता के लिए अलग रखी गई हैं और इस पाठ में शामिल नहीं हैं। पिछली इकाइयों और सभी भाषाओं में बच्चे का पूर्व अनुभव जाँचें; अज्ञात इतिहास में स्थानांतरण का दावा न करें।\"", "also_in": [] }, { "unit_id": "RELATION-REFERENCE-PATH", "language": "hi", "anchor_type": "unit", "anchor_id": null, "field": null, "quote": null, "severity": "low", "category": "translation", "comment": "All scorer guidance in the Hindi keys (alternative_rule, rubric, ambiguity_note) is English only, so Hindi-only reviewers cannot read the rules they must apply.", "suggestion": "Provide Hindi versions of the alternative rule, rubrics and ambiguity note in hi/keys.json (or show both languages).", "also_in": [] } ]