1. It appears that scoring for each skill consists of summing the number of accurate responses (usually coded as 1’s) to form a simple Total. Is this correct?
Each task involves assessing the task overall (i.e., summing the number of accurate responses). Some tasks also include a measure of near transfer (i.e., shown in the episode) and far transfer (i.e., tasks used in the day’s activities). Near and far transfer need to be scored, recorded, and analyzed separately. Guidance will be provided on near and far transfer tasks. In all cases the score is a simple total.
2. Two of the literacy tasks (i.e., Day 2: Wonder Red Day: Decoding Assessment and Day 3, Part Two: Encoding do not have a line for Total score. Are these two skills nonetheless scored the same way as the other skills (total of 1’s)?
Yes.
3. The RFP asks that the evaluator check the accuracy of scoring of each literacy skill (#2 under Scope of Work); does this entail simply running new totals of the 1’s (or correct responses) on the scoring lines and then ensuring that the Total line is accurate?
Checking the accuracy of scoring entails making sure the individual responses in a skill set were accurately scored and that a correct total was provided for that skill. It also entails ensuring that the overall Total line is accurate.
4. At this point, do you know how many of the roughly 1600 children from summer 2009 have both Pre-Assessment and Post-Assessment data? Do you know how many are missing an entire assessment (either Pre or Post)?
No, we do not have any information on missing data.
5. Are data to be analyzed for only those children who have both Pre and Post assessment data?
Yes, though bidders are welcome to suggest statistical techniques for dealing with missing data.
6. Due to testing over several days, some children may have been absent and will be missing some skill scores. Will these children be kept in the analysis in order to examine those skills for which both Pre and Post data exist?
Children who were absent for one or more days should be kept in the analysis and assessed on the skills for which both Pre and Post data exist.
7. The Post Assessment sheets include 4 separate Age/Ethnicity/Birthday data entry blanks. Is more than one set to be entered in the database?
Only one record of a child’s Age/Ethnicity/Birthday data needs to be created and entered for each child.