Tests and Exams in Socrato
Can I find the test online / What test material is available online?
Socrato supports two types of tests
For grade 3 - 10 Math and ELA there is a big collection of Items/Question Bank and Test Bank online.
For many of the "Admission Test" like SAT, ACT etc. Socrato provides Online Processing Only. One can purchase or get the test material for these tests from bookseller like Amazon, B&N etc. In majority of the cases, the testing agencies themselves will sell or provide a download of a few sample tests (which are typically past retired tests).
What are the different Tags [S], [S+A], [S+AD] [OQ] at the end of Test Name?
To process and create advance diagnostic analysis from a test it goes through iterative analysis. The tags at the end of test name indicate the Online Practice and Processing capabilities in Socrato. Currently used tags are as follows:
[S] Scoring - Pretty much for every test.
[D] Diagnostic Analysis - Few SAT or ACT tests where you can do scoring and some diagnostic analysis (few graphs do not show up in the report).
[AD] Advance Diagnostic Analysis - Certain admission tests has been fully tagged, so you can generate very detailed diagnostic reports.
[OQ] Online Questions - Typically available for Grade 3 – 10 Math and English tests
Examples:
US Citizenship Test [OQ | S]
MCAS 2006 English [OQ|S|D]
ACT Diagnostic Test (Form 0259C) [S|D]
ACT Diagnostic Test (Form 0964E) [S|AD]
What are the different numbers [#345] at the end of test and exam name?
Many of the Tests has very similar name, Socrato uniquely identified them with a random integer. The number at the end is that unique identifier.
What are the codes (061B or ABFA, CCFA etc.) at the end of Test name?
Testing agencies like CollegeBoard (SAT), ACT org etc. release the past / retired test in any combination of: as sample download, as part of students result, published material via book seller or sells directly. Student can get access to these Tests via purchasing, from libraries, their elder siblings etc. Testing agencies uniquely identifies these retired tests via assigning them certain codes. These codes may be shown at beginning of the test booklet, at the end of the test booklet, or in the footer of the test booklet.
Socrato does not host the questions of these test, but provides processing and diagnostic analysis for retired tests. Users need to make sure they submit the results for the proper tests by looking at the associated codes in the Test name.
What are the FORM CODEs in the SAT Tests?
CollegeBoard which conducts the SAT exams has an interesting way of coding the Tests Name, also known as the Form Code. After talking to a lot of students and educators below is our take.
For a given Test Day there is only 1 Test but 3 Form Codes.
For every test day (example Jan 2010) SAT will create “One Test” (which will have 171 questions organized into 10 sections, 3 for Math, 3 for Reading, 2 for writing, 1 Essay and 1 experimental). Interestingly, in a given subject area, each section will have different number of questions. Example: Three section of Reading will have 24, 25 and 18 questions respectively.
Once this questions and section structure is completed. College Board will create three (our understanding) different sequencing of sections and will create 3 Tests (Forms). Each Test/Form will have its unique code and unique sequencing of Sections. Please note the questions with in the section are in same order.
For SAT the Form Code in my Test does not match with what Socrato can process. How do I handle that?
Enter Results via Excel Copy / Paste:
Before you can use the copy / paste method, you need to get the understating of the sequencing how Socrato will process the results and how they are arranged in your Form Code. You will have to manually rearrange the sections in your excel file and map those to what system expects, before you can copy and paste.
Enter Result via Online Forms
“Login” | “People” | <<Working Group Name>>
On the left menu, click on "Process Tests"
On the "Enter or Upload Results/Scores for Multiple Students" page select the radio button for "Enter Results".
On the next "Enter or Upload Results/Scores for Multiple Students" page follow the instructions to enter results of one or more students.
In content area of the page enter / select following mandatory information:
Select the Exam Category, Test Name, Session Tag, date.
Click on "Add or Select Student" button
In Enter Test Results, click on “Enter Test Results Manually” | Click on “Enter Question Responses”
On the Session Start Page
Select Grid-in Mode
Please note – This will give you accurate scores and diagnostic analysis. Only question response table on page 3, 4, and 5 will be in sequence how system has process them.
Take Test, Enter or Import Scores
How can I generate report for an individual section of test?
<< coming soon >>
Diagnostic Reports & Group Analytics
I accidentally generated a diagnostic report for the wrong test. How do I handle removing it and is it possible to get a credit back for it?
If you generated the report for the wrong test and consumed the credit, there is no automated way to get the credit back. To remove a Result, see the section ‘Edit Delete Student Results’.
Where to find the excel template?
Please see the section ‘Considerations while uploading student results using Excel (copy / paste)’.
How do I add my logo to the report?
Please see ‘Customize-(Brand)-Reports’.
How do I add my company name to the report
Please see ‘Customize-(Brand)-Reports’.
Do you have instructions to do a group reporting?
Please see the sections
We just administered over 100 tests at the high school and we want to be able to show the administration the results...
Please see the sections
We just administered over 100 tests at the high school and we want to be able to show the administration the results...
Please see the sections
How to do generate multiple reports at a time?
• Login to Socrato
• Click “Reports” Tab
• Click “Results”
• Select the Group name in drop down
• Select all the reports you want to generate
• Click “Generate Selected Reports”
• All the reports will be generated
• Reports will be saved in local folder in Zip file
How to Delete Multiple Reports?
• Login to Socrato
• Click "Reports" Tab
• Click "Results"
• Select the Group name in drop down
• Select all the reports you want to delete
• Click "Delete Selected Reports”
• All the reports will be deleted
Personal Account Management
How do change the password?
Please see the section ‘To reset a password via email’.
How to clean and manage old data?
• Login to Socrato
• Click "Accounts” Tab
• Click “Clean up" Results
• Group and session will be listed,
• Click "Details” button
• All the results of that group will be listed.
• Select the session by clicking the check boxes.
• Or select the header check box for all the session.
• Click the button "Delete Results".
• All the old results will be deleted from the selected group.
Group & User Management
How do I move a student from one Group to another?
See ‘Managing (Members) Staff or Students in a group’.
How do I remove a student from a Group?
See ‘Managing (Members) Staff or Students in a group’.
How do I add new person as an admin to my account?
Please see the section ‘Manage members (Staff or Student) with in a group ‘.
Test Scoring
General
If I have same number of questions wrong in 2 practice test, why my scaled score different?
There is an ABSOLUTE SCORE (percentage correct, raw points) and RELATIVE SCORES (percentile, SCALED SCORE).
In order to compare student results from one test to another, testing agencies for exams (like PSAT, SAT, ACT etc.) align, balance, and reports on RELATIVE SCORES (SCALED SCORE) basis.
Example, using this method they can compare Jan 2011 test scores against the May 2011 test score.
Regardless of, how tuned questions are in a test, many a times, the test as a whole is somewhat difficult or easy relative to other tests. So, if a same student takes two different practice tests (Jan 2011 and May 2011) on two consecutive days, they may get a different ABSOLUTE SCORE (that is, PERCENT CORRECT Score).
For any given test day, the overall community of student may have a different caliber. Example Jan date students may be less prepared.
The SCALED SCORE (the balancing of score) is created after the fact and based on the distribution of Absolute scores of the overall students appearing in that test. This scale is non linear (relationship between raw score and scaled score) and the distribution is based on the results of all students. Once done the scale is fixed and is associated with a test.
Let’s take a scenario of SAT Math from Jan and May of given year which has total of 54 questions.
Jan Math test was very difficult, even if someone have 4 questions wrong – they still get full 800
May Math test was easy, in this situation, one will need all 54 question right to be at 800
SAT Test Scoring
I have 3 question wrong in SAT and still the score is perfect of 800, how is that possible?
Admission test like SAT, ACT etc. has different types of scores. The raw score, percentage, the percentile, the scaled score etc.
SAT takes student Raw Score and converts to a Scaled Score in the range of 200 to 800. The conversion from Raw Score to Scaled Score is not a linear conversion. So for 0 correct responses student can still get minimum score of 200. Likewise the Scaled Score can be 800 even if few questions are wrong.
No question was attempted in a section but the score is still 200 in SAT test. How is it possible?
SAT takes student Raw Score and converts to a Scaled Score in the range of 200 to 800. The conversion from Raw Score to Scaled Score is not a linear conversion. So for 0 correct responses student can still get minimum score of 200. Likewise the Scaled Score can be 800 even if few questions are wrong.
Why for certain SAT tests scaled scores are odd numbers (ending in 5), they are supposed to be an even number (ending in 0)?
In SAT official book version 2 (with 10 SAT tests), there are 2 scoring mechanism.
For test 1 to 3 – The raw score to scaled score conversion is done as a single number. This is the new method that is used in all new (post 2005 changes) released tests.
For test 4 to 10 - The raw score to scaled score conversion is done as a range. This was also done for the pre 2005 released SAT tests.
For test #4 – In Critical Reading section raw score of -1 has scaled score range of 200 – 290.
In same tests, for writing section, raw score of 23 with essay score of 5 translates in a range 500 – 630.
While processing results, there are four option to calculate scaled score, each with its pros and cons.
Show as range – All new tests are scored as single number, users are not familiar with this.
Show minimum – It creates perception that scores are artificially reduced.
Show maximum – It creates perception that scores are artificially inflated.
Show average – Many times the score ends with odd number, causes confusion. So for above examples, student will get 245 in reading and 565 in writing.
After experimenting with all above, we settled on #4 (show average scores).
Uploading ....