Modelpalooza Judging Process
Judges will generally be assigned to one of two shifts on Saturday to score entries:
10 AM until 12pm
1 PM until 3pm
There will be a little judging done Friday night also - Our Head Judge will lead this effort. Judges need to be prepared to score model entries for at least two and possibly three of our Entry Groups below. Judges also need to be available for consultation on scores and follow-up questions from the Head Judge.
The purpose of this guide is to prepare all Judges for the “Open System” scoring process as it will be implemented by Modelpalooza. The general idea is to award each Entry based upon its own merits rather than by comparing the entries together as in the 1st, 2nd and 3rd places of typical IPMS shows. All Entries in Modelpalooza will be organized into eight general Groups:
•Miscellaneous Other (anything not otherwise classified below) - Specific Instructions
•Dioramas and Vignettes - Specific Instructions
•Individual Figures - Specific Instructions
•Science Fiction/Mecha/Real Space Vehicles - Specific Instructions
•Nautical Craft - Specific Instructions
•Military Armor/Ordnance/Vehicles - Specific Instructions
•Automotive Cars/Trucks/Vehicles - Specific Instructions
•Aircraft - Specific Instructions
The Judging process will be conducted as follows:
All Judges will be assigned a unique Judge ID - write your number down. We have introduced the new "Adult - Basic Skill" division, however the judges should make no distinction in scoring between the two adult divisions. An adjustment factor will be made automatically for the new adult division in the ModelBase scoring system. So judges will score all divisions the same (except Juniors).
1) Together with other assigned Judge, look at the Contestant ID number on the form and identify all of a given Contestants Entries which should be placed together on the display table. Talk amongst yourselves and quickly assess all of the Contestants Entries and determine if they are all of similar quality. If one Entry stands out as being better, you will only score that one Entry. If the entries are similar, then Entries are scored as a collection so that a "Display Medal" may be awarded. If you are judging all entries as a group, write the word "Display Medal" on the top of one Entry. Then separate the Entry sheets from all of that Contestant’s Entries leaving only the Pink copy on the display table. The White and Yellow copies are distributed to the Judges.
2)Remove the White and Yellow copies from the rest of the Contestants' Entry slips – even those which are not to be scored – draw a vertical line through the scoring area of the Entries which will not be scored. When you are finished judging a given contestant, there should only be pink slips on the table.
3) The Judge should turn over the selected Score sheet to be marked and record their unique Judge Number on the top of the selected Entries Scoring Form. Then Judges should determine which criteria are present for the Entry by placing a check mark in the “Max. Possible” column. For missing criteria, draw a line through the “Max Possible and “Raw Scores” boxes as shown in the examples. Confirm that both judges will be scoring the same criteria.
4) Consider the entry score sheet and determine if it is "OOTB" or "Scratch-built". Verify each of these - instructions should be present for OOTB entries. OOTB Entries must be an unmodified commercially produced kit, WITH KIT INSTRUCTION SHEET provided next to the model. If no instruction sheet is present, the Entry will not be judged as OOTB. Judges should then refer to the front side of the Entry Sheet and cross out the OOTB marking. Seams may be filled if necessary, rigging, antennas and paper seat-belts may be added. Entry may be painted as desired and substitute decals may be used (same as regular IPMS rules).
Scratch-built Entries must be more than 50% Contestant supplied parts. Scratch-built models may incorporate parts from other kits, but these should be generally unrelated to their original identity, except for minor parts such as wheels, guns, etc. (same as regular IPMS rules). If it is marked OOTB and there are no instructions present, write "no instructions" on the score sheet. If it appears that a scratch-built entry is not scratched, then write "not scratch" on the score sheet.
5) At last, now to record the Score of the entry. Alone without the other Judge's input, the Judge should then score the Entry (recording the score in the ‘Raw Score’ column) using the 1 to 10 scoring for each of the individual criteria. Refer to the individual instructions for each Group for specific scoring directions. The criteria for each entry group are different - so be careful. You may wish to confer with the other judge on the entry characteristics, but this is not a requirement. Do NOT try to calculate the score for any entry, focus on the proper score for each criteria element.
6) At the end of your shift (or periodically), return all the un-Scored and completed Entry Scoring Sheets to the Registration Desk for review and data entry. The final weighted score is automatically calculated by ModelBase. The Registrar may request additional information from the Judges if issues are identified.
Medals will be generally awarded using this scale (but may be adjusted as necessary):
•Gold / Gold Display Medal - 9 or 10
•Silver / Silver Display Medal - 7 or 8
•Bronze / Bronze Display Medal - 5 or 6
•Highly Commendable Certificate - 3 or 4
•No recognition – 0 , 1 or 2
Score Validation (done by Registar)
After scores are tabulated and keyed into ModelBase, various quality assurance checks will be performed on the Entries score. For example, if Judges Scores are widely dispersed, ModelBase will detect this and provide a report to show these discrepancies. Judges may be asked to re-convene and consider such disparities in scores upon request. One Judge may have seen a problem or error which the other Judge had missed causing a wide variation in scores. Another validation check looks for the same criteria elements being scored for the same Entry.
Score Calibration (done by Registar with the Chief Judges input)
ModelBase also allows for a Judge’s average scores to be calibrated together with other Judges. This means that if one Judge is scoring “hard” and another is scoring “easy”, this can be detected and corrected across a Group and even the entire show. Judges should attempt to just be consistent. We don’t expect all Judges to score identically, so some calibration may be necessary. An overall assessment of the Judges scoring scales will be performed by the Head Judge to determine that there is equality among all the various Groups and these are calibrated together. Judges scores may be revised based upon this assessment.