Modelpalooza Judging Process
The purpose of this guide is to prepare all Judges for the “Open System” scoring process as it will be implemented by Modelpalooza. The general idea is to award each Entry based upon its own merits rather than by comparing the entries together as in the 1st, 2nd and 3rd places of typical IPMS shows. All Entries in Modelpalooza will be organized into eight general Groups:
•Miscellaneous Other (anything not otherwise classified below) - Specific Instructions
•Dioramas and Vignettes - Specific Instructions
•Individual Figures - Specific Instructions
•Science Fiction/Mecha/Real Space Vehicles - Specific Instructions
•Nautical Craft - Specific Instructions
•Military Armor/Ordnance/Vehicles - Specific Instructions
•Automotive Cars/Trucks/Vehicles - Specific Instructions
•Aircraft - Specific Instructions
The Judging process will be conducted as follows:
1) Together with other Judges in your Group, identify all of a Contestants Entries grouped together on the display table. Quickly assess all of the Contestants Entries and determine if they are all of similar quality. If one Entry stands out as being better, only score that Entry. If they are similar, then Entries are scored as a collection so that a "Display Medal" may be possibly awarded. Then separate the Entry sheets from all of that Contestant’s Entries leaving only the Pink copy on the display table. The White and Yellow copies are distributed to the Judges. (Remove the White and Yellow copies from all Entries – even those which are not to be scored – draw a vertical line through the scoring area of the Entries which are not to be scored). The Judge should turn over the sheet and record their unique Judge Number on the top of the selected Entries Scoring Form. Then Judges should determine the criteria for the Entry by placing a check mark in the “Max. Possible” column. For missing criteria, draw a line through the “Max Possible and “Raw Scores” boxes. Verify that each Judge has recorded the same values and recorded a ‘0’ for any missing criteria.
2) Alone without the other Judges input, the Judge should then score the Entry (recording the score in the ‘Raw Score’ column) using the 1 to 10 scoring for individual criteria. Refer to the individual instructions for each Group for scoring directions.
3) Return the un-Scored (from Collection Entries) and completed Entry Scoring Sheets to the Head Judge for review.
Judge Considerations for Evaluating and Scoring Entries:
- Judges should be familiar with the Contestant Rules for Entry.
- Judges should take into consideration the Entries noted as OOTB or Scratch-built. Judges will use the same scoring criteria, however they should determine if the Entry warrants inclusion in these classifications.
- OOTB Entries must be an unmodified commercially produced kit, WITH KIT INSTRUCTION SHEET provided next to the model. If no instruction sheet is present, the Entry will not be judged as OOTB. Judges should then refer to the front side of the Entry Sheet and cross out the OOTB marking. Seams may be filled if necessary, rigging, antennas and paper seatbelts may be added. Entry may be painted as desired and substitute decals may be used (same as regular IPMS rules).
- Scratch-built Entries must be more than 50% Contestant supplied parts. Scratch-built models may incorporate parts from other kits, but these should be generally unrelated to their original identity, except for minor parts such as wheels, guns, etc. (same as regular IPMS rules).
- After scoring all Entries, the scored Entry Sheets are then returned to the Registrar for data entry. The final weighted score is automatically calculated by ModelBase. The Registrar may request additional information from the Judges if problems are identified.
- When the Entry Sheets are turned in, the ModelBase scoring system will be used to automatically re-calculate and weight the score criteria elements present and determine a final ‘weighted score’ for the Entry.
Medals will be generally awarded using this scale (but may be adjusted):
•Gold / Gold Display Medal - 90 to 100 points
•Silver / Silver Display Medal - 70 to 89 points
•Bronze / Bronze Display Medal - 50 to 69 points
•Highly Commendable Certificate - 30 to 49 points
•No recognition – 0 to 29 points
After scores are tabulated and keyed into ModelBase, various quality assurance checks will be performed on the Entries. For example, if Judges Scores are widely dispersed, ModelBase will detect this and provide a report to show these discrepancies. Judges may be asked to re-convene and consider such disparities in scores upon request. One Judge may have seen a problem or error which the other Judge had missed causing a wide variation in scores. Another validation check looks for the same criteria elements being scored for the same Entry.
ModelBase also allows for a Judge’s average scores to be calibrated together with other Judges. This means that if one Judge is scoring “hard” and another is scoring “easy”, this can be detected and corrected across a Group and even the entire show. Judges should attempt to just be consistent. We don’t expect all Judges to score identically, so some calibration may be necessary. An overall assessment of the Judges scoring scales will be performed by the Head Judge to determine that there is equality among all the various Groups and these are calibrated together. Judges scores may be revised based upon this assessment.