Random Test Generator-PRO

Random Test Generator-PRO
PC Windows 32-Bit Software

For Microsoft Windows 95/98/NT4/ME/NT2000/XP Operating Systems Version 8.2
A Product of Hirtle Software

http://www.hirtlesoftware.com
Hirtle Software
Information contained in this document may change without notice. It is acknowledged that there may be errors or omissions in this publication for which responsibility cannot be assumed. No liability will be accepted for loss or damage resulting from use of information contained in this manual or from uses as described. No part of this document may be reproduced or transmitted by any means electronic or mechanical, for any purpose, without the express written permission of Timothy L. Hirtle. All information contained in this document is copyrighted 1995-2004 by Timothy L. Hirtle. The use of the term; Hirtle Software refers to Timothy L. Hirtle, an individual. Hirtle Software is used for product identification purposes only. This product uses Microsoft Agent Technologies. Microsoft Agent is copyrighted by Microsoft Corporation 1996-1998. The furnishing of this document does not give you license to the information contained herein or the Random Test Generator-PRO software. http://www.hirtlesoftware.com
Hirtle Software
Contents
Topic
Introduction
Page
6 8 10 12 13 16 17 20 21 23 24 25 27 31 37 38 39 44 46 47 48 50 51
Installing Random Test Generator-PRO
Getting Started
Context Sensitive Help
Chapter 1: Creating TestBanks Navigating TestBanks Adding New Questions to TestBanks Deleting Questions from TestBanks Using Question IDs (QIDs) in Test Questions Using References in Test Questions Providing Answer Explanations to Test Questions Providing Manual Point Values to Test Items Grouping Test Items Together Using Multimedia Files Viewing Multimedia Files Printing TestBanks Importing Test Data From Other Software
Chapter 2: Editing TestBanks Using the FIND Option Using the REPLACE Option Using Spell Checking and Thesaurus Validating TestBanks Using Font Capabilities
Hirtle Software
Topic
Chapter 3: Creating Tests Controlling What Gets Printed Saving/Recalling Commonly Used Test Settings Test IDs and Answer Keys Internet Testing Modifying Test Settings
Page
56 67 73 75 77 86 87 91 93 97 99 103 106 108 109 110 112 117 121 123 126 129 132
Chapter 4: Administering Student Tests Creating Test Bubble Answer Sheets Re-Administering The Same Tests Reviewing Completed Tests
Chapter 5: Grading Tests Creating Test Answer Keys Using the Passing Score Setting
Chapter 6: Reports and Analysis Grade Report Test Performance Analysis Test Item Analysis Test Item Analysis Editor
Chapter 7: Accounts Administration Administrating Applications Master Password Administrating Student/Instructor Accounts Assigning Student Tests Activity Log
Hirtle Software
Topic
Chapter 8: Advanced Tools Repair/Compact Files Backing Up TestBank Files Viewing TestBank Properties Changing Print Margins Password Protecting TestBanks and Student Tests Using Speech Capabilities Creating PDF Student Tests & Reports
Page
133 133 135 136 138 139 142 148 150 150 152 154 155
Chapter 9: Licensing/Support Licensing Postal Mail Order Form Receiving Technical Support Contacting Hirtle Software
Hirtle Software
Introduction
Random Test Generator-PRO is designed for educators at any level to develop TestBanks of test items from which randomly selected test items are then extracted to create student tests. Each TestBank acts as a repository to house a wide range of test items for specific topics. There are no limits to the amount of test items which can be stored in each TestBank and no limit to the number of TestBanks which may be created. You may use multiple TestBanks to create student tests. Test Items may comprise of multiple choice, True/False, Fill-in and/or essay types. Multiple choice test items may also have multiple answers if desired. All your test items can be spoken out-loud as well as read from the screen. This Text-to-Speech (TTS) feature provides students an added (optional) benefit to hear a crisp computer synthesized voice reading questions and answer choices out-loud. Hundreds of languages and visual characters are available to download and use for FREE. The Test Builder option can be set to identify exactly how many questions to select from each TestBank to create a single test. Random Test Generator-PRO will then randomly select test items within each TestBank requested without selecting the exact same question twice. These tests may be administered on the computer with an optional timer, printed on paper or administer via the Internet. Since each test is unique, custom answer keys may be printed for every student test developed. Printed tests and their associated answer keys are provided with the same ID number so they can easily be matched up. Tests administered on computer may be automatically graded in seconds. Tests administered via the Internet allow students to easily submit their answers via e-mail for grading with a single-click. In addition to standard tests where students do not receive test results (feedback) until provided for by the instructor, you may also create tests as Practice Tests. Tests created in this mode will allow students to immediately receive feedback after they have completed their tests and even receive full explanations as to the true correct answer. You may add images, animations, movies, sound/music and/or any other files in which your computer supports to any test item. These media files may be embedded directly into your TestBanks or linked to files on your computer. TestBanks and completed tests are maintained in Microsoft Access Database (MDB) files for reliability and security. Best of all, MS-Access itself is not required to use with this product, all the functionality is built into Random Test Generator-PRO. A Test Item Analysis feature has been added which will keep track of all your test items as to how students are performing against them to help you decide the validity of each of your test items. Your TestBanks, students tests, Test Item Analysis Reports and a variety of other reports may be saved to Rich Text Formatted (.RTF) and/or Text (.TXT) files. RTF files may be directly used with most word processing software such as MS-Word. This format retains the exact same font attributes used in your word processor and Random Test Generator-PRO. Therefore, you can edit these files between these applications without losing any formatting. There are many important uses for this software, here are just a few examples: Provide your entire class tests on the same subject without any two students having the exact same test. In this situation each test would have many different randomly selected test items although based on the same topics (TestBanks). This method makes it near impossible for students to cheat off each other. Provide your class the exact same test questions but the question order being different from test to test. In this situation every student will be provided the exact same test items, but the order in which they are presented these test items will be different for every test. For example, question #5 for one student will be different compared to the same question #5 for another student. This method ensures your tests are identical (same test items) but makes it very difficult for student to cheat off of each other. Provide a single test for the entire class whereby each student has the exact same test and the question order is the same but by using this software to create the test, the test items will be selected randomly ensuring that your tests are not compromised beforehand. http://www.hirtlesoftware.com
Hirtle Software
Random Test Generator-PRO is an ideal prep (preparation) tool to be used by those learning/studying any discipline since it stores an unlimited amount of test items. Therefore, it can be used for any single or group of subjects. Test items are randomly selected and thus may be randomly presented much like flash/index cards are often used when preparing for an examination.
All these uses for this software allow you to create student tests at anytime (and on the fly) since all your possible test items already reside in your TestBanks. Its just a matter of using the Test Builder within RTGPRO each time you need to create new student tests. Simply select the TestBanks you wish to use, and identify how many test items from each TestBank should be randomly selected. Your new tests will then be created in mere seconds. Its that simple. What could be easier? You no longer need to sit down and create student tests manually. This software allows you to get away from using the same student tests class after class which leaves them open to be compromised much more easily. Random testing is the most secure and versatile testing method available. It is a useful tool for any public, private or business institution in which testing is conducted regardless of the subject matter. This software is a cheaters' worst nightmare and a must for educators at any level. The Shareware/Trial version of this program is designed to demonstrate the capabilities of this software. Therefore, it has limitations imposed. The following is a list of limitations in which the Shareware version imposes: A maximum of 25 questions may be added to TestBanks. (No question limit for registered version) A maximum of 10 questions can be selected to create random tests. Includes screen or printed tests. (No question limit for registered version) Starting and exiting program will display registration reminder windows. (No reminder screens will auto display for registered version) Registration advertising on toolbar. Unable to hide toolbar. (No toolbar advertising and toolbar may be hidden for registered version)
Hirtle Software
Installing Random Test Generator-PRO

This software is designed to run on any 32-bit Windows operating system such as Microsoft Windows 95, 98, NT 4, NT 2000, ME and XP.
New Installations
After you have downloaded the software you must then install it onto your computer. This is done by simply double-clicking the downloaded file using Windows Explorer or by selecting the file using the Windows Taskbar Start menu and selecting the Run option. Then select the Browse button and point to the downloaded file and then select OK to begin installation. Simply follow the directions on the screen. After the installation has been successfully completed, the original downloaded file may be deleted since it is no longer needed. However, you may wish to retain it if you wish to install this software on another computer at a later date. After the software is installed there will be an icon in your Windows Taskbar Start menu. Simply select it to run this software. If you are evaluating this software without purchasing it immediately, click the Continue Unregistered button. This will allow you access to the software but impose limitations as explained in the Introduction section above. If you have purchased a license from Hirtle Software, you will be provided a registration code which will allow you full access to the software without limitations. You should enter the registration code into the Registration Code field when prompted and then select the Register button. You will then have full access to the software.
Upgrading or Re-Installing
Before you upgrade to a newer version or re-install RTG-PRO, you should make back-up copies of all your TestBanks (.MDB) and student test (.TST) files and store them in a safe location, if they are currently in your current RTG-PRO folder or a sub-folder of it. This is a precautionary measure. You should then uninstall your current version using the ADD/REMOVE PROGRAMS option from the CONTROL PANEL located in the SETTINGS selection from the START menu. After the old version has been uninstalled, you can install the new version using the same procedures described above. Once your upgrade or re-installation is complete, you can then copy your saved TestBanks and student test files back into the RTG-PRO folder (if desired) and you are now ready to run the software. If you receive an error during installation which states; "The AGENTSVR.EXE file is linked to missing OLEAUT32.DLL:227" This is caused when you have out of date Windows system files. This software will update these files during installation. But, because the files did not exist during installation, a second install of this software is required to complete the installation. If this error occurs, simply re-install this software a second time. The 2nd install will work because the updated files will be present from the 1st install. After installation if you are satisfied with the Text-To-Speech functionality, the following files located in your installation directory are no longer needed and may be deleted from your computer: MSAGENT.EXE TV_ENUA.EXE SPCHAPI.EXE GENIE.EXE http://www.hirtlesoftware.com
Hirtle Software
Network Installations
Random Test Generator-PRO does not come with a specific network version for installation. However, this software runs perfectly fine from a network system. In this section we will explain how you can operate this software from a network without needed a special network version. Please note that with most software products you are required to account for all network nodes (connections) for the number of licenses you have purchased. Therefore, if your network contains 50 connections, that this software is enabled, then you are required to have purchased 50 licenses. Please see the licensing section in Chapter 9 for more information. We highly recommend that an experienced network administrator or computer savvy person perform these tasks. Although, it is not particularly difficult, there are some tasks in which a network administrator should be able to perform with ease. Follow these steps to allow Random Test Generator-PRO to run from a network: Install Random Test Generator-PRO on each workstation you wish the software to be used on. This includes either for Faculty/Test Administration or students who would be taking their tests from. On your file server, create a folder such as RTG-PRO or any name you wish. This folder should be accessible from each workstation in which you have installed RTG-PRO onto. This includes that the appropriate permissions are granted for read and write for this folder for the various user accounts. Copy the installed RTGPRO.EXE, TEMPLATE.TPL and ACCOUNTS.AZZ files from the installation directory from one of your workstations into your new folder on the file server. The default installation directory on local workstations is; C:\Program Files\Hirtle Software\Random Test Generator If you used the defaults when installed, this is where you will find these files. If you have any TestBank (.MDB) or student test (.TST) files you have already created, then copy them also to your file server in a location where all workstations (user accounts) have access and read/write permissions. Optionally, if you wish the help files to be enabled, you can copy over the HelpFiles folder from one of the workstations into the file server folder where RTGPRO.EXE is contained. This is also true for the Samples directory if you wish access to the sample TestBank files. Now delete the RTG-PRO installation folders and its files from each workstation. This includes all sub-folders, RTGPRO.EXE, etc Finally, change each icon shortcut for Random Test Generator-PRO at every workstation so that it now points to the RTGPRO.EXE file on your file server instead of the local workstation.
Thats all that is required to run Random Test Generator-PRO from a network. It is necessary to install it on each workstation in the beginning because many Windows system files will be installed which do not reside in the installation folder for your workstations. Therefore, when your run RTGPRO.EXE from a workstation that points to the file server, these system files must be already contained on that local workstation. If not, the software will not function correctly. If you wish to add an additional workstation at a later date, you still must install the software on that workstation first. You would already have the necessary files on the file server. Therefore, you simply install the software on the new local workstation, delete the installation folder from the workstation and re-point the Random Test Generator-PRO shortcut icon to the RTGPRO.EXE file server location. Now every workstation will be using the same executable file (RTGPRO.EXE) from your file server. This also provides that each workstation will access the same templates and accounts from your file server folder. Finally, this configuration allows every workstation access to the same TestBank (.MDB) and student test (.TST) files making Random Test Generator-PRO fully networked without having to purchase an expensive network version.
10
Hirtle Software
Getting Started
In order to create randomly generated student tests, you must have created one or more TestBank files in which test items may be extracted from. TestBank files act as a repository of questions for a given topic. These TestBank files are created by you. You add the questions, all answer choices and provide the true answer to each test item. As an option, you may provide media files such as images or animations to any test item. This information resides in a database and is eligible to be selected by the randomizer if you identify the TestBank file to create a new test with. Think of a TestBank file as a warehouse of test items. When you build a test, test items are extracted from this warehouse on a random basis. You identify the amount of questions from each TestBank (warehouse) and which TestBanks to use for a given test. These tests may be built for paper testing, the computer screen or the World Wide Web (WWW) for Internet/Intranet use. With this in mind, here is the typical process to get started designing TestBanks, building and administering student tests:
Creating a New TestBank

Create one or more TestBank files for the topic(s) of your choice by selecting NEW from the FILE menu option then select TESTBANK or select the New Icon the toolbar. Type-in the name of you TestBank file you wish to use. on
Editing Your New TestBank

Add questions you wish to include in the TestBank repository for each TestBank you create. You must provide all answer choices, true answers, QIDs and media file/locations (if used) for each question. You may update these files at anytime by selecting OPEN from the FILE menu or Open Icon on the toolbar.
Building a New Test

Select TESTS from the main menu and then choose the TEST BUILDER option. Identify which TestBank files you wish to use for your new test, how many questions to use for each TestBank file and whether you wish paper tests, screen tests or Internet tests (WEB). You may also set up an optional test title, passing score, and timer (applicable to screen tests only) values. Then select the number of (unique) tests you wish to be created. Select ACCEPT when done setting up your test.
11
Hirtle Software
Administering Tests
If a SCREEN TEST was selected your test will appear in seconds with questions from each TestBank selected at random. If a PAPER TEST was selected you will see a printable form appear with you random test ready for review and print. If . WEB TESTS (HTML) will write all the acceptable, just select the Printer Icon code necessary to create an online web test. Once created an option to send your new Internet tests and their associated media files (if necessary) to your web server via FTP using this software will display.
Grading the Test

Optional. After a SCREEN TEST was completed by the student you may automatically GRADE the test or review the student's test manually. Printed tests will include a customized answer key since each test will be unique. Two Internet tests designs are provided one is auto-graded immediately for students, the other will auto-send a students' answers to an instructor (via e-mail) for grading.
Analyze the Test and Test Items

Optional. All screen tests automatically record student selections. The TEST ITEM ANALYSIS option from the STATISTICS menu display a wealth of information about which answer choices students are selecting per test question. Use this tool to judge your test items and their answer choices. Since paper and Internet tests cannot record student answer selections automatically, you may manually record student answers via the Test Item Analysis Editor.
These are the typical steps used to create TestBanks, edit them, creating student tests, administer them to students, grade student screen tests, analyze your tests and perform test item analysis. These are the basic steps you would use to maximize the capabilities of this software. However, many other tools are available to allow you to take advantage of this software which will be discussed in detail in the following chapters as well as in-depth information about the steps above. Selecting the SPEECH SETTINGS from the TOOLS menu will afford you the opportunity to have test items heard as well as read for TestBank and student tests (if desired).
12
Hirtle Software
Context Sensitive Help

This product provides context sensitive help for many of the options available. Context sensitive help is a help service which provides specific help information only about the current window and object you select. Therefore, you do not have to sort through a huge help file to find out the information you need. This quick help information will provide the purpose of the object as well as potential uses. To obtain help information about an object of your choice follow these steps: Right-click on any object and select the WHATS THIS popup menu item option. Note: In this example one of the answer choice letter (buttons) was selected.
Immediately a pop-up QUICK HELP window will display providing you only the information about the object you selected in the previous step.
You may keep this QUICK HELP window open if you desire, any new object you right-click and select the WHATS THIS menu option will then update this QUICK HELP window with the information on the new object. In addition, you may select the DISPLAY WINDOW ON TOP OF OTHER WINDOWS checkbox on the bottom of the QUICK HELP window. This will then keep this help window on top (in front) of other windows for your convenience. This context sensitive help feature is designed to provide just the essential details about the purpose of an object and methods in which it can be used. However, for detailed information about any feature of this software you should refer to this guide.
13
Hirtle Software
Chapter 1 Creating TestBanks

Random Test Generator-PRO requires TestBanks in order to extract questions from to create student tests with. The idea behind TestBanks is to maintain a large variety of potential test questions for a specific topic. This program will extract a specified amount of test items as requested by you from any or all TestBanks you identify. This allows you to provide fresh and uncompromised tests time after time. You could provide every member in your class a test on the same information, but have each test be unique. The potential is limitless. To get started, the first thing you should do is create TestBanks for topics of your choice. Here are the steps to create a new TestBank: Select NEW and then TESTBANK from the FILE menu item or the New Icon on the toolbar.
Type-in a unique file name of your new TestBank file, then press the SAVE button.
14
Hirtle Software
Select whether you wish your first test item to be either a Multiple-Choice or Fill-In/Essay question type., then select the ACCEPT button.
An empty TestBank file will then be created ready for you to begin entering questions, answer choices, answers, answer explanations and references to. This form is the same as if you opened an existing TestBank. Simply select the test item type (Multiple-Choice/True-False or Fill-in/Essay) and start entering your test questions.
This program comes with two sample TestBank file named "Sample.mdb" and Sample1.mdb located in a folder called SAMPLES, a subdirectory of your installation directory. These examples demonstrate TestBanks and their functionality. Please open these files to observe the capabilities of TestBanks. You cannot change question types once created. Multiple-choice/true-false and fill-in/essay question types are permanent. Therefore, in order to modify a test item to a different format, you will have to delete the original test item and add a new test item with the format you desire. TestBank files should be based on a single subject, sometimes even a topic within a subject. Ideally the questions within a single TestBank file should be all about equal in difficulty. In this way, questions randomly selected from it should be on par (in difficulty) with all other questions contained. Therefore, students who take different tests from the same TestBanks will be on equal footing. Thereby, eliminating some students receiving "easy" and others receiving "difficult" tests. Especially if they are graded on a curve. You may wish to consider a method to create TestBanks which is very flexible. For instance, if you have a school book used in the class, you may want to create different TestBanks by chapters, rather than the entire books worth of questions in the same TestBank. Otherwise, you may be randomly selecting questions on chapters that you have not yet reached, since the single TestBank cannot discriminate within itself. Therefore you may wish to create TestBanks such as: MATH101-CHAP1.MDB, MATH101-CHAP2.MDB, etc..... If you want to test chapters 1 through 5, then you can select just these TestBanks in the TEST BUILDER function. In this case, no other chapters are used, thus eliminating randomly selected test questions on material in which has not been covered in class. This is a very flexible way to create TestBanks. Your next test could be chapters 6 through 8, this procedure will work great for that as well. Even if you want to test the entire book such as in a final exam, you could select all the chapter TestBank files. If you have test items in TestBanks you do not wish selected when test are being created, simply select the MAKE UNAVAILABLE TO RANDOMIZER checkbox for each test item you wish not be selected when tests are built using the TEST BUILDER option from the TESTS menu. http://www.hirtlesoftware.com
15
Hirtle Software
TestBanks are created and maintained as Microsoft Access Database (.MDB) files. They may even be opened and edited using MS-Access itself. However, we do not recommend any editing using MS-Access because the file structure and data within must follow very strict guidelines to be used with Random Test-Generator-PRO. Therefore, please do not use MS-Access itself to edit your TestBank files. In addition, if you open any TestBank .MDB file in MS-Access 2000 or higher, DO NOT accept the MS-Access automatic dialog box which asks you to convert the file to a newer MS-Access version. Doing so will permanently cripple the TestBank so that it can longer work with RTG-PRO. MS-Access software is NOT required to use Random Test Generator-PRO. This software uses its own built-in MS-Access functionality to create and edit these files. Therefore, there is no need to use this software only on systems which have MS-Access installed. This software will function completely by itself.
16
Hirtle Software
Navigating TestBanks
Using the Mouse and Arrow Buttons
Navigating through test items in TestBanks, Student Tests and Test Item Analysis screens is as easy as using a VCR. The navigation bar located at the bottom of these windows looks very similar to VCR type buttons. Each button has a specific function to take you to a new location. The center text area of the buttons show the current test item and the total number of test items in your TestBank or student test. Button meanings are as follows: Move to First Test Item Move to Last Test Item
Move to Previous Test Item
Move to Next Test Item
Using The GO TO Button

The GO TO button on TestBank displays allow you to move to a specific test item by its QID number. Once this button is selected a pop-up display will appear with a list box which encompasses each test item which currently resides in the TestBank. Simply select the QID number you wish to go to and you will be immediately taken there. This feature is very convenient when you have TestBanks with large amounts of test items contained within. Using the arrow (VCR) buttons to navigate through your test items can be a slow process as it will only allow you to go from one test item then the next in sequential order to get to a specific test item. The GO TO button can take you there immediately.
207531
Using the Keyboard

When students are being administered screen tests the < > keyboard keys can be used to navigate one test item on either side as appropriate. This only applies when in screen test mode, not while editing TestBanks or Test Item analysis data. These keys should be selected by themselves without selecting any other key at the same time such as SHIFT, CTRL or ALT.
17
Hirtle Software
Adding New Questions to TestBanks

After you have created a new or opened an existing TestBank, adding new test items to them will be typically your next step. To add new test items to your TestBank follow these steps: Select the OPEN option from the FILE menu or the Open and choose the TestBank file you wish to add Icon questions to. The last 5 TestBanks which you have added questions to will be listed on the FILE menu option allowing you to select them without browsing through the file directories manually. If this TestBank does not contain any test items in it, you will see an empty TestBank. You will be prompted to select a MULTIPLE-CHOICE/TRUE-FALSE or a FILL-IN/ESSAY test item. Once you select the desired question type, just start entering in your questions, answer choices, answer explanations and select or type-in the correct answer(s) as appropriate. If this TestBank already has test items contained inside, simply press the ADD QUESTION button . You will be prompted to select either a MULTIPLECHOICE/TRUE-FALSE or a FILL-IN/ESSAY test item, then select the ACCEPT button. Once you select the desired question type, just start entering in your questions, answer choices and select or type-in the correct answer(s) as appropriate. You will notice the only field pre-filled is the QID field. Multiple-Choice/True-False Example
What year did Columbus first come to America? 1776 1492
18
Hirtle Software
Fill-In/Essay Example
Mary had a little __________ . lamb
Duplicating Test Items With The Add & Dup Button

Often there will be times when you are creating test items that many will be similar to each other. With RTGPRO you may duplicate an existing test item and add it as a new test item to the current TestBank using the DUP & ADD button while in TestBank development mode. This will make an exact duplicate (clone) of the current test item and add the new test item to the end of the current TestBank. Every aspect of the duplicated test item will be identical to the original test item except the new test items QID number will be new based on the last QID number in your TestBank and the QID Auto-Increment number set from the OPTIONS window. Any media files used will also be duplicated for the new Test item. You can then make you modifications to the new test item rather than typing in a brand new test item which is similar to an already existing test item. Here is the simple process to duplicate an existing test item: Select the OPEN option from the FILE menu or the Open and choose the TestBank file you wish to add Icon questions to. The last 5 TestBanks which you have added questions to will be listed on the FILE menu option allowing you to select them without browsing through the file directories manually. Navigate to the test item you wish to duplicate so that it appears in the current display windows. Press the ADD & Dup button.
The new duplicated test item will be created at the end of the current TestBank file and its QID number will be modified to reflect the next sequential number. You will automatically be navigated to the newly cloned test item and you are now ready to edit it. The QID field for all TestBank test items should be a unique number which has not previously been used in any TestBank file. Please make sure every test item you add or modify is given a unique QID number which is not repeated in any other TestBank. In this way when you or a student find a question which needs modifying, its QID number will greatly assist you in finding it in your TestBank files, since question numbers will vary from test to test for the same test item because questions are randomly selected. Changing font sizes to very large sizes may cause them to display and print outside their predefined viewing areas. Therefore, it may look like parts of questions and answer choices are missing when in fact, the large font size cause them to display and print (invisibly) beyond their permissible viewing area. You should select font sizes which will not cause this problem. Typically 14 PT and below seems to work well. However, not all fonts use the exact same size scale, so you may have to experiment with fonts until you are satisfied. Please consider this when changing font sizes. http://www.hirtlesoftware.com
19
Hirtle Software
It is very important that every multiple-choice/true-false question you create have an identified correct answer(s) with it. The top right-hand label displays the correct answer for the question. If it is blank, then no correct answer(s) has been identified. Also, identified correct answers will have their answer selection highlighted in a shade of yellow in TestBanks. In order to automatically grade tests correctly, the correct answer(s) must be identified. Otherwise the question will be considered incorrect when graded. To identify the correct answer(s) for a question while entering questions in TestBanks, select the answer choice button(s) (A, B, C, D or E) which correctly answers the question. The ANSWER label will show the letter(s) that you selected and will be stored within the TestBank file.
Although this software provides the ability to use as many as five answer choices per multiple-choice test item, as little as two answer choices may be used. If you wish less than five answer choices, simply leave the undesired answer choice fields blank. This software will not display blank answer choices to students. For example, if you wish to create a true/false test item you simply complete answer choices A and B, while leaving answer choices C, D and E blank.
True/False Test Item Example
20
Hirtle Software
Deleting Questions from TestBanks

In some cases you may wish to delete a test item contained within a TestBank. To delete a test items, follow these steps: Open the TestBank file you wish to delete a question from. Use the navigation arrows buttons to go to the test item you wish to delete or use the GO TO button. Select the DELETE QUESTION button. Select the YES button to delete the test item or the NO button to keep the test item when prompted.
Deleting test items may only be done within a TestBank file. Actual questions as part of student tests cannot be deleted from student test (.TST) files. All test files created are final. However, paper tests may be edited after they are displayed and prior to printing. If a test item is bad or inaccurate, it should be deleted or modified within the TestBank file. Updating TestBanks will ensure all test items within it are accurate. Therefore, any test item randomly selected from it in the future will also be accurate. In most cases it is simpler to modify or completely rewrite a test item rather than delete it. Since TestBanks are simply repositories of test items, modifying/rewriting outdated test items usually makes more sense than deleting them. Keep in mind that modifying and rewriting test items will retain their original QID number, unless your modify it. You may wish to reset Test Item Analysis for test items which are modified so the statistics of the test item will be based on the new changes to it. Test Item Analysis is based on QID numbers, therefore you may wish to change the QID number or reset its Test Item Analysis statistical information (see Test Item Analysis in Chapter 6). This will provide a more accurate reflection of the test item validity since any past statistical information for the modified test item will not be reflected with the current change.
21
Hirtle Software
Using Question IDs (QIDs) in Test Questions

QIDs or Question IDs is a numerical system which identifies specific test items. The numbering system is up to you, however each test item should have a unique number in which no other test item has. This would include across all your TestBank files whereby no two test items should ever have the same QID number. The idea of QIDs came about when it became difficult to locate screen, paper or Internet test items back to their original TestBank. Since test items are selected at random, the question number where they are displayed (if selected) on any given student test will vary. Therefore, If you discover for example that question number five within a student test is incorrect, knowing that it is question number five does no good to locate it within its TestBank in order to correct it. QID numbers on the contrary always stay with the test item (and do not change) regardless of what question number it is within a given student test. Therefore, locating a test item by its QID number in a TestBank is much simpler. Think of QIDs as a serial number for a specific test item. They are unique and used for identification. These are the specific rules to correctly use QIDs. They must be whole numbers only No alphabet or special keyboard characters of any kind is permitted. They CANNOT be duplicated within the same TestBank. They should NEVER be duplicated with any other TestBank test item. The QID field cannot be empty. Up to 10 numeric digits between 1 - 2147483646 is allowed. Cannot be zero or a negative number.
QIDs are automatically assigned based on the QID increment assignment in the GENERAL area of the OPTIONS window from the TOOLS menu. Each new test item will be in multiples of the QID increment.
QID Increment Setting
22
Hirtle Software
This setting will automatically increment your QID numbers based on the number which is set. For instance, if the QID Increment is set for 10, the first question of a TestBank will be automatically assigned 10, the second question you create will be 20, etc. However, if you manually change the first test item to say 22, the second test item once created will be displaying QID number 32. Therefore, the increment setting will know your last QID number used (based on the last test item in your TestBank) and add the QID Increment value when a new question is created. The last QID in a TestBank is read whenever a new question is created and assigned the QID Increment to it. Therefore, if you have 10 test items in your TestBank and a QID Increment setting of 5, with test item 1 being QID 5 and test item 10 being QID 50, the next test item you create (test item 11) will be automatically assigned QID 55. This is true even if you modified test item 3 (QID 15) at the time. It will read the last test item and add the QID increment value to it. If you manually changed the last question's QID to say 123, the next question created will be 128 (123 + 5). This is why it is best to try to keep your QID numbers in a TestBank in order from lowest to highest, with the last test item always being the highest QID number. Remember, QID numbers which are automatically assigned can ALWAYS be modified if you wish. The purpose of the QID increment is to try to save you time typing-in your QID numbers. If you wish to change any QID to your own preferred numbering system, you may. It is strongly recommended that you keep a list of your QID ranges (Low - high) for every TestBank you create. This will help to make sure you do not duplicate any QID numbers between them. You may also want to consider establishing a formal QID numbering system, with each number within a QID having a very specific meaning. lets take a look at one QID number where each number within this QID could tell allot about the question itself: QID 3426358
QID Meaning
3 4 2 6 3 5 8 History U.S. History U.S. History 1865-Present Book used in the course (a specific title) Book chapter number Teaching objective number for this book chapter Simple numeric of what question number created for the teaching objective. In this case, the 8th question created for this teaching objective.
As you can see this system could tell us allot about a test item and also serve as a reference to the test item's origin. You would have to assign all the numeric values and their meanings yourself. Another benefit is that it will go along way in preventing accidental duplicate QID assignments by you.
23
Hirtle Software
Using References in Test Questions

The Reference area of each TestBank test item is an area for you to use as you wish. Ideally (as designed), you will use it to type in reference information pertaining to the current TestBank test item such as publication information, page number and/or objectives that it pertains to. This information could be very useful to verify the validity of questions at a later date especially when the subject matter is very fluid.
Reference Example
The REFERENCE field is optional and not required. However, the reference field can be used as you wish. If you wish students not see this information, you can suppress it from printing and/or displaying on any student test. To prevent reference information to be printed on paper tests and displayed on screen and/or Internet tests, follow these steps: Select the OPTIONS function from the TOOLS menu item.
Select the TESTS button from the OPTIONS window.
Deselect PRINT/DISPLAY REFERENCES checkboxes for any or all the test types options as you wish. Select the ACCEPT button.
Reference data is stored in test files regardless if you display or print them. Therefore, deselecting the PRINT REFERENCES and/or DISPLAY REFERENCES will not prevent them from storing this information in your student test (.TST) files. These options merely allow students to view the data within tests. Therefore, even after the test was built you can later turn on these features for any test file already created when you recall the test at a later date. http://www.hirtlesoftware.com
24
Hirtle Software
Providing Answer Explanations to Test Questions

This is an optional feature of this software. Answer Explanations allow you to provide in-depth details about how and why the true answer to your test items are in fact correct. Students may only obtain access to this information when they are presented Practice tests. Tests administered as Standard tests do not allow students to ever obtain access to this information. When screen, paper or Internet (Web) tests are created in Practice test mode, then answer explanations (if any) are also provided. In screen test mode, students will be presented the ability to review their tests and any answer explanations only after they have completed the test. They will then be able to walk through each test item and compare their answer selections against the true answers and also be able to review any answer explanations provided. While in paper test and Practice modes, the true answers and answer explanations are automatically generated and may be printed along with the test itself. For Internet (Web) practice tests, custom HTML/JavaScript source code is generated to automatically grade the test and then allow students to review the tests true answers and answer explanations for each test item after they have completed their online test. To provide in-depth answer explanation to your test items, select the ANSWER EXPLANATION button while editing your TestBanks. Select this button for each test item you wish to provide detailed explanations for.
B If Sallys bowling scores were 110, 123 and 104, then what was her average score? 117.8 112.3
Answer Explanation Example

Step 1: Add all scores together (110 + 123 + 104). This totals: 337 Step 2: Since there are 3 scores, divide the total (337) by the total games bowled (3) This equals: 112.3333 average per game Step 3: Round off your average to the nearest tenth, final answer is: 112.3. Answer is B This will then become the answer explanation for this test item within this TestBank. Every test item you have has the ability to contain its own customized answer explanation. Like the other edit fields, you may change answer explanations at any time. You may also insert images into this field if desired. As mentioned earlier, this field is optional. If you do not intend to provide Practice tests, then you probably would find no need for this feature. You may then simply ignore it by leaving this field blank (empty) for each of your test items.
25
Hirtle Software
Providing Manual Point Values to Test Items

This is an optional feature of this software. If you wish to provide customized point values for correct and incorrect student answer selections, then this feature will allow you this ability. The OPTIONS and GRADE TEST windows allows you to automatically grade student screen tests in a variety of methods. These methods are described in detail later in this manual. However, one of the methods available is MANUALLY ASSIGNED POINT VALUES. If this option is selected, then the point values manually assigned will then be the system used when tests are graded. When using the GRADE TEST option from the TESTS menu, you can grade and re-grade tests in a variety of methods with just a single click. Therefore, the grading method does not have to be decided prior to the student being administered tests. If you do not wish to provide custom point values, then simply ignore the point values displayed in these pull-down list boxes to the right of the answer choices within the TestBank edit window.
B If Sallys bowling scores were 110, 123 and 104, then what was her average score? 117.8 112.3
To manually assign point values within your test items, select or type-in the point values in the pull-down listboxes to the right of each answer choice. These values will then be associated to the individual answer choices. When students select these answer choices within screen tests, these values will then be used as part of their overall grade if the MANUALLY ASSIGNED POINT VALUES is the default grading method selected from the OPTIONS menu. You may even assign negative values which would be subtracted from the overall final test score. Negative values are typically used as a penalty for incorrectly selecting the correct answer. Assigning a value of zero (0) would in effect provide no penalty when students select those answer choices. Some systems weigh each answer choice individually based on how close an incorrect answer is to the true correct one such as: Which US State has the highest average temperatures year around? A. Alaska (-1.0 Point) B. California (-0.5 Point) C. Minnesota (-1.0 Point) D. Hawaii (+1.0 Point) E. North Dakota (-1.0 Point) As you can see from the above test item that Hawaii is the only correct answer (worth 1 point). However this test item is weighted so that a reasonable (albeit incorrect) answer choice B (California) is a less severe point deduction ( -0.5 points) as compared to the other answer choices which are each unreasonable (-1.0 Points). This is an example of a weighted test item which tries to asses 2nd, 3rd, etc.... best answers. Weighted test items simply provides less punishment to reasonable incorrect answer choices compared to unreasonable incorrect answer choices. Therefore, it rewards students who select reasonable incorrect answer choices by deducting less or not deducting any points. However, the point values are totally up to you. You may provide your own weighting values or provide standard values for all correct and all incorrect answer choices. You may even assign higher point values for different test items. This feature is completely customizable. http://www.hirtlesoftware.com
26
Hirtle Software
Since many test grading systems provide the same point values for correct answers and separate point values for incorrect answers, we have provided a time-saving method for you to assign your own manual point values, simply follow these steps: Select the OPTIONS function from the TOOLS menu item.
Select the GRADING button from the OPTIONS window.
Type-in your default manual point values you wish to assign to correct and incorrect answers. Select the ACCEPT button.
This will then automatically assign your typed-in point values when you identify the actual correct answers inside your TestBanks and will also provide your default point values for the incorrect answer choices. This should be a great time saver when using manual point values. However, this will only take effect as you add or modify your correct answers within TestBanks, it will not automatically change any previously existing test items assigned point values. Reselecting the correct answer(s) for any previously existing test items will then adjust to your new default correct and incorrect point values. Students are NOT able to see your assigned point values when they are being administered tests as this would usually tip-off the true correct answers to your test items since most point systems provide the highest value to the true correct answer. By seeing which answer choices have the highest value it would be easy to determine correct answers. Therefore, point values remain hidden while students are administered tests. Manually assigned point values have no effect on the Test Item Analysis (TIA) features within this software. TIA uses simple percentage values to assess how students are performing against your test items using a standard 0% to 100% scale. This allows all your TestBanks and every test item to be judged using the same scale. Again, manually assigning point values are not required nor is it mandatory that your grading system uses them. Even if you assign manual points, you may easily change your grading method with a single click from the GRADE TEST window at any time. You DO NOT have to assign your own point values for standard percentage grading since this is automatic computed by selecting Require 100% Multiple-Choice Match Method (grading method #1). If you wish to just use standard percentages (grading method #1) or any of the other two built-in grading methods, you can simply ignore the pull-down list-box values altogether. http://www.hirtlesoftware.com
27
Hirtle Software
Grouping Test Items Together

Sometimes you may wish to group a series of test questions one after the other within student tests. Often this type of testing is referred to as diagnostic testing which can determine how well students understand a particular subject, and at what point (if any) they begin to lose their mastery of the topic. By asking a series of test items one after the other, the test administrator is able to pin-point exactly where the student is having problems. Thereby, the test itself is used as a diagnostic tool to provide the test administrator information on what (if any) subject matter needs to be further provided. In this example, the entire test is used for such purposes. However, you may only wish to group together just a few test items within your TestBank. In either circumstance this software provides you the ability to group as many or as little test items together as you wish. This is an advanced feature of this software. Please read this entire topic before you attempt to create test item groupings. Its very important to understand how grouped test items are handled by this software product when creating student tests. Grouping test items together is done while in TestBank edit mode using the GROUP QIDs button. Because this software randomly selects test items from your specified TestBanks when creating student tests, grouping test items together can only be performed from this option. The idea behind this option is that all your grouped test items will appear (if randomly selected) or none of them will appear (if not randomly selected). This is important to understand. This software is designed to randomly select test items from your specified TestBanks to create student tests. Even though you have grouped test items, they may still not necessarily be selected (randomly) within your created tests. This is a random process. By grouping test items together, this random selection process will either select the entire grouped test items or will not select any of them. By grouping them together, individual test items from the grouping will not be selected. To further understand how the random selection process works with grouped test items while creating student tests from the TEST BUILDER window, here is a circumstance which will force the randomization selection process to always select your grouped test items when creating student tests:
Scenario:

10 total test items contained within a TestBank 5 of the 10 test items are grouped together
Using the TEST BUILDER window, You then create a student test and request that 6 test items from that TestBank be (randomly) selected
In this situation, your grouped test items will always be selected because the criteria used would leave no choice since there are not 6 independent (ungrouped) test items. Only 5 test items are independent in this situation. In order to randomly select 6 test items from this TestBank, the randomizer would be forced to use the group of 5 plus one independent test item. Again, this is because the rule is that all grouped test item will be used or none of them. Therefore, in this situation the only method in which 6 test items from this TestBank could be used is by using the group of 5 plus one independent (not grouped) test item. To assure that these grouped test items are ordered correctly when used in student tests, you MUST select the ORDER STUDENT TESTS BY QID NUMBER choice in the TESTS button from the OPTIONS menu. In addition, you must order your QID numbers for these test items in the same order you wish them to appear on students tests. For example, if the grouped QIDs are randomly selected the lowest QID number within any group will appear first, the next highest QID number in the group will appear second, etc... You may create as many test item groupings in the same TestBank as you wish. But be aware of your groupings and the requirements mentioned above. The amount of test items you request using the TEST BUILDER option should be reasonable as to your groupings within a TestBank. http://www.hirtlesoftware.com
28
Hirtle Software
If you wish to group 3 or more test items together you should link the 2nd, 3rd, 4th, etc... test items all to the first. For example, if your perspective group are test items; 100, 110 and 120 (QID numbers), simply go to QID 110 (first), then select the GROUP QIDs button, then select QID 100 from the GROUP THIS QID TO pull-down list box. Next, you should move to QID 120, select the GROUP QIDs button (if not already visible) and also select QID 100 from the GROUP THIS QID TO pull-down list box. That's it. Now QIDs 100, 110 and 120 would then be grouped together. Then by moving to QID 100 (in the above example) you would then see that QIDs 110 and 120 are linked to it from the GROUPED QIDS TO CURRENT TEST ITEM list-box to the right. This is how you can tell if there are any linked (grouped) test items to the current test item.
If at a later time you wish to remove or edit your groupings, you simply move to the test item, select the GROUP QIDS button and select NONE from the GROUP THIS QID TO pull-down-list box to remove the grouping or select an alternative QID number to change your grouping. Again, if you use grouped test items in your TestBanks, you should make sure that the ORDER STUDENT TESTS BY QID NUMBER selection from the OPTIONS menu. This will display the selected test items to students based on their QID number from lowest to highest. Therefore, you should make sure that the order of your grouped test items are based on their QID numbers in the same order. This will ensure that students are presented with these grouped test items in the correct sequence you wish. If you change your QID numbers to grouped test items, you should verify and modify (if necessary) other test items which may have been linked to old QID numbers. This will not change automatically. If you use the DUPLICATE & SCRAMBLE button for printed student tests, although the exact same test items will be created and then scrambled to create a new test, grouped test items may sever their groupings within the new scrambled test. This is because the DUPLICATE & SCRAMBLE function is solely designed to scramble test items to instantly create new tests. It will not consider test item groupings during this process. However, the grouping is still linked within the TestBank. Therefore, if you create your new tests using the TEST BUILDER window, your groupings will still be in effect when tests are created. If your grouped test items use the same media file, you can simply place the media file in the 1st grouped test item (lowest QID number) only. Since the test items are grouped together, you should only need the media file presented in the 1st item. This will help you save resources. However, there is no harm to use the same media file to each of your grouped test items if you wish. Here is the step-by-step method used to group test items together, review test item grouping and remove test item from groups within a TestBank:
Grouping Test Items Together

Select the GROUP QIDs button from the TestBank edit window after you have navigated to the test item (QID number) you wish to group. http://www.hirtlesoftware.com
29
Hirtle Software
Use the pull-down list box (on left) under the GROUP THIS QID (XXX) TO label to select the QID number (test item) you wish to group this current QID number to. In this example, we have grouped (linked) QID 70 to QID 60.
Thats it. There is no ACCEPT button as this is grouping is automatically saved. You may then navigate to group another test item or close the GROUPED (LINKED) QID window.
Viewing Test Item Groupings

Select the GROUP QIDs button from the TestBank edit window after you have navigated to the test item (QID number) you wish to group. If the current test item has any other test items grouped (linked) to it, each test items QID number which is grouped to the current test item will display in the GROUPED QID(s) TO CURRENT TEST ITEM (QID XXX) list-box on the right.
In this example you can see that test item QID 70 is grouped (linked) to test item QID 60 (current QID). If QID 80 was also grouped (linked) to QID 60, then you would see QID 80 listed as well in the list box to the right. You will also notice that the QID pull-down list box on the left is disabled. This is because you cannot chain-group items. Since QID 60 is the base test item of this grouping in this example, you are not allowed to then group QID 60 to any other test item. In order to group QID 60 in this example to some other test item, you would need to unlink the grouping to it by going to QID 70 and select None as the grouping, thereby removing the link to it. This would then display NONE in the GROUPED QID(s) TO CURRENT TEST ITEM (QID XXX) list-box for QID 60 and then allow it to be linked (if desired) to any other test item. The GROUPED QID(s) TO CURRENT TEST ITEM (QID XXX) list-box is display only. It displays what QID numbers or test items (if any) are linked to the current QID number (test item). You are unable to make changes to it directly. Changes occur when you add and remove groupings (links) for individual test items. Those changes automatically reflect in this list box.
Removing Test Item Groupings

Select the GROUP QIDs button from the TestBank edit window after you have navigated to the test item (QID number) you wish to remove the grouping (link).
30
Hirtle Software
Use the pull-down list box (on left) under the GROUP THIS QID (XXX) TO label and then select the NONE choice.
In this example, we are removing the grouping for QID 70. By selecting the NONE option from the pulldown list box, it will be removed from its grouping to QID 60 and then become an independent (not grouped) test item. You could then group it to another test item or leave it as an independent test item.
31
Hirtle Software
Using Multimedia Files

Random Test Generator-PRO allows you to use any binary file with your test items. For testing purposes these files would be expected to be multimedia files. However, any file may be used. This software directly supports the following file types:
VIDEOS
MPG AVI GIF (Animated)
PICTURES
BMP JPG GIF (Static) WMF EMF ICO
MUSIC/SOUNDS
MP3 WAV MID
If you wish to use any other file type, your computer must support that type with its own software. You can judge whether your computer supports a specific file type by double-clicking the file, if a 3rd party software initiates and runs your file then your computer supports that file type. You should then select the USE COMPUTERS DEFAULT SOFTWARE TO VIEW MEDIA FILES checkbox in the GENERAL area of the OPTIONS window located in the TOOLS menu.
When multimedia files are being used this software will then start your default application for the file type used. You may actually use your own computers software for every file type if you prefer, by selecting this checkbox. If this checkbox is not selected, Random Test Generator-PRO will use its own built-in players to run the multimedia files, but only for the file types listed above. Image media files will appear just above the test question for printed (paper) and WEB Internet (HTML) tests, for screen (computer) testing, students will have a button to select to display/listen to multimedia files used with test items. If you opt to embed image files, you may insert them anywhere in your test items as desired. Refer to the Embedding method below for more details about embedding media files directly into your TestBanks.
32
Hirtle Software
There are two basic methods to use multimedia files with your test items. These choices are embedding or linking. The embedding method will make a copy of any file and store it inside your TestBanks directly. The linking method simply stores a link directly to a multimedia file contained on your computer for a specific test item. Therefore, they must be maintained in the same directory path location throughout the use of your TestBank. If you move (or rename) linked media file locations within your computer, then you would have to edit the link to it within the TestBank for each test item affected. Otherwise , an error will appear if you attempt to display/play a linked media file which no longer resides in the folder or has been renamed in TestBank development and also during student test creation. To control whether to embed or link multimedia files, it is done through the GENERAL section of the OPTIONS window from the TOOLS menu item. There you simply select Embed Media Files in TestBanks or Use Media Files from Computers Directories (Links). From that point when you select the ADD/EDIT MEDIA button in the TestBank editing window, a different display will appear depending on which option was selected. You may even use a combination of embedding and linking within the same TestBank.
However, changing either option will not effect any multimedia files already embedded or linked previously within your TestBank. Changing this option will only effect future multimedia file uses in your TestBank. Adding multimedia files such as videos, animations, pictures, or sounds to your test items is very easy. Each method will now be discussed in detail.
33
Hirtle Software
Embedded Method
When the Embedded method is selected you will be shown the MEDIA CENTER window after you select ADD/EDIT MEDIA button from the TestBank editing window.
Example of Media Center display
If you look at the SAMPLE1.MDB TestBank file which comes with the software, you will notice that all image files used are listed in the MEDIA CENTER. These files are all embedded into the TestBank. Just below the File window you will see "CURRENT QID NUMBER:" This is the current QID (test item) you were on when you selected the ADD/EDIT MEDIA button. Just below that you will see "ASSOCIATED MEDIA FILE." This will identify if any embedded media file is associated to the current test item. It will state "None" if no associations have been set. An association is a term used to indicate whether a file that is embedded into a TestBank is set (associated) to specific test items. You may associate the same embedded file to multiple test items or even to no test items if desired. To associate an embedded media file to the current QID test Item, you simply select the media file on the list and select ADD/CHG MEDIA TO TEST QUESTION button. You will then see the display change and show that the Current QID has an associated media file to the one you just selected. Only one media file may be associated to a test item at a time using this method. However, you may manually insert as many images directly inside your test questions and answer choices as you desire. If you select a different media file using this method, then the association will change to the new file only. To Embed (Add ) a new multimedia file not listed, select the ADD MEDIA TO TESTBANK button. This will bring up a selection window where you simply select the media file you wish to embed to the TestBank. It will then copy it to the TestBank and it will appear on the list. This function does not associate the newly embedded file to a Test Item (QID number), it simply adds it to the TestBank. Once added, you may then associate it to the Current QID if desired or close the MEDIA CENTER and go to the QID you wish and then select the ADD/EDIT MEDIA button. You cannot associate to multiple QIDs at one time. You will need to go to each QID and then select the ADD/EDIT MEDIA button individually. However, you may embed (add) as many media files as you desire without needed to go to specific QID numbers. To remove an association you can either replace it with a new embedded media file or if you wish no media file associated, select the REMOVE MEDIA FROM TEST QUESTION button. This will only remove the association. The media file will still be available to the TestBank. http://www.hirtlesoftware.com
34
Hirtle Software
To delete an embedded media file from your TestBank altogether simply select the media file from the list and select the DELETE MEDIA FROM TESTBANK button. This will remove it from the TestBank entirely. Those are the embedded media file tools available to you which use the MEDIA CENTER method. However, there is another way to embed image files. You may have noticed the INSERT IMAGE selection from the EDIT menu. This method allows you to place images directly in TestBank Test items which can be displayed with the test item directly. The added advantage of this method is that you can place images in test questions, answer choices, reference area and answer explanation area of test items and the images will be visible without needing to select the PLAY GRAPHIC button. The disadvantage of this method is that, if you use the same image multiple times, a new copy is made on each occurrence. Therefore, the TestBank file size can get rather large. Also, inserted images cannot be displayed for HTML Internet Tests. So, if you intend to create Internet Tests, you should either emded these image files using the MEDIA CENTER and then associate them to test items or use the Link method. The advantage of the MEDIA CENTER method of embedding multimedia files is that you only need to embed one instance of the file and you can then associate that instance to as many Test Items as you wish. Which means a multimedia file which is used multiple times need only to be embedded once within a TestBank. This can save a great deal of disk space especially if you use many of the same multimedia files numerous times in the same TestBank. Because of the nature of databases, they do not recapture unnecessary disk space when items are deleted from them. Therefore, we recommend that you use the REPAIR/COMPACT FILES option from the TOOLS menu whenever you delete embedded files from your TestBanks. You will often see a dramatic reduction in your TestBank file sizes after the Repair/Compact process is administered.
35
Hirtle Software
Linking Multimedia Files

Here are the steps to link multimedia files to your test items while editing your TestBank: Open the TestBank file in which you wish to add media files to your questions. Using the arrow buttons, navigate to the test item you wish to link a media file to. Select the ADD/EDIT MEDIA button near the button of your TestBank window. Select the appropriate media type button from the pop-up window such as GRAPHIC, GIF (or Animated), AVI, MP3, WAV, MIDI or Other. Note: If this window is not displayed but instead the Media Center window appears, this means that the EMBED option is activated in the GENERAL area of the OPTIONS window. You should change this option to Use Media Files from Computers Directories (Links) if you wish to use the Link method.
Select the path/file name of the file which you wish to add to your test item from the dialog box. Then select the OPEN button.
Select the ACCEPT button on the Media Linking window when finished.
You will notice that the media file and its location will appear in both the popup window and the MEDIA FILE location of the TestBank FILE SELECTED window. This will be your indication that the file is linked to your question. If you simply want to replace an existing media file with your question, just select the new media file you wish and it will replace the existing file. There is no need to choose the REMOVE MEDIA FILE option beforehand unless you do not want any media file linked to your question. It is important to understand that media files you use with your test items using this method are only linked to your question by its path(folder)/file name. They are not embedded within the TestBank. What is stored in your TestBank is the text location (path) and file name you have linked to your test item. This is vitally important to understand. If you link media files to specific test items and subsequently place these media files in different directory locations on your system (or rename them), that an error will occur when you attempt to view them. More importantly, students will also receive these errors when they try to view them. Therefore, be very careful when moving (or renaming) linked media files from their present locations unless you know that no test items are link to them. If you do move (or rename) them, you must then go to each test item affected, and redefine the new path (folder)/file locations in order to use these media files. http://www.hirtlesoftware.com
36
Hirtle Software
We recommend that you predefine set directories whereby linked media files to be used in your test items are stored in specific directories that are obviously being used for test items. Here is an example of our recommended scheme: C:\MATH101\TESTBANK\CHAPTER1 C:\MATH101\TESTBANK\CHAPTER2 C:\MATH101\TESTBANK\CHAPTER3 C:\MATH101\MEDIA\GRAPHICS C:\MATH101\MEDIA\SOUNDS C:\MATH101\MEDIA\VIDEOS You may use the same linking method to change multimedia files to test items. Since only one link is allowed per test item, any subsequent link to the same test item will simply replace the previous link with the newest one. To remove all media file links to a test item altogether, simply select the ADD/EDIT MEDIA button and select the REMOVE MEDIA button.
37
Hirtle Software
Viewing Multimedia Files

will All media files used in a TestBank can be reviewed at anytime. The PLAY MEDIA button only be enabled whenever a media file is assigned for the current test item. To play the current media file, simply press the PLAY button. The caption on this button will change depending upon the file type linked to the current test item. For example, if the current linked media file is a JPG the caption will be PLAY GRAPHIC. If it is an AVI file, the caption will read, PLAY MOVIE, etc... Depending on which type of media file it is, is how you will be presented with it when played. In addition, if you selected to use your own computers default software, then the method of playing your media files is dependant upon the type of software your computer has installed. Each time you select the PLAY button, your computer will start the default application for the file type selected. If you have not selected to use your own computers software, then Random Test Generator-PRO will use its own embedded software players. Refer to the beginning of this topic to see the list of file types this software directly supports. Please consider that if you decide to use your own computers default software, this software may include editing capabilities such as graphic applications which would allow editing of the media file. However, editing embedded media files cannot be done. Embedded files will create a temporary file each time they are viewed. Therefore, any editing would be to the temporary file and not what is embedded. For sound files, the PLAY WAV/MIDI button will change to STOP WAV/MIDI. Pressing this stop button will stop playing back any sound file which is currently playing.
38
Hirtle Software
Printing TestBanks
You may at times wish to print entire TestBank files for record keeping or for review purposes. Here are the steps to print the entire contents of a TestBank file: Open the TestBank file you wish to print using the OPEN option from the FILE menu or Open Icon on the toolbar. on the Select the PRINT option from the FILE menu or Print Icon toolbar.
Select the OK button on the pop-up dialog box in the PRINT PREVIEW window when you are ready to print the contents of the TestBank.
This option will print out the entire contents of a TestBank file, it does not print student tests. In order to create/build tests you should choose the TEST BUILDER option under the TESTS menu. Printing TestBank files will display all information for each test item within the TestBank. Unlike printing tests, TestBank files will print items in addition to test questions and answer choices such as: Reference data (if available) Answer Explanations (if available) Media Type (if available) Media location (if available) QID Graphics (if available)
This additional information will display/print at all times for TestBank printing. Using the TESTS selection in the OPTIONS function of the TOOLS menu item has no effect for printing TestBanks. This function is for controlling printed student tests only. http://www.hirtlesoftware.com
39
Hirtle Software
Importing Test Data From Other Software

If you have used other software products in the past to create TestBanks and/or student tests, Random Test Generator-PRO has provided an IMPORT WIZARD feature which will attempt to automatically import this test information into a new RTG-PRO TestBank, saving you the time to manually input this data yourself. This Text Import Wizard makes it easy to import text files to Random Test Generator-PRO format. This Wizard guides you through the steps to import data from tab, space, semi-colon or custom delimited ASCII text files. Therefore, you should save your existing test data as a delimitated text file (if not already) using the capabilities of the other software product prior to attempting to import them into RTG-PRO. RTG-PRO is only designed to import delimitated text files. If your existing test data is not in delimitated text format, see below on the methods available and specific formatting requirements that your files must adhere to in order for them to be imported successfully. Here are the steps used to import your delimitated text files into RTGPRO TestBanks: Select the IMPORT WIZARD option from the FILE menu.
Navigate through this IMPORT WIZARD using the NEXT and PREVIOUS buttons. Select the NEXT button to continue.
40
Hirtle Software
Select the delimitated text file you wish to import into a new RTG-PRO TestBank file. Then select the NEXT button to continue.
Select the delimitated format of the text file you are importing. If the character is not displayed, use the OTHER option and type-in the delimitated character. Then select the NEXT button to continue.
Select the checkbox if you wish the new TestBank which is created to display immediately after the import process is complete. Then select the FINISH button to start the import process.
Importing Test File Methods And Requirements

Most software products allow you to SAVE AS or EXPORT into a text format. If your other software product does not store the test data in text format, check for a SAVE AS or EXPORT option. Often, this it is referred to as DELIMINATED text files (comma-delimitated, tab-delimitated, etc...). Microsoft Office products (MS-Word, MS-Access and MS-Excel) all have the capability to save its data as delimitated text files. Try not to use straight (non-delimitated) text files, if at all possible. These files should be delimitated text files. The delimitation (tab, comma, etc...) is what separates the data between test questions and answer choices, so RTG-PRO imports them correctly. It is not necessary that these files have a .TXT extension so as long as they are true text files. For example, MS-Excel will save a comma-delimitated text file with a .CSV extension. http://www.hirtlesoftware.com
41
Hirtle Software
In order to import files created from one software products into other, the exact format of the files must be known beforehand. This is because data/text files can be designed (formatted) in many different ways depending on how the creator decided to design them. Therefore, in order to import them correctly, this format must be known, so the importing software understands where to place extracted data from the imported files into. RTG-PRO uses specific fields where it stores test items into and must know the format of the data being extracted in order to place this information into the correct RTG-PRO TestBank fields. Therefore, your goal should be to create your ASCII delimitated text file into a format that RTG-PRO can understand and import the data correctly. Your delimitated text file you wish to import should have the following requirements: No Question numbers or answer choice letters Only test questions and no more than five answer choices (A-E) No blank lines between test questions and answer choices No blank lines between answers choices No data or blank lines before your first test item and after your last test item Only one blank line between test items
Once your formatting is completed, your text files should look something like this:
It is best to save the text file as TAB-Delimitated if that choice is available to you. Comma or any other character used to delimitate may lead the import function to stray-off if you have used the same character within your test data itself. This would cause a domino-effect and could misfile where it places data inside the newly TestBank for all subsequent text that it is importing. Do not worry, RTG-PRO does not modify the file you are trying to import in any way, it simply extracts the data from it. Once your data is imported into a new TestBank file, you will have to define the actual true correct answers to each test item since that information is not imported. This is done by simply selecting the correct answer choice button for each test item (within RTG-PRO). The background color will change and the answer letter will appear in the upper-right hand corner to reflect that the answer choice is the correct answer. In addition, you may (optionally) also wish to supply reference and answer explanation information for your test items in the new TestBank that is created since RTG-PRO provides for this capability. The TestBank file name which is created when your data is imported is the exact same file name as the text file, but will contain _Imported.mdb as the file name extension. Once your data has been successfully imported, you may display it from RTG-PRO using the OPEN TESTBANK option from the RTG-PRO FILE menu. You should verify that your test data looks normal. If not, you should review the format process above and try again. It is a good idea to run the Validate checker (VALIDATE button) as well, so that the TestBank is verified that it meets the minimum requirements to be used to create student tests. http://www.hirtlesoftware.com
42
Hirtle Software
All test data is imported as multiple-choice test questions. It is impossible to differentiate test items in text files as to whether they are multiple-choice or fill-in/essay type questions. So, all your test items will be imported as multiple choice. The only way to change a multiple-choice test item into a fill-in/essay test item is by deleted the multiple-choice test item from the TestBank and then add a new test item and selecting the FILL-IN/ESSAY option. In addition, QID numbers are automatically assigned based on the option selections you have chosen from the OPTIONS menu. You may wish to change these default QID numbers which have been created in your new TestBank. It is impossible to import images using this process. Therefore, if your original test file contains images you will have to either create a new link or embed them into your TestBanks manually for the appropriate test items. Many people have their test data in MS-Word files. Therefore, we have provided an in-depth explanation on how to format an existing MS-Word file into a delimitated text file and formatted correctly so it can easily be imported into RTG-PRO.
Formatting your Existing Test Data From MS-Word

If your existing MS-Word document does not contain your test data in a table, you can use the CONVERT TEXT-TO-TABLE feature in the TABLE menu (MS-Word) after you have selected your text. However, please note that you should then make sure that table conforms to all the requirements in step 1 below. It is necessary to have your test items in a table in MS-Word in order to use the SEPERATE TEXT WITH (DELIMINATE) option when converting a table to text (as in step 5 below). Follow these steps: 1. It is very important that your table be formatted exactly as follows, otherwise the import process may contain errors in which you would have to correct within RTG-PRO after importing. It is usually easier to correct them beforehand: A. Make sure your table is formatted so that only test questions and answer choices are contained. B. Your table should contain just a single column starting with a test question, followed by answer choices A through E or less than 5 answer choices. However, your answer choice letters should not appear. C. If you have test question numbers in your table, they should be removed. Otherwise they will import with your test questions. Question numbers are not used in TestBanks since they are assigned when you actually create student tests. D. If you have more than 5 answer choices you should edit such test items down to 5 or less. E. If you have answer choice letters preceding them you should remove them. Otherwise, they will import with your answer choices. Answer choice letters are not manually typed-in TestBanks but are selected. Therefore, if you use manually typed-in answer choice letters they will appear twice when tests are created. F. You should not skip table fields unless you are starting a new test item, the test question and answer choices should not have any skipped fields. Skip only one field between test items.
43
Hirtle Software
When you are done editing, your MS-Word table should like something like this:
3. Once you are comfortable with your table format, you are now ready to convert it to text. You should highlight (select) the entire table (nothing else). 4. Select the TABLE menu 5. Select the CONVERT TABLE TO TEXT option. If this option is not available it means you have selected more than the table. Verify your selection and try again. 6. Choose the option you wish in the SEPERATE TEXT WITH window. Usually the TABS option is best. If you choose COMMAS, then you should not have commas with your test items. Otherwise the commas found will trigger a field change indicator causing the import process a domino effect which would then require you to manually correct the problems within RTG-PRO after import. 7. Make sure the delimited text file has the same type of data in each field and the same fields in every row. After your MS-Word table has been converted to text, it should look something like this:
8. On the File menu, select SAVE AS. 9. In the FILE NAME box, enter a new file name. 10. In the SAVE AS TYPE list, select TEXT ONLY (DO NOT use the WITH LINE BREAKS option), and then select SAVE.
44
Hirtle Software
Chapter 2 Editing TestBanks

Many times test items within your TestBanks will need to be modified because they have become outdated, obsolete or just incorrect. Random Test Generator-PRO allows you to easily edit your existing test items. To edit existing TestBank test items, follow these steps: Open the TestBank file you wish to modify, using the TESTBANK option from the OPEN item located in the FILE menu or use the OPEN Icon .
Navigate to the test item you wish to edit using the VCR type buttons at the bottom or using the GO TO button. Simply type-over any area which you wish to modify such as the question, answer choices, answer(s), reference and/or answer explanation.
You may also delete test items as well as modify or add multimedia files to your test items. By changing the text and/or its multimedia files in a test item the information will automatically be saved like any database file. Therefore, there in no specific SAVE option. Caution should be taken whenever you modify an existing test item since you will not be able to undo the changes. However, one method you could http://www.hirtlesoftware.com
45
Hirtle Software
use is to have a backup of your TestBank file prior to making changes in case you wish to recover the original file information prior to your new modifications taking effect. The SAVE AS option from the FILE menu allows you to save your current displayed TestBank file with a new file name. This option basically clones the original file and makes an exact copy of it with your new file name. The original TestBank is not deleted. Be aware as discussed earlier because TestBank files are databases, any change you make to them are saved immediately as you edit the fields. Therefore, unlike many other file types save as text files, using the SAVE AS option not only creates a new file with your recent edits included, but because your recent edits was to a database file, these changes will also be changed to your original TestBank (database) file as well. QID fields for all TestBank test items should be a unique number which has not previously been used in any TestBank file. If this program randomly selects two different questions from the same or different TestBank which have the same QID number assigned, an error will occur when using the TEST BUILDER option. The 2nd QID number which was randomly selected will be disregarded. Therefore, the entire question will not be used in your new test. You will have less questions than you have requested. Please make sure every question you add or modify is given a unique QID number which is not repeated in any other TestBank question. In this way when you or a student find a question which needs modifying, the QID will greatly assist you in finding it in your TestBank files, since questions numbers will vary because questions are randomly selected. Refer to the QID link below for more information. You cannot change question types once created. Multiple-choice/true-false and fill-in/essay question types are permanent. Therefore, in order to modify a question to a different format, you will have to delete the original test item and add a new test item with the format you desire. Double-clicking any test question, answer choice or reference edit box will enlarge that edit box greatly. This will allow you a big viewing area to observe and edit your test items while editing your TestBanks. To reset the edit box back to its normal size simply double-click it again. This double-clicking process acts as a toggle between enlarging and resetting back to normal these edit boxes.
46
Hirtle Software
Using the FIND Option

You may often need to find a specific test item or group of test items based on certain criteria in a TestBank. Random Test Generator-PRO contains a powerful search engine which will quickly find all test items which match the search criteria within a TestBank. Searches may be conducted for QID numbers, and within the following fields: Questions, answer choices, references, answers and answer explanations. Here are the steps to find information within your TestBanks in Random Test Generator-PRO: Select the FIND item from the TOOLS menu or select the CTRL+F keys.
In the FIND window, enter the test string or QID number in the FIND WHAT field.
Select any search requirements such as Match Case and/or Match Whole Word by selecting the appropriate check boxes, if desired.
Select the FIND NEXT button to begin your search.
You can continue your search after matches have been found by continually selecting the FIND NEXT button. This option will continue your search starting in the next field (question, answer choice A, etc...) after a previous match has been found. Therefore, it will start where you have left off and continue until the entire TestBank or printable form has been searched. When performing a TestBank search the FIND option will only find the 1st instance of a match per field. Therefore, if more than one match is inside the same field, only the 1st match will be alerted on. Selecting the FIND NEXT button after a match is found will jump to the next field to start the next search. Fields that are searched within TestBanks are the Question, every answer choice and the Reference area. QID searches inside TestBanks are separate from text searches. Therefore, when selecting this option it will automatically deselect the Match Case and Match Whole Words Only checkboxes. The QID search field will be activated to type the specific QID number you wish to find. In addition, any QID number which contains your search will be found even if is a partial match. When performing searches for printable forms (not TestBanks) such as paper tests and reports, there is no separation between QIDs and other text. Therefore, you may perform QID searches or any text searches using the same options. http://www.hirtlesoftware.com
47
Hirtle Software
Using the REPLACE Option

There may be times when a word or phrase used throughout your TestBank may need replacement. The REPLACE feature included within this software is designed to handle such circumstances quickly and with ease. Please note that this function should be used with caution. It will instantly change your specified text without a capability to Undo the change. For example, if you have a few test items with the word then and you prefer the word therefore in it's place, this option will find every occurrence of 'then' and substitute 'therefore'. Here are the steps to automatically replace specified text using the REPLACE option: Select the REPLACE item from the TOOLS menu or select the CTRL+H keys.
Enter the text string you wish to have replaced in the FIND WHAT field.
Enter the text string you want to be substituted in the REPLACE WITH field.
Select the criteria such as Match Case and/or Match Whole Words checkboxes if desired.
Select the REPLACE ALL button when complete and ready to make the changes.
When using replace while in the TestBank editor, you have a REPLACE and REPLACE ALL capability. The REPLACE option will only replace matches for the current test item (QID) when the button was selected. The REPLACE ALL option will find and replace every instance where a match is found for the entire TestBank which includes test questions, answer choices, references, answers and answer explanations fields. You may not replace QID numbers using either REPLACE option within TestBanks. When using the REPLACE option with printable forms such as paper tests and reports, you will only have the REPLACE ALL button available. Therefore, all matches within the printable form will be replaced, including QID matches.
48
Hirtle Software
Using Spell Checking and Thesaurus

This software provides the ability to spell check TestBanks and printable forms by running the MS-Word spell checker and thesaurus capabilities. Therefore, you must have MS-Word installed on the same computer in which you are using this Random Test Generator-PRO in order to take advantage of these capabilities. To use the spell checker and thesaurus within RTG-PRO, follow these steps:
Spell Checking
Open the TestBank file or printable form you wish spell checked, or if already open, select it (click-it) to make it is the active form. Select the SPELL CHECK option from the TOOLS menu or select the F7 key.
Change incorrectly spelled words as appropriate using the spell checking options available when prompted.
The spell check function assumes that the dictionary for MS-Word is also installed. If it is not, then you will have to install it in order to use spell checking. If your are able to use the Spell Checker in MS-Word, then you should also be able to use it within RTG-PRO. This operation will automatically open MS-Word in the background and then close it when the spell checking has been completed. Therefore, please consider your computer's memory constraints prior to choosing this option. It may be best to close other applications which may be open to conserve system memory (RAM). Only the file which is active (highlighted) at the time of your spell check request will be checked. To check another open file, simply select its window, then choose the SPELL CHECK option again. You are unable to close (exit) the Spell Checker inside of TestBanks until the entire TestBank has been spell checked. This is due to the continual looping that is performed from test item to test item.
49
Hirtle Software
Thesaurus
Open the TestBank file or printable form you wish use the thesaurus with, if not already open. Highlight (select) the word you wish to run the Thesaurus on.
Select the Thesaurus option on the TOOLS menu or select the SHIFT+F7 keys.
Use the Thesaurus options available to modify the highlighted word as appropriate.
The thesaurus function assumes that the dictionary for MS-Word is also installed. If it is not, then you will have to install it in order to use the thesaurus. If your are able to use the Thesaurus in MS-Word, then you should also be able to use it within RTG-PRO. This operation will automatically open MS-Word in the background and then close it when the thesaurus checking has been completed. Therefore, please consider your computer's memory constraints prior to choosing this option. It may be best to close other applications which may be open to conserve system memory (RAM). Only the highlighted text in the active file will be checked using the thesaurus. To check another open file, simply select its window to make it active and highlight any text, then choose the THESAURUS option again.
50
Hirtle Software
Validating TestBanks
on TestBank editing forms checks for missing or skipped information The VALIDATE button within the current TestBank. The following is a list of the minimum requirements which each test item should meet to be considered "valid" for multiple choice/true-false question types: Each test item must have a supplied test question Each test item must have at least answer choices 'A' and 'B' completed Each test item must have the correct answer choice(s) identified Test answer choices cannot be skipped such as 'C' and 'E' with data while 'D' is blank Verifies that any media file identified (linked) in the TestBank actually (still) exists in the specified directory locations Checks for test item validity by comparing student answer selections Checks for test items made unavailable to the randomizer Checks that grouped test items (if any) are linked to existing QID numbers
The following is a list of minimum requirements which each test item should meet to be considered "valid" for fill-in-the-blank/essay question types: Each test item must have a supplied test question Each test item must have a supplied answer typed Verifies that any media file identified (linked) in the TestBank actually (still) exists in the specified directory locations Checks for test items made unavailable to the randomizer Checks that grouped test items (if any) are linked to existing QID numbers
The VALIDATE button will verify that these minimum requirements are met for every test item contained in the TestBank. When the VALIDATE button is selected it will cycle through each question in the TestBank starting with the 1st test item, when a requirement that is not met is detected, it will immediate notify you what the error is and provide you an opportunity to correct it at that point. If you select YES to correct the problem immediately, you should then reselect the VALIDATE button again to continue the validation process. You should continue with the validation after each edit until a complete cycle has been checked without any errors detected. This is to ensure that your TestBank is 100% validated and verified. Once the entire TestBank has been verified, it is then ready to be used to create student tests with from the TEST BUILDER window from the TESTS menu. NOTE: If your TestBank includes many displayed images, you may need to exit all other software on your computer as the validation process is RAM intensive because the images are constantly being displayed one by one as the validator goes from test item t test item at high speed. If your RAM is low then the process may even lock-up your system when your computer runs out of available RAM. http://www.hirtlesoftware.com
51
Hirtle Software
Using Font Capabilities

You may change Fonts, colors and styles to any character, group of characters or all characters very easily with Random Test Generator-PRO. This software conforms to most word processing applications with these capabilities. Inside of TestBanks and printable forms such as paper tests and reports you may change these font attributes to any Test Question, Answer Choice, Reference and/or Answer Explanation. Changes will only effect the current selected (highlighted) text and will not change any other text which was not highlighted.
Changing Font Colors

Select (highlight) the text you wish to modify its font color.
Right-Click the highlighted text (or select the EDIT menu) and select COLOR SELECT or choose the Color Icon on the toolbar.
Select the desired color you wish and press the ACCEPT button to the right. Or simply double-click the desired color.
Changing font names, sizes and colors also affect the font selections when printing on paper. The PRINT PREVIEW screen will display exactly what the text will look like when printed. Black and white printers of course will not print color fonts, but instead will automatically select the closest shade of gray to best match the color font used. It is best to use a black font color when printing from a black and white printer, this will greatly speed up the printing process. In addition, if your student test or report is using black fonts, it is best to select a blank & white print (from the PRINT dialog box) if you use a color printer to also speed up the printing process and conserve your color cartridges. http://www.hirtlesoftware.com
52
Hirtle Software
Changing Font Names/Sizes

Select (highlight) the text you wish to modify its font name.
Select from the Font Name list, to the desired font you wish the highlighted text to change to and/or select the Font Size from the list provided. Both lists are near the top of the form.
Changing font sizes to very large sizes may cause them to display and print outside their predefined viewing area. Therefore, it may look like parts of questions and answer choices are missing when in fact, the large font size caused them to display and print (invisibly) beyond their permissible viewing area. You should select font sizes which will not cause this problem. Typically 14 PT and below seems to work well. However, not all fonts use the exact same size scale, so you may have to experiment with some fonts until you are satisfied.
Changing System Font Settings

Within TestBanks there are certain items you cannot change Font settings to by the common way of highlighting them and modifying their setting. The areas which cannot be changed by this method are QID numbers, and Answer Choice Letters. You may have noticed that when creating student tests or any report, these font attributes are pre-selected and that they have the same settings. These font attributes are controlled from the OPTIONS menu. There you may create your own default font setting such as font name, size, color and attributes such as bold and italic. From then on any printed test or report will contain your default font selection for areas in which you may not set individually. Even though you may not edit these areas prior to creating printed tests and/or reports, you may select any text within these printable forms and change font settings prior to actually printing them, if desired. Follow these steps to change your default font settings: Select the DEFAULT FONT button from the GENERAL area of the OPTIONS window located from the TOOLS menu.
53
Hirtle Software
Select the desired Font Name, size, color and other attributes listed in the FONT DIALOG BOX to become your default font settings.
Select the OK button
Changing Other Font Attributes/Alignment

Select (highlight) the text you wish to modify its font attributes.
Right-Click the highlighted text and select the attribute (BOLD, ITALIC or UNDERLINE) and/or alignment (LEFT, CENTER or RIGHT) you wish from the options provided or select the appropriate icon from the toolbar
54
Hirtle Software
Inserting Font Symbols

Position the cursor to the location you wish to insert a symbol at. Right-Click and select INSERT SYMBOL or choose INSERT SYMBOL from the EDIT menu. on the toolbar.
Select the desired symbol to insert and press the COPY & INSERT or COPY button as appropriate.
This option allows you to include symbols which are not available from standard keyboards such as; DR By default the current displayed Font is used to initially display symbols associated to it. However, you may select any font installed on your computer by selecting any Font from the list at the top of the INSERT SYMBOL form. This will cause the symbols in the viewing area to change to the selected font. You may also copy symbols from other applications and past them into RTG-PRO if the other application supports standard Windows copy and pasting methods.
55
Hirtle Software
Text-To-Speech In TestBank Development Mode

If you have the SPEECH SETTINGS window set to ENABLE TEXT-TO-SPEECH for TESTBANK DEVELOPMENT, then when editing TestBanks the test items will be audibly read out-loud by this software. You may then use the SPEAK/STOP SPEAK and ENABLE SPEAK/DISABLE SPEAK buttons to control speech behavior. The SPEAK/STOP SPEAK button acts as a toggle to speak the current test item out-loud or stop speaking the current test item (in mid-sentence). The STOP SPEAK button only stops the current reading and does not permanently stop the speaking for other test items as you navigate between them. However, the ENABLE SPEAK/DISABLE SPEAK button acts as a toggle to permanently activate or deactivate the speech software. This allows you to control whether you wish to hear the speech software regardless of the speech settings that have been set from the SPEECH SETTINGS window. However, the character will still adhere to the other settings such as whether it visibly displays and whether it uses the balloon style text window when it speaks. Therefore, the SPEECH SETTINGS window settings for DISPLAY CHARACTER and DISPLAY BALLOON STYLE (for TESTBANK DEVELOPMENT) are permanent unless changed. These settings will be relied upon whenever you decide to enable the speech software. The setting to enable or disable Test-to-Speech in the SPEECH SETTINGS window is simply a default setting. When a TestBank is initially opened, this setting is what will occur. You may change your mind at anytime while in TestBank development mode. Any newly opened TestBanks will revert back to the settings in the SPEECH SETTINGS window as the default values.
56
Hirtle Software
Chapter 3 Creating Tests

Random Test Generator-PRO allows up to 50 TestBank files to be used to comprise a single student test. The only limitation to the number of test items which may be used from each TestBank is how many total test items are contained in them. Therefore, you may use as many test items per TestBank as desired. The TEST BUILDER option from the TESTS window is the method used to create student tests.
57
Hirtle Software
Standard Vs. Practice Tests

Every test type (Screen, Paper and WEB/HTML) have the ability to create tests as either Standard or Practice tests. Standard test mode presents tests to students without providing any feedback. No final score is provided and students do not have the ability to review their answer selections against the true correct answers. Standard tests simply allow students to take their tests and nothing else. Practice Tests on the other hand are designed for students to receive immediate test feedback including their automatically graded final score (Screen & WEB/HTML tests) as well as the ability to review their answer selections against the true correct answers. Before you create student tests you should know what test format (Screen, Paper, WEB/HTML) and what test mode (Standard or Practice) you wish to present these tests to students as. Below is a breakdown of the differences between Standard and Practice tests for Screen, Paper and WEB/HTML formats:
Screen Tests
Standard Test Students are administered their Standard Screen Tests but do not receive any type of feedback. However their tests are automatically graded and their results are stored in the test (.tst) file itself. These results my be reviewed from the DISPLAY TEST PERFORMANCE RESULT/REPORT option from the TESTS menu. You may also re-grade their test using a variety of methods from the GRADE TEST option in the TESTS menu and you may review their actual answer selections from the REVIEW COMPLETED TEST option in the RECALL SCREEN TEST option from the TESTS menu. Any test feedback to students is intended to be from the test administrator and not RTG-PRO. Practice Test Screen Practice tests will behave exactly like standard tests, but when the student has completed it they will be automatically sent to a test review mode where they will see their overall grade and be able to review each test item one by one to compare their answer selections against the true correct answers. Their grade will be automatically recorded in the test (.tst) file. The grading method used is based on which method is selected from the OPTIONS menu. These tests are typically for students self-assessment.
Paper Tests
Standard Test When a Standard test is requested in Paper format, this software will display the test along with its custom answer key in a printable form. It is intended that both the test and answer key be printed. The student would then be handed the test while the test administrator would secure the custom answer key in a safe location to be used to grade the test after the student has completed it. Any test feedback to the student would then be from the test administrator. Practice Test Practice Paper tests will make available for printing answer keys with answer explanations (if provided for) at the end of the paper test. This allows the printing of practice tests as packages where students can review their answer selections and see answer explanations (if provided). Test administrators could either hold onto these answer keys and answer explanations until the student has completed their Practice tests or provide the entire package to the student for their own review and grading for their own self-assessment.
58
Hirtle Software
WEB/HTML Tests
Standard Test Standard Web/HTML tests are administered via your web server. The student may take this Web/HTML test anywhere in the world providing your Web Server has a recognized IP Address and the student has an Internet connection on the computer they wish to take their test with. All that is needed is a standard web browser (MSIE, Netscape, etc...). Standard Web/HTML tests do not provide any type of feedback to students. When students complete their tests they simply select the TEST COMPLETE button on their Web Browser. This will then automatically send their test answers via e-mail to any valid e-mail address you specify before the test was created. You may then grade the students test and provide them feedback. Practice Test Web/HTML Practice tests are administered via your web server. The student may take this Web/HTML test anywhere in the world providing your Web Server has a recognized IP Address and the student has an Internet connection on the computer they wish to take their test with. All that is needed is a standard web browser (MSIE, Netscape, etc...). Web/HTML Practice tests will create an answer key with answer explanations (if provided for) within the same HTML file. Once the student has selected the TEST COMPLETE button on their web browser, their overall final score is automatically computed using RTG-PRO created JavaScripting from their Web Browser and they will then be provided their test score and be able to review every test item one by one using their web browser. Test scores are kept internal and are not transmitted. These tests are typically for students self-assessment. The Practice test option for any test type (screen, paper or Web/HTML) should not be selected if you do not wish students to immediately receive their test score and be able to review their answer selections as compared to the true correct answers. Like all student tests (.tst) files, you are never bound by the features you have selected when the file was created. For example, you may at a later time/date provide the exact same test (.tst) file to a student as a standard (non-practice) test from the options provided in the TESTS menu. The same test file may be used in a multiple of ways. You may also administer (or re-administer) these test files in any test mode (paper, screen Web/HTML) at anytime.
Creating Student Tests

Here are the general steps necessary to create student tests once you have your TestBank(s) files completed: 1. Select the TEST BUILDER option from the TESTS menu item.
59
Hirtle Software
2. Choose the first SELECT button near the top-left corner of the screen. 4. Choose the path (folder)/file of one of the TestBanks (.MDB) file you wish to use to create a new test with. Then select the OPEN button.
5. If another TestBank file is desired, use the second SELECT button. Use the third button for another TestBank, etc..... (do not skip fields). 6. Use the up/down arrow buttons to select the number of questions you wish each TestBank file to randomly select from in the AMOUNT field for each TestBank you are using. The maximum amount is based on the maximum amount of test items contained in each TestBank. 7. Choose between the BUILD SCREEN TEST , BUILD PAPER TEST or BUILD WEB TEST (HTML) options for the desired test type you wish to create. 8. Select the number of tests to create from the up/down arrow buttons. Optionally, you may enter a test title, a students name and identify a passing score value. These optional fields will be recorded in the student test (.tst) file and used where appropriate. 9. Select the CREATE AS PRACTICE TEST checkbox if you wish the test to be created and presented in Practice Test mode (if immediately starting the test).
10. Select the ACCEPT button when complete and ready to create your new student test(s).
60
Hirtle Software
11. Type-in a new (unique) file name for your test to save as a .TST file. Then select the SAVE button.
An optional timer may be used for Screen Tests. This timer will count down in hours, minutes and seconds the remaining time for the test. To set up the timer, follow these steps once you have chosen BUILD SCREEN TEST after step 7 above: 7a. Select the SET TIMER checkbox. 7b. Use the vertical scroll bars to set the maximum test time in hours, minutes and seconds.
7c. Select the ACCEPT button. Your time will display in the timer field and the SET TIMER checkbox will be checked. As soon as you select the OK button when prompted to BEGIN TEST (Screen Tests only), your test will immediately begin and the countdown timer will start (if set). Therefore, the student should be ready at this time to begin the test. If the time expires prior to the student completing the test, a pop-up box will appear notifying the student that their time has expired, when the student selects the OK button, the test will exit with all the students answers saved to that point in which the time expired. At no time can the student make any additional answer selections after the expiration time. For all screen tests, once completed, and if login requirement feature is activated, the login screen will appear and not allow access to Random Test Generator-PRO until the correct Master Password or a correct Instructor/Student login name and password is entered. This is for security reasons so students who are not monitored cannot get access to this software after test completion. However, if the login requirement feature is not activated, then students may obtain access when the test is over. This should be considered if students are not being monitored during screen tests. The CLEAR buttons next to each SELECT button will only clear the contents of the TESTBANK PATH/FILE NAME(S) and AMOUNT fields for just the current field, not all fields. All student tests regardless of type (screen, paper or web) will create test (.tst) files using the file names you have specified from the TEST BUILDER when prompted. These test (.tst) files are base files which can be used or re-used as often as desired. Not only for the test type you initially created them for, but also you can re-use these same files for other test types as well. This allows you the maximum flexibility. Therefore, you may re-use these files for screen, paper or Web tests at a later time no matter what you initially created them for. In addition, you may also set them for Standard or Practice tests at the same time. There is no need to create a second (3rd, 4th, etc...) test (.tst) file if you wish to simply re-administer the same test to http://www.hirtlesoftware.com
61
Hirtle Software
students. Using the RECALL SCREEN TEST, RECALL PAPER TEST and CREATE HTML TEST FROM TST FILE will provide you the ability to use these test (.tst) files in any format at anytime. The CREATE AS PRACTICE TEST checkbox option will display Screen Tests, Paper Tests or create Web (HTML) Tests (depending on which option you have selected) in a Practice Test format. If you do not intend to present screen tests, paper tests or Web (HTML) tests to a student immediately, then you do not need to decide whether you wish a Standard or Practice test immediately. The test (.tst) files which this TEST BUILDER creates can be presented as Standard or Practice tests at any time using the RE-ADMINISTER STANDARD TEST or RE-ADMINISTER PRACTICE TEST in either the RECALL SCREEN TEST or RECALL PAPER TEST options from the TESTS menu. You can use the CREATE HTML TESTS FROM TST FILE with either STANDARD TEST or PRACTICE TEST options to create specific Web Tests for Standard or Practice test modes. Therefore, using this TEST BUILDER to create your tests allows you to re-administer them in Standard or Practice test modes at anytime. The CREATE AS PRACTICE TEST checkbox option simply is used if you intend to immediately provide screen tests, paper tests or Web (HTML) tests. You can always re-apply these test (.tst) files in any mode at anytime at a later date. To automatically administer predetermined test (.tst) files to students using their own personal login names and passwords, see Chapter 7 topic: Assigning Student Tests. This will provide all the necessary information needed to assign student tests to student login accounts. If the REQUIRE LOGIN NAME AND PASSWORD AT START-UP checkbox is selected from the OPTIONS menu, you then have the ability allow student to log into this software, if their account has been assigned a test, it will activate immediately and present it to the student. Once the student is completed with the test, the software will log them off line and await another student to login for their test. In this way, it would require little if any monitoring. Student accounts do not allow the use any other functionality of this software. Test scores are automatically graded and the information stored within the test (.tst) file itself. All TestBank files you wish to use to create tests must not be after any skipped (blank) TESTBANK PATH/FILE NAME(S) or AMOUNT fields. The TEST BUILDER will stop reading in any subsequent field data (if any) once the first empty (or skipped) field is detected. Therefore, any TestBank files you may have set-up after a blank field will NOT be used to create the test. Please place all TestBank and question amount information in order starting at the first TESTBANK PATH/FILE NAME(S) and AMOUNT fields, then working your way down to the next field. Each TestBank file you create are not required to be used when creating student tests. However, you may choose any one or as many (up to 50) TestBanks as desired when building tests. Therefore, you may create as many TestBanks as you wish as long as you use no more than 50 at a time when building student tests. There is no maximum number of test items which can be selected from each TestBank file used. The limit imposed is based on the number of test items in each TestBank file itself. For example, if there are 30 test items in a specific TestBank file, then the maximum number of questions in which the randomizer could choose from would be 30 for that file. TestBank files by themselves have no limit to the amount of test items you may add to them. To view the amount of test items, and what types of test items are contained within any TestBank file, use the TESTBANK selection under the PROPERTIES option from the FILE menu item. The TOTAL QUESTIONS window below the AMOUNT windows in the TEST BUILDER will tally the various amounts of test items requested for each TestBank providing the total number of test items which will be created for the test currently being built.
62
Hirtle Software
If your TestBanks contains test items which you have made unavailable to the randomizer, then this will limit the maximum amount of questions in which you may request to generate a test from these TestBanks. For example, if there are 50 total test items in a TestBank file and you have made 10 questions unavailable to the randomizer, this leaves a total of 40 questions in which the randomizer may choose from this TestBank. Therefore, the maximum questions is 40 vice 50 in this case. In addition, you should consider what options are set-up especially for printed (paper) tests. If you choose not to print test items which have graphics, sounds and/or movies associated to them, this will also limit the total amount of available questions which may be randomly selected from TestBanks which are being used to create tests. Therefore, you should refer to the OPTIONS under the TOOLS menu item. Select the TESTS button to review which question types (if any) have been selected to not be used for paper, screen and WEB (HTML) tests. You may modify these options if you desire. By selecting these options, entire test items which have these multimedia files associated to them will be unavailable when tests are built, you are not simply just disallowing the selected multimedia files to be used, but the entire test item as well. Please remember, TestBank files act as repositories of test items, not necessary all questions within them will or should be used to create tests. The test items within them should be much more than the number you wish to extract to create any given test. This will allow the randomize process to be most effective. Since different tests, will have different questions, in different orders. You may create multiple (unique) Screen and Paper tests with one set-up routine. This will allow you to make many tests without the need to set-up each test individually. Selecting the number of tests desired from the TOTAL TESTS TO CREATE option will create that number of tests with each test having the exact same values as set-up on the TEST BUILDER form. However, the test items which are randomly selected will be unique for each test. The test items themselves will be the only difference between each test. If you wish unique test titles, TestBanks, question amounts, passing score values and/or time limits, then you will need to set-up these tests individually for each test batch with their own test settings. There are two methods to create multiple tests. The first method as shown above will create multiple tests where each created test will be created independently. Therefore, each test may contain different test questions. However, if you wish each student to receive the same paper test but have the ordering of the questions in different for each test, then you should create a single test from this TEST BUILDER method and within the printable form which displays your (single) test, you would select the DUPLICATE & SCRAMBLE button. This will duplicate the exact same test but place the ordering of the questions randomly. Each time you select the DUPLICATE & SCRAMBLE button the same test will be created with randomly ordered questions. You may do this as often as you like to allow the same test to be provided to a group of students with the ordering of the questions to be different for each test. However, be aware that if you have grouped test items being used, the DUPLICATE & SCRAMBLE button will ignore this grouping and the new test will be duplicated and scrambled like any other.
63
Hirtle Software
Test file names for multiple tests are based on the test name which you provide after the ACCEPT button has been pressed. Multiple test files will use the exact file name you provide and attach a test number to your file name in order to provide a unique file name as required by Windows. For example, if you name your test file to "MyTest.TST" when prompted. This software will automatically name the first file created to "MyTest1.TST", the second file will be named "MyTest2.TST", etc... This will assure that every .TST file created will be unique when saved to disk. This TEST BUILDER will create all .TST files first. Then depending if they were created for screen or paper, they will either be queued for immediate screen test administration or be prepared for printing on paper. Since only one screen test may be administered at a time, the first test file created will be the test file which is queued for immediate administration. A message box will appear informing how many tests was created and ask if you wish the first created test to begin. Selecting the YES button Will start the first test. Selecting the NO button will exit the test administration function. Created test (.tst) files are still available and may be queued manually at anytime to administer them to students by selecting the RE-ADMINISTER STANDARD TEST or READMINISTER PRACTICE TEST in either the RECALL SCREEN TEST or RECALL PAPER TEST options from the TESTS menu. You can use the CREATE HTML TESTS FROM TST FILE with either STANDARD TEST or PRACTICE TEST options to create specific Web Tests for Standard or Practice test modes. Tests will not automatically queue themselves as they are completed when multiple screen test batches were created. This must be done manually after the first test has been completed or you can use the ADMINISTRATION options to assign test (.tst) files to student accounts. You may also administer the exact same test (.tst) file to multiple students simply by selecting the same Test (.tst) file. When creating multiple paper tests, each test will be displayed in their own printable form all at once prior to being printed. You may edit these created tests if desired. However, please remember changes to test items on these printable forms do not change the same information inside of TestBanks. Therefore, any permanent changes to test items should be done at the TestBank level. Otherwise, the next time the test item is selected it will still have the original information without the changes you made on the printable forms. Since tests are created from TestBanks, editing test items from TestBanks is the only was to assure that your changes will be permanent and take effect immediately.
64
Hirtle Software
Printable student tests will automatically place test answer keys which are unique to that test at the very end of each student paper test. The idea for doing this is to make it easier for grading since tests are based on randomly selected questions extracted from TestBanks. Therefore, each test is potential very unique from all others created. Grading these students tests can be difficult because of this. However, by creating a customized answer key for each paper test created, the grading process should be much easier. The Test ID at the top of every student test corresponds to the same Test ID displayed at the top of every answer key. Matching up these Test IDs will assure that you have the correct answer key for any specific test. You are not obligated to keep these answer keys as they may be manually deleted if desired. However, be aware that they exist at the end of every paper test created. You should obviously remove this part of your printed tests and keep the answer keys safely stored away from students prior to handing tests to students. You may also create student answer keys from test (.TST) files at anytime using the CREATE TEST ANSWER KEY from the TESTS menu.
Random Test Generator-PRO cannot set automatic page-breaks when creating paper tests or any paper report. Therefore, you may wish to administer your own page-breaks in locations you desire. If so, the easiest way of doing so is sending your paper tests and reports to MS-Word (if installed) which provides automatic/manual page-braking capabilities. Within RTG-PRO you can perform a print preview to observe how pages will appear when printed. Then you can close the preview window and adjust your line spacing accordingly. If you observe other formatting problems when creating paper tests and reports, this may be caused because of a Windows system file which is used by RTG-PRO and many other applications which use word processing functionality. Its possible that this system file on your computer is a different version than RTG-PRO basis its formatting on. Please see the Technical Support topic on this subject. In addition to printing, paper tests may also be saved as Rich Text files (RTF). This file type may be used directly with most word processing applications such as MS-Word. Your test files will be saved with the exact same formatting as you see, including images, font names, colors and sizes. Therefore, saving your paper test files as RTF files is an ideal way to maintain tests which you wish to administer over and over again. To save your tests as RTF files, follow these steps: Make sure the test you wish to save is the active window by clicking on it once.
65
Hirtle Software
Select the SAVE AS option from the FILE menu.
Type-in the file name you wish to save it as and make sure that the SAVE AS TYPE list box below is RICH TEXT FILE (.RTF). You may opt to use the default file name provided by this software or use your own name.
Select the directory location you wish to save your test file into Select the SAVE button
You may open these files directly from your word processor or open them back into Random Test GeneratorPRO any time. The SEND TO MS-WORD button on your printable forms will make a copy of the current active form and send its contented to MS-Word (if installed). This bypasses the saving as an RTF file. Therefore, no file is saved unless you do so either in Random Test Generator-PRO or in MS-Word. The DUPLICATE & SCRAMBLE button on the top of your printable forms is activated only when a test is opened directly from a test (.TST) file. This option allows you to create a new test based on the current test but move around the test questions in random orders. This is convenient if you wish to provide a group of students the same test but have the security of knowing that each student has their test questions in different orders. This will make it very difficult for students to cheat by simply looking at their neighbors test. You are not able to use the DUPLICATE & SCRAMBLE option by opening an existing Rich Test File (RTF). However, by maintaining your student test (.TST) files, you are able to use the RECALL PAPER TEST option from the TESTS menu to re-create a paper test which will allow you to use the DUPLICATE & SCRAMBLE option as often as you wish. You may also save your tests as text (.TXT) files using the same steps above but select the SAVE AS TYPE list box to TEXT (.TXT) vice RICH TEXT FILES (.RTF). However, saving files as text will strip any font formatting and images from the test when saved. Therefore, you should consider this before deciding this file type to save as.
66
Hirtle Software
Paper student test printable forms are created with the multiplechoice answer selections indented at 0.5 inches from your left margin setting. In order for answer choice letter options to stand out while the answer choice text indents at an additional 0.5 inches, a Hanging Indent has been applied to the first line of every multiple-choice answer choice. Therefore, you may set your indents to any spacing you desire, the Hanging Indent will remain. If you wish to remove the Hanging Indent select (highlight) the entire text and then select REMOVE HANGING INDENT option from the INDENT selection located in the EDIT menu. This will cause the answer choice to align at the same spacing as the indent spacing (if set). Selecting the REMOVE INDENT and REMOVE HANGING INDENT options from the EDIT menu will set the selected text to align at your left margin. WEB (HTML) tests will display a second file dialog box and ask you to enter a file name for the HTML file it will create. Simply type in an appropriate file name (spaces not allowed in HTML files names) and your test will be created in an HTML format to administer over the Internet. WEB (HTML) tests are always created from the .TST files in which every test creates. Therefore, once your .TST file is created by the TEST BUILDER it will then automatically create an WEB (HTML) test from it. Because WEB (HTML) tests create test projects which include multiple HTML files and media files (if used), only one Web (HTML) test may be created at a time. However, the TEST BUILDER form and the original values will still remain after any test is created. Simply reselecting the ACCEPT button after a test has been created will create another test with the same values (but different questions). Or you may create multiple screen or paper tests, then select the CREATE HTML TEST FROM TST FILE option from the TESTS menu to manually create WEB (HTML) tests. There is no difference between test (.TST) files between screen, paper or Web tests. This method would allow you to create all the test (.TST) files at once and then the ability to create Web Tests one by one from them. Using advanced Text-to-Speech functionality, this software assists those with visual disabilities when students are administered screen tests. In addition to hearing questions and answer choices, you may also navigate through test items and select answers without using the mouse. This may also assist those with visual disabilities while in screen test mode. The following are keyboard keys which may be used to substitute mouse operations to navigate through test items: SELECTING ANSWERS Simply select the letters (A through E) which corresponds to the answer choice you wish to select for the test item currently displayed for multiple-choice/true-false or type-in answers for fill-in/essay questions. MOVING BETWEEN TEST QUESTIONS
< = Move back one test question number (less than symbol) > = Move forward one test question number (greater than symbol)
Select only the keyboard keys which display these symbols. Do not select SHIFT, CTRL or ALT keys in addition to these keys. http://www.hirtlesoftware.com
67
Hirtle Software
Controlling What Gets Printed

There may be times when you do not wish to print Reference data, multimedia test items, QID numbers, and/or other information to students within your paper tests. The following sub-topics will provide step-bystep details on how you can control exactly what gets printed when you create student tests:
Printing References
Select the OPTIONS function from the TOOLS menu item.
Deselect the PRINT REFERENCES and/or DISPLAY REFERENCES options for Screen, Paper and/or WEB tests as appropriate to disallow reference data to be printed. Select the ACCEPT button.
Reference data is stored in test files regardless if you display or print them out. Therefore, deselecting the PRINT REFERENCES and/or DISPLAY REFERENCES will not prevent them from storing this information in your student test (.TST) files. Therefore, even after the test was built you can later turn on this feature for the same test files already created when you recall them at a later date. Since test items designed around animations, videos, and sounds are usually administered on a computer system which can play them, normally you would not desire to have them printed on paper tests since you cannot see animations and videos or hear sounds. There may also be times in which you may not wish to print any test items which contains a graphic. Follow these steps to prevent printing of any test question on paper which use graphics, animations, videos, and/or sounds individually or collectively:
68
Hirtle Software
Printing Multimedia Test Items

Deselect the PRINT AVI/MPG/ANIGIF QUESTIONS, PRINT MP3/WAV/MIDI QUESTIONS, PRINT GRAPHIC QUESTIONS, and/or PRINT OTHER QUESTIONS options as desired to disallow these test items to be selected when tests are created. Select the ACCEPT button.
There may be times when you do not wish to print out QID numbers for your test questions when building a test. Follow these steps to turn off the printing of QID numbers:
Printing QID Numbers

69
Hirtle Software
Deselect the PRINT QID NUMBERS option from the PAPER TESTS area to disallow QID number to be printed. Select the ACCEPT button.
QID numbers are very valuable to identify test items within and between TestBanks. Tests generated from randomly selected test items will display/print test items in different orders (question numbers) from test to test. For example, on one test a specific question may be question number 5, on a different test, the exact same question (if selected) may be question 1. Therefore, there is no way to identify the original location of a question within TestBanks based on it's printed test question number. The QID number will always be a part of the test item regardless of what question number it appears on a test. This makes it easier to locate a test item within TestBanks for modification if necessary. QID numbers can only be turned off on paper tests. Screen and Web Tests will always display QID numbers for each question selected by the randomizer. You have the ability to include test items in TestBanks but disallow them to be randomly selected whenever tests are being built from them. Each test item in a TestBank contains a checkbox option (located next to the QID number) of the application which states; MAKE UNAVAILABLE TO RANDOMIZER. Choosing this option will prevent the test item from being randomly selected whenever a test is being built using the TestBank. By deselecting this option, it will make the test item available for random selection. This feature allows you to create test items in your TestBanks but they may not ready to be presented to students as yet. There may be many situations you wish not to make certain test items available to the randomizer such as when a portion of a topic was not covered in class, but you already have questions created for it, or a test item's validity is in question and you wish to hold back the test item from students. This feature allows you to retain test items in TestBanks even if they will not be used in tests. Therefore, you do not need to delete these test items, just make them UNAVAILABLE TO THE RANDOMIZER.
When creating Fill-in the blank and Essay question types for paper tests you have the ability to control how many blank lines will be printed for each fill-in/essay question used with a student test. These blank lines are designed for students to fill-in their answers to these questions. Follow these steps to set-up this feature to the desired number of lines you wish printed: http://www.hirtlesoftware.com
70
Hirtle Software
Printing Blank Student Essay Lines

Select the NUMBER OF ESSAY LINES list box and highlight the desired number of lines you wish. Select the ACCEPT button.
You have a choice between 1 to 10 lines that will be created for fill-in/essay questions. The same number of lines will print for all fill-in/essay test items. You may also edit these printed lines manually within the printable forms with your student tests or even in MS-Word if desired. Therefore, you are not required to maintain the number of lines prior to printing. Everything on these printable for are editable. When creating multiple-choice and True/False question types for paper tests you have the ability to print a small blank space for students to write-in their answer choices. Follow these steps to set-up this feature to print blank answer space for multiple-choice and true/false question types:
71
Hirtle Software
Printing Blank Answer Spaces (Multiple-Choice)

Select the PRINT STUDENT BLANK ANSWER SPACE checkbox. Select the ACCEPT button.
Test Items selected by the randomizer will vary widely from test to test. This also holds true in regards to the order in which they are selected. This process is truly random in that this selection process is very unpredictable. There may be times that you wish selected test items to be in the same order in which you created them in their associated TestBanks, typically their QID numbers would follow this same order from lower to higher as you add new questions to TestBanks. Although, the test items are selected randomly, the order in which they are placed within tests may be somewhat controlled. You may allow the display of test items by their QID number or simply the same order they where randomly selected from TestBanks. To view or change this setting follow these steps:
Selecting Test Item Order for Student Tests

72
Hirtle Software
Select the ORDER STUDENT TESTS BY QID NUMBER or ORDER STUDENT TESTS RANDOMLY options as you wish. Select the ACCEPT button.
Its important to understand that in both circumstances test items are selected from TestBanks randomly. The only difference between these two options is how the selected items will be displayed to students, either by their QID number or the order they were randomly chosen. It has no effect on the actual test items which were randomly selected. These options apply to all test types Screen, Paper and WEB/HTML tests. The only way to guarantee that any test item will be randomly selected is by identifying that every test item inside a TestBank is to be used to create a student test. Although, this is an acceptable practice, the idea of a random test would be lost in such circumstances since each question will be selected. Typically TestBanks should contain large amounts of test items for a given subject and small subsets of these questions are randomly selected for testing with each test you create using different test items inside these TestBanks. This provides the fullest randomization possible.
73
Hirtle Software
Saving/Recalling Commonly Used Test Settings

When designing a test using the TEST BUILDER option from the TESTS menu item, you have to supply exactly which TestBank(s) to use, how many questions from each TestBank whether you are creating a screen, paper or WEB (HTML) test, test title, passing score value, number of tests to create, and set the timer features if desired. Often, these parameters may be the same for many tests you wish to create. The SAVE TEMPLATE and LOAD TEMPLATE options in this window are designed to save you the effort of building recurring test parameters each time you wish to create tests. The SAVE TEMPLATE function will save all your settings into the TEMPLATES.TPL file (in your application's folder) and the LOAD TEMPLATE option will recall this data and place the information in its appropriate fields in the TEST BUILDER window, saving you the trouble of re-typing this data in. Since you can use a maximum of 50 TestBanks at a time to create a single student test with, you are then limited to a maximum of 50 TestBanks which may be stored in each template you save. Here are the steps to save and load templates:
Save Template
After you have set-up your test parameters, select the SAVE TEMPLATE button from the TEST BUILDER window. Enter any template name you wish and select the OK button. Note: Every template name MUST be unique. You CANNOT replace an existing template name. You should type in a new template name each time. If you no longer wish to maintain a template, you can delete it.
Load Template
Select the LOAD TEMPLATE button from the TEST BUILDER window. Select the desired saved template from the displayed list. Select the ACCEPT or APPLY button.
Saving and loading template information requires the file; TEMPLATES.TPL which is installed in the same directory as Random Test Generator-PRO. This file is necessary in order to save and recall your test settings. If you delete this file, rename it or move it to another folder you will not be able to save or recall test settings. If the file has been deleted and no longer available you will need to reinstall Random Test Generator-PRO to get it back. Before reinstalling this software we recommend you back up all your TestBank files in a safe location as a precaution. http://www.hirtlesoftware.com
74
Hirtle Software
Selecting Template File Location

The TEMPLATE.TPL file as a default is installed in the same folder as the RTG-PRO executable. This is the location where the LOAD TEMPLATE and SAVE TEMPLATE will initially look for this file. If you choose to move the TEMPLATE.TPL file to any other location, you must identify that location within RTG-PRO or you will not be able to save/load template information when building tests. To identify the location of the TEMPLATE.TPL file within RTG-PRO follow these steps: Select the OPTIONS selection from the TOOLS menu.
Select the GENERAL button at the top of the OPTIONS window. Select the browse () button near the bottom/right of the window to bring up the file dialog box. Point to the new TEMPLATE.TPL location and select the OK button on the dialog box. Finally, select the ACCEPT button to make the change active and to close the OPTIONS window.
75
Hirtle Software
Test IDs and Answer Keys
Student Paper Test Display
Test Answer Key Display
Since, you may create many random tests and administer them to students with each one being different, identifying which answer key relates to which test could be a problem. Random Test Generator-PRO solves this problem by providing every test and its associated answer key print a Test ID number. This Test ID number is unique to every printed and WEB (HTML) test. The answer key will have the same Test ID number as the test it is associated to. Therefore, matching up a test with its correct answer key is simple. Test ID numbers are automatically generated, starting at 1. Each subsequent test will have one Test ID number higher than the previous test. Test IDs can range from 1 to 2,147,483,646. After 2,147,483,646, Test IDs will revert back to 1 and start the counting process all over again. Every test generated will consume a Test ID number. This includes screen and WEB (HTML) tests as well. Therefore, your paper tests may not have consecutive Test ID numbers if a screen and/or WEB (HTML) test was created between paper test prints. Screen tests will not display Test ID numbers since automatic grading is provided for them. These Test ID numbers are stored within the created test (.TST) files. Therefore, if you recall a test for printing at a later date, it will have the same Test ID number as when it was originally created.
Answer Keys
Because every test which is created will be different, correcting paper tests could be a challenge. This is true especially with multiple TestBanks which have very large amounts of test items. Random Test Generator-PRO solves this problem by creating custom answer keys for any test (.TST) file anytime you request one. Printable student tests will automatically place test answer keys which are unique to that test at the very end of each student paper test. The idea for doing this is to make it easier for grading since tests are based on randomly selected questions extracted from TestBanks. Therefore, each test is potential very unique from all others created. Grading these students tests can be difficult because of this. However, by creating a customized answer key for each paper test created, the grading process should be much easier. The Test ID at the top of every student test corresponds to the same Test ID displayed at the top of every answer key. Matching up these Test IDs will assure that you have the correct answer key for any specific test. You are not obligated to keep these answer keys as they may be manually deleted if desired. However, be aware that they exist at the end of every paper test created. You should obviously remove this part of your printed tests and keep them safely stored away from students prior to handing the tests to them. You may also create student answer keys from test (.TST) files at anytime using the CREATE TEST ANSWER KEY from the TESTS menu.
76
Hirtle Software
Follow these steps to manually create answers keys for test (.TST) files: Select the CREATE TEST ANSWER KEY option from the TESTS menu. Then select either TEXT or BUBBLE FORMAT.
Select the desired test file from the dialog box and press the OPEN button.
When using the DUPLICATE & SCRAMBLE button with printable paper tests, every duplicate test and answer key created from the same Test (.TST) file (Test ID) will be provided a REV (Revision) number to the Test ID in order to distinguish themselves from each other. Therefore, you should match-up the Test ID and its REV number in these circumstances for tests and answer keys. You should use the answer key which automatically generates at the end of paper tests when using the DUPLICATE & SCRAMBLE button as you will not be able to manually create answer keys for revised (REV) tests. Creating answer keys from test (.TST) files at a later date will only create the original answer key for that test, not REV answer keys.
77
Hirtle Software
Internet Testing
Example of an Internet Test (WEB HTML) using the MS-Internet Explorer browser
A WEB (HTML) Internet test is designed to be administered over the Internet or your local Intranet. These tests after they are created by Random Test Generator-PRO may be sent to your web server where they can be found by anyone with internet/intranet access. WEB tests are taken using most any common web browser such as MS-Internet Explorer or Netscape Navigator by students at their local computer after they connect to your web server by the URL address of the test file (HTML). Students do not need any special software to gain access to these test files as long as they have Internet access and a web browser such as MS-Internet Explorer or Netscape Navigator. All the Hypertext Markup Language (HTML) and JavaScript code necessary is written entirely by this software when an WEB test is requested. All that is necessary is to send (upload) your tests to a web server so that intended students will be able to gain access to them. It is highly recommended that if you are not familiar with the web server process that a web administrator perform the task of uploading your test files to your server. They should also easily provide you with the correct URL address necessary to connect to the new uploaded test for you and students to gain access anywhere in the world. You can use any FTP software to send your WEB test files to your web server or use the built-n FTP capabilities provided by Random Test Generator-PRO from the UPLOAD TESTS USING FTP option from the TESTS menu item. Using this option will allow you to upload your WEB (HTML) tests and their associated media files (if any) to your web server.
78
Hirtle Software
Random Test Generator-PRO offers two different types of WEB tests; Standard and Practice. Both have advantages and disadvantages. Which one you should use is depending upon your needs. We will discuss each WEB test type in detail in this chapter.
However, if you elect to create a Standard WEB test, student answer selections will be sent to any valid e-mail address. Therefore, you should make sure you have entered the e-mail address you wish these test answers to be sent to from the TESTS button in the OPTIONS window from the TOOLS menu prior to creating a Standard WEB (HTML) test.
Standard Test
Standard Web/HTML tests are administered via your web server. The student may take this Web/HTML test anywhere in the world providing your Web Server has a recognized IP Address and the student has an Internet connection on the computer they wish to take their test with. All that is needed is a standard web browser (MSIE, Netscape, etc...). Standard Web/HTML tests do not provide any type of feed back to students. When students complete their tests they simply select the TEST COMPLETE button on the testing Web page within their Browser. This will then automatically send their test answers via e-mail to any valid email address you specify before the test was created. You may then grade the students test and provide them feedback. Because these tests are administered via the Internet using a web browser and then uses the students default e-mail software, there is no way for RTG-PRO to automatically grade them. However, manually grading is simple. Just create an answer key from the TESTS menu (using the test .tst file) and them simply compare the student answer selections which are provided with the received e-mail messages against your answer key. This test type will forward the student test answer selections via an e-mail message to any valid e-mail address in the world. Once the student has selected their answer choices to each question, they simply press the "Submit Test to Instructor" button and their default e-mail software will convert their test answer selections to an e-mail message automatically. They may receive a security alert notifying them that they are sending an e-mail message and the recipient will be able to know their e-mail address. They should just select OK and the e-mail will be sent. The advantage of this test type is that students do not have access to the answers as in the Practice test type. Therefore, their score would be more reliable to their understanding of the topic. The e-mail recipient is the only one who grades the tests and test answers cannot be found within the HTML code. The disadvantage is that feedback is not immediate since a test proctor must manually grade the test. However this test type is most common for the "reliability" factor. It's ideal for most situations where gathering true student knowledge of a topic is desired. http://www.hirtlesoftware.com
79
Hirtle Software
The E-mail address where students send their test to is embedded within the HTML code when the WEB test is created from the TEST BUILDER option. This e-mail address should be changed prior to building a test for the correct email address to be included when it is created. The e-mail address is changed from the TESTS button from the OPTIONS menu at the TOOLS menu item.
The e-mail address may also be changed within the HTML file itself manually using an HTML editor or text editor such as MS-Notepad. Look for the following HTML code near the top of the HTML file: <FORM method="post" action="mailto:YourName@YourServer.com?subject=Test Submission - YourTestTitle (Test ID=XXX)" enctype="text/plain"> Simply change the e-mail address to the one you desire. Make sure you follow the exact same format as shown here( no extra spaces). Then save your HTML file as text and send it to your Web server. When an Email test type is sent to the instructor by a student it will contain the information necessary to grade it. The E-Mail subject line will arrive such as: Test Submission - YourTestTitle (Test ID=112) Your test title along with the appropriate Test ID number will be contained within the subject of the e-mail message. The body of the arriving e-mail will contain information such as: Test Taker's Name: =John Doe Class ID: =Q12345 Test ID =112 Question 1= QID (70) (70)=a. Allow fainter objects to be seen Question 2= QID (30) (30)=c. The path of the Sun across the sky Question 3= QID (140) (140)=b. True The first line within the e-mail body will contain the name of the student. They will type this in within the Web Page. Also a Class ID field is optionally available for them to use. If you have numerous classes, then this field could be used to distinguish between them. Following Class ID is Test ID. As with paper or screen tests, each test created will have a unique Test ID number. Please refer to Test ID information contained within this help file for additional information. Finally, the questions will follow in sequential order. They will contain their Question ID or QID as a way to verify that the correct test item was provided. Refer to QID information contained within this help file for additional information. The second line after Question number and QID is the QID and student selected answer for the question. Here is the answer selection the student made for the question. There is no need to see the entire test, other than what the student selected to grade it since the Test Name and Test ID numbers will help you match-up the test with it's Answer Key. Its important to understand that you are only receiving the answer choices in which the student has selected. They are not necessarily the true correct answers for your test items. You should simply compare these student selected answers within the e-mail message against your answer key in order to assess whether students has selected the correct answer(s) or not. If students select multiple answer choices for a given test item, each answer selection will be contained within the e-mail message. http://www.hirtlesoftware.com
80
Hirtle Software
Practice Test
Web/HTML Practice tests are administered via your web server. The student may take this Web/HTML test anywhere in the world providing your Web Server has a recognized IP Address and the student has an Internet connection on the computer they wish to take their test with. All that is needed is a standard web browser (MSIE, Netscape, etc...). Web/HTML Practice tests will create an answer key with answer explanations (if provided for) within the same HTML file. Once the student has selected the TEST COMPLETE button on their web browser, their overall final score is automatically computed using RTG-PRO created JavaScripting from their Web Browser and they will then be provided their test score and be able to review every test item one by one using their web browser. Test scores are kept internal and are not transmitted. These tests are typically for students self-assessment. In addition to HTM files your project may encompass multimedia files such as GIF, JPG, BMP, ICO, WMF, WAV, MIDI, and AVI files. If you link any of these files to test questions and these questions are selected by the randomizer, then these files MUST accompany your HTM files at your web server and MUST be in the same directory as your HTM files. Fortunately, Random Test Generator-PRO makes it easy for you to gather all files necessary for your project. When This software finishes creating your WEB test it will provide you a list of every file necessary to make your test work and it will even make a copy of each file from their original folder and place them all in a project folder in a separate directory location. Simply place all these files in your project folder on your web server and your test is ready. Please make sure that each file is in the same directory at your web server. When asked to create a project folder, you should always press the OK button. Otherwise, you will have to gather each file yourself to place on your web server. In order to use the Practice test type with your browser, it must be set to allow JavaScript. Please tell your students that their browsers must be set-up to allow this capability. Typically web browser default settings will have this features already activated. However, many can be disabled by users. Therefore, it is important to publicize this information in case anyone has disabled this capability on the web browser they intend to use to take the student test.
Creating Internet Tests From Existing Test (.tst) Files

The fastest way to create Web tests is from the TEST BUILDER window using the TESTS menu. Simply identify all your settings you wish to use for your new test and make sure the BUILD WEB TEST (HTML) option is selected. The TEST BUILDER will then create a test (.tst) file as well as an HTML file. However, if a test (.tst) files that you wish to use for a student Web test is already created but there is not an HTML file created from it, you can simply use the CREATE HTML TEST FROM TST FILE option from the TESTS menu to create a Web test file in HTML format ready to be sent to your web server. Every test created regardless of type (screen, paper or WEB) may be viewed into any other type. To turn an already created test (.tst) file into a Web test, follow these steps: Select the CREATE HTML TEST FROM TST FILE option from the TESTS menu item. Select whether you wish to create your new Web test as a Standard or Practice test.
81
Hirtle Software
Select the test (.TST) file you wish to be used to create your new Web (HTML) test, then select the OPEN button.
Type-in a (.HTM) test file name when prompted and identify the location you wish to save the file into. Select the SAVE button when complete. NOTE: Internet URL addresses cannot have any empty spaces. Therefore, you should not use any empty spaces for your .HTM file name because this will become part of the URL address when sent to your web server.
After the .HTM file has been created you will be prompted to create a project folder on your desktop with all necessary files placed in it. In most cases you should select the ACCEPT button. Then the .HTM file and all multimedia files (if any) needed will be placed into the project folder for deployment to your web server. Embedded media files (if any) used will be extracted to your Temp directory. Selecting the DELETE TEMP DIRECTORY FILES AFTER COPIED checkbox will remove them since they are unnecessary any longer in the Temp directory once copied to your project folder. You will be then prompted whether to launch your default web browser to view your Web (HTML) test from your local computer. This will allow you to observe the test to verify that it looks proper and functions correctly prior to uploading it to your web server via FTP. You will then be prompted whether you wish to use the built-in FTP function to upload your new Web test and all associated files to your web server. You may upload your test at a later time if desired.
82
Hirtle Software
Uploading Internet Tests to Your Web Server

The embedded FTP functionality provided by this application allows you to send your Web (HTML) tests to your web server which will then allow students to take these tests online from anywhere in the world. The first thing you must do prior to uploading tests, is to create Web (HTML) tests using the TEST BUILDER option from the TESTS menu item or by using the CREATE HTML TEST FROM TST FILE option from the TESTS menu. Once Web (HTML) tests have been created, you can then upload them to your web server. In the process of creating a Web (HTML) test you will automatically be prompted to upload your necessary files using FTP. However, if you select the NO button, you will then need to manually perform this task if you wish to upload your test at a later time. The manual method just means you will have to select the FTP option yourself. To upload Web (HTML) tests using this software's FTP functionality, follow these steps: Select the UPLOAD TESTS USING FTP function from the TESTS menu item.
Type in the URL address of your web server, FTP port, User ID (or Login name) and your account password in the appropriate fields from the FTP UPLOAD window.
Select the disk drive and directory location of where your WEB (HTML) test (project folder) is located.
Select the CONNECT button to connect to your web sever. http://www.hirtlesoftware.com
83
Hirtle Software
After successfully connecting to your web server, doubleclick on the directory location at your web server (right hand side of window) where you wish to send your test to.
Select the first project file (left hand side of window) and drag & drop it onto the directory location of your web server (right hand side of window). This will auto-transfer the file.
After file transfer is complete, follow the same procedure to select each additional file (if any) until every file associated with your test (including media files, if any) has been uploaded. Select the CLOSE button to disconnect and exit the FTP UPLOAD window.
This software provides the functionality to upload your files using FTP. However, FTP experience is highly recommended to perform these functions. Please use a qualified individual such as your web site administrator to upload your test files. Please make sure that every test file including necessary multimedia files (if any) are included in the same folder on your web server. The HTML code automatically created assumes that all project files reside in the same directory and will only search within the same directory in which your HTML test file is located. Any missing files will cause a malfunction in the testing process to some degree, such as images (if any) not displaying. After your test files have been successfully uploaded, you may view and/or administer the test by connecting to the Internet and pointing your web browser to the test name HTML file on your server by its URL address that was uploaded such as: http://www.mywebsite.edu/myfolder/mytestname.htm Your web site administrator should easily locate the appropriate URL address for your test if you are unable to locate it yourself.
84
Hirtle Software
General
Throughout our testing MS-Internet Explorer v5.0 and above was the hands-down best browser, especially when using advanced multimedia files with test questions such as AVI and MIDI. However, Netscape V2.0 and above as well as MS-Internet Explorer v3.0 and above both advertise they are capable of handling the requirements of Web test files created by this software. But, like anything the newer the version of browser the more likely that the test will run smoothly. Based on our testing we recommend that MS-Internet Explorer (v5.0 or higher) be used by yourself and your students. Internet (Web/HTML) tests will not use any special font formatting that may be used within your TestBanks and/or Student Test (.tst) files. This is because the formatting commands are different within HTML files in regards to font formatting. Therefore, any special font colors, bolding, underlining, symbols and sizes that you may have used will not be used when the HTML file is created. The HTML file will use a base font name and a single font color. Any underlining, bolding or special font symbols will not be used within the HTML file. If these font attributes are important, then you will need to edit the HTML file yourself once created. However, uppercase lettering (if any) will be retained. In addition, only embedded or linked images will be used for Internet (Web/HTML) tests. If you Inserted images directly into test questions or answer choices, they will not be carried over into your new HTML files. Only image files which have been used via the Embedded or Linked methods will be carried over to your HTML files. Therefore, if you intend to create Internet (Web/HTML) tests, you should not use the INSERT IMAGE option from the EDIT or pop-up (right-click) menus. The automated HTML code generated by this software can be modified if desired using any editing software or even using MS-Notepad. The generic HTML code created is meant to meet the needs of the majority of customers using this software. There may be additional information desired for your own Web tests. You are free to make any changes you desire to the HTML code to satisfy your needs. However, any changes to the original HTML code is your own responsibility. We only support the HTML code generated by this software. Using multimedia files with Web (HTML) tests are at the mercy of the web browser(s) in which they are connected to. Therefore, the web browsers own capabilities is what determines the quality or whether certain types of multimedia files are supported. As mentioned earlier we recommend MSIE v5.0 and above. In addition, many multimedia types may not be supported by web browsers. For instance most browsers do not directly support MP3 music files without a special plug-in. You should make sure that your tests uses multimedia files in which you know will be supported and that your students have or understand what browsers they should use in order to take your Web tests. Therefore, some trial and error may be necessary to confirm the minimum requirements necessary that students must have in order to successfully take an online exam using your multimedia files. If you have test items in your TestBanks which use MP3 media files or other formats in which typical web browsers do not support, you can disallow such test items to be selected when creating Web (HTML) tests by following these steps:
Disallowing Unsupported Multimedia Files from WEB Tests

85
Hirtle Software
Deselect the DISPLAY MP3 QUESTIONS and/or DISPLAY OTHER QUESTIONS check boxes as you wish from the WEB TESTS (HTML) area.
Select the ACCEPT button.
86
Hirtle Software
Modifying Test Settings

When tests are created using the TEST BUILDER option from the TESTS menu item, you have the opportunity to identify the test title, time limit imposed and identify what value is considered the passing score. These tests are saved as files (.tst) on your disk drive when the test is built. There are times which you may wish to re-administer these tests at a later time but wish these settings to be different. Changing these values is very simple, follow these steps: Select the CHANGE CREATED TEST VALUES function from the TESTS menu item.
Select the test (.TST) file you wish its values to be changed, Then select the OPEN button.
In the CHANGE TEST SETTINGS window modify the settings as you wish.
Select the ACCEPT button when you are completed.
Your new test settings will stay with the test file unless the settings are changed again at a later time. Time limits and passing scores only apply to tests administered on the computer (screen tests). However, these values will have no effect for paper or Web (HTML) tests if the files are later used for these test types. http://www.hirtlesoftware.com
87
Hirtle Software
Chapter 4 Administering Student Tests

The TEST BUILDER option allows you select the TestBanks and amount of questions to randomly select from each. In addition, you must also decide in what format you wish to initiate the test in such as screen, paper or Internet Web (HTML) tests. This test type selection informs the software how to display your test after it is created. Screen tests will provide you the ability to administer the test on the computer to a student immediately (if desired). You may also provide the created test at a later time using the READMINISTER STANDARD TEST or RE-ADMINISTER PRACTICE TEST selection from the RECALL SCREEN TEST option in the TESTS menu. Creating paper tests will display printable documents with your created tests and answer keys included. The paper test format also allows you to duplicate tests but scramble the question order and/or to send the test to MS-Word (if installed). Finally, Internet Web Tests will create an HTML file from the test (.tst) file automatically to allow you to present the test to students via the Internet or your local Intranet. All three test formats are created from Test (.TST) files which are created from the TEST BUILDER option in the TESTS menu. In fact, these .TST files are the exact same format regardless of whether you initially requested screen, paper or Web (HTML) tests. Which means you can re-use these test files again and again if desired. You may also re-use them in any other format as well. For example, you may re-administer tests you created for the screen as paper or Web (HTML) tests. You may even interchange these test files as either Standard or Practice tests. Test (.tst) files created for any initial test type are base files which means they can be re-used and interchanged at any time. http://www.hirtlesoftware.com
88
Hirtle Software
Administering Screen Tests

This topic discusses the manual method of providing screen tests to students. However, if you wish to have this software automatically administer screen tests to students after they login using their personal login name and password, please refer to chapter 7, topics: Administrating Student/Instructor Accounts and Assigning Student Tests. Those topics will discuss in great detail how to create student accounts and how you may assign specific tests (.tst) files to these student accounts. This software will automatically administer your specified screen tests to a specific student immediately upon their next login. Once their assigned test is completed, they will automatically be logged-off awaiting for another student to log in to take their assigned test. This process will provide you the ability to assign tests to as many student accounts as you wish. Students are then automatically administered these tests and logged out without having access to other parts of this software. This will free-up your time and not require you to monitor students. You simply provide them a login name and password to gain access. This process requires that the REQUIRE LOGIN NAME AND PASSWORD AT START-UP checkbox be activated from the OPTIONS menu. If this student login process is what you are interested in, refer to detailed information in chapter 7 of this manual. Screen tests are administered over the computer. Once a screen test is created using the TEST BUILDER or the READMINSTER STANDARD/PRACTICE TEST options, this software will ask you to select the OK button when you are ready to begin. If you selected a time limit for this test, you should have the student ready as soon as you select the OK button to begin the test as this will start the countdown timer immediately thereafter. The student then simply selects multiple choice/true false answers or types-in their fill-in/essay answers to the questions posed. They may navigate from question to question using the Arrow buttons just above the timer. They may go back and reanswer questions at anytime.
Double-clicking any test question, answer choice, reference box or answer explanation box will enlarge that box greatly. This will allow students a big viewing area to observe the specific information while being administered screen tests. To reset the box back to its normal size, the student should then simply doubleclick it again. This double-clicking process acts as a toggle between enlarging and resetting back to normal these boxes. When students select their answer choices for multiple-choice and true/false question types during screen tests their selections will display in the YOUR SELECTION(S) window on the screen test itself. Also, the background color for the selected test items will highlight in a shade of yellow as an indicator of what answer choices have been selected. When students return to test items they have already provided answers to, their answer choice selection(s) will highlight and the YOUR SELECTION(S) window will display what answer choices they have selected. They may keep these selections or change them at anytime prior to exiting the test. Once they are finished they should select the TEST COMPLETE button. http://www.hirtlesoftware.com
Student Screen Test
89
Hirtle Software
The screen testing function will then ask the student to verify that they wish to exit the test.
The software will then validate the completed test by verifying that all test items have been provided answers by the student. If an unanswered test item is detected, the student will be afforded an opportunity to provide an answer to such test items or they may exit (complete) the test without provided answers to alerted test items. If the time expires (if timed) prior to the student completing the test, a pop-up box will appear notifying the student that their time has expired, when the student selects the OK button, the test will exit with all the saved student answers to that point stored away in the appropriate test (.TST) file. At no time can the student make any additional answer selections after the expiration time. For all screen tests, once completed, and if the REQUIRE LOGIN NAME AND PASSWORD AT START-UP checkbox is activated from the OPTIONS window, the password login window will appear and not allow access to Random Test Generator-PRO until a correct login name and password is entered. This is done for security reasons so students who are not monitored cannot obtain access to this software after test completion. However, if the password feature is not activated then students can obtain access to this software when the test is over. This should be considered if student are not being monitored during screen tests. If you have the SPEECH SETTINGS window set to ENABLE TEXT-TO-SPEECH for TEST ADMINISTRATION, then when Screen Tests are presented to students the test items will then be audibly read out-loud by this software. Students may then use the SPEAK/STOP SPEAK and ENABLE SPEAK/DISABLE SPEAK buttons to control speech behavior on their screen test window. The SPEAK/STOP SPEAK button acts as a toggle to speak the current test item out-loud or stop speaking the current test item (in mid-sentence). The STOP SPEAK button only stops the current reading and does not permanently stop the speaking for other test items as the student navigates between them. However, the ENABLE SPEAK/DISABLE SPEAK button acts as a toggle to permanently activate or deactivate the speech software. This allows students control as to whether they wish to hear the speech software regardless of the speech settings that have been set from the SPEECH SETTINGS window. However, the character will still adhere to the other settings such as whether it visibly displays and whether it uses the balloon style text window when it speaks. The student cannot control these settings while the screen test is in progress. Therefore, the SPEECH SETTINGS window settings for DISPLAY CHARACTER and DISPLAY BALLOON STYLE (for TEST ADMINISTRATION) are permanent unless changed. These settings will be relied upon whenever the student decides to enable the speech software while being administered screen tests. The setting to enable or disable Test-to-Speech in the SPEECH SETTINGS window is simply a default setting. When screen tests are first started, this setting is what will occur. However, the student may then change whether their individual screen test will use the speech software from the ENABLE SPEAK/DISABLE SPEAK toggle button on the screen test itself. They may change their mind at anytime while in screen test mode. Any follow-on students who are administered screen tests will revert back to the settings in the SPEECH SETTINGS window as the default values.
90
Hirtle Software
The ALERT UNANSWERED checkbox from the TESTS area of the OPTIONS window allow you to set whether you wish the student to be alerted on each test item they have left unanswered. If selected, students will receive a message box for every test item in which they have not provided an answer for, once they have selected the TEST COMPLETE button on Screen Tests. This is a good feature to use if you wish students to be reminded when they have indicated they are complete with their test but have test items unanswered. It will allow them to answer any unanswered test items prior to actually exiting their test. However, if they have left numerous unanswered test items, then the continuous alerts for each test item could be annoying if they purposely wish to leave test those items unanswered. Students are never required to provide answers to test items. The alert is just a reminder. They may simply select the NO option on the alert pop-up box to leave any test item unanswered. Once all items have been checked for student answers and the student has provided answers to alerted test items or choose to leave any or all unanswered, their test will exit. This option only applies to screen tests.
Administering Paper Tests

Using the TEST BUILDER window you may create student tests to be administered as traditional paper tests by selecting the BUILD PAPER TEST option. You may also create paper tests from any test (.tst) file on your computer by selecting the RECALL PAPER TEST and the STANDARD TESTS or PRACTICE TEST options from the TESTS menu. These options will create the test in a printable form that you may edit or print immediately. Paper Tests are administered in the traditional way once they are printed. Be sure to collect all answer keys which are automatically displayed at the end or every test prior to administering them to students. You may also delete these answer keys prior to printing if you desire. You may create an answer key at anytime from the CREATE TEST ANSWER KEY option from the TESTS menu. Matching up TEST ID numbers for tests and answer keys will assure you that answers keys are correct for their respective tests.
Administering Internet (Web/HTML) Tests

Using the TEST BUILDER window you may create student tests to be administered as Internet Web(HTML)tests by selecting the BUILD WEB TEST (HTML) option. You may also create Web tests from any test (.tst) file on your computer by selecting the CREATE HTML TEST FROM TST FILE option from the TESTS menu. These options will create the test in a new HTML file in which you may then send to your web server and ready for students to access immediately. To administer these tests you must upload the HTML file and any multimedia files used in your HTML test file to your web server. This software provides a very streamlined method to create and deploy your Internet Tests. This process is covered in great detail in the previous chapter under the Internet Testing topic.
91
Hirtle Software
Creating Test Bubble Answer Sheets

Test Bubble Answer Sheets allow students to provide their paper test answer selections by darkening-in circled letter choices. In addition you may create your answer keys in the same bubble format (from the TESTS menu) for consistency. Test Bubble Answer Sheets are created and customized to the specific test. Therefore, the available choices in the answer sheet will be based on the exact same available choices of the test (.tst) file itself that you select. For example, if question number 3 has only answer choices A, B and C available in the test, then the Student Answer Sheet will also only have these answer choices available. Here are the steps to create Test Bubble Answer Sheets:
Select the CREATE TEST BUBBLE ANSWER SHEET option from the TESTS menu.
Select the student test (.tst) file you wish to create a customized answer sheet for. Then select the OPEN button.
Bubble Answer Sheet - Display http://www.hirtlesoftware.com
92
Hirtle Software
Please note that Answer sheets are based on the order which is selected from the TESTS button in the OPTIONS window from the TOOLS menu item. At the bottom of this window, the options to ORDER STUDENT TESTS BY QID NUMBER and ORDER STUDENT TESTS RANDOMLY are available. These options not only allow you to format the order that test items are placed within tests, but will also follow the same order for answer keys and sheets. Therefore, if you create a test using one choice you Must use the same format when creating an answer key or sheet at a later date. Otherwise, your answer key or sheet may not match the order of the test items. This is very important to understand. Even though they will both display question numbers in what seems the right order because they flow sequentially, they will not be correct because the question number is unrelated to the order of the test items. If you create answer keys and sheets manually please verify that you are using the same test ordering format as the original test was created in to avoid test/answer key mismatches. Currently you are not able to create customized Bubble Answer Sheets when using the DUPLICATE & SCRAMBLE button with printable paper tests. Creating Bubble Answer Sheets from test (.TST) files at a later date will only create the original Bubble Answer Sheet for that test, not REV Bubble Answer Sheets.
93
Hirtle Software
Re-Administering The Same Tests

There may be occasions when you wish to re-administer the same (already created) test more than once to the same or different students. Either immediately or at a later date. This can easily be done because every test created is saved in a test (.TST) file. This application allows you to re-administer the exact same tests as often as you desire. To re-administer test files follow these steps:
Screen Tests
Select the RE-ADMINISTER STANDRAD/PRACTICE TEST function from the RECALL SCREEN TEST option found in the TESTS menu.
Select the Test (.TST) File you wish to re-administer from the File directory.
Select the OPEN button when ready to begin the test.
If the Test (.TST) file has been previously administered (as a screen test) and the previous student has selected answers to the questions within the file you will be notified and will be provided an option to erase all the previous student answers in order for the new student to take the test. Therefore, if you wish to retain the previous student's answer selections, you should not re-administer the test (.TST) file. You may make copies of the file for other students using Windows Explorer. If you wish to use the automatic GRADE TEST function, you must initiate it prior to re-administrating the exact same test (.TST) file to another student for screen tests since each time the test file is administered all the previous students answer selections will be erased in order to record the new students answer selections. Each new student who use the exact same test (.tst) file will overwrite any previous students test answers choices. Only a students overall grade is retained within the test (.tst) file and not their specific answer selections when a new student uses the same test (.tst) file. http://www.hirtlesoftware.com
94
Hirtle Software
Paper Tests
Select the STANDARD TEST or PRACTICE TEST options from the RECALL PAPER TEST selection found in the TESTS menu item.
Select the Test (.TST) File you wish to recall from the File directory.
Select the OPEN button to display the test in a printable form. Select the PRINT option from the FILE menu or the Print Icon on the toolbar.
95
Hirtle Software
The DUPLICATE & SCRAMBLE button allows you to create an exact duplicate of the same test, but the question order will be in random (scrambled) order. Therefore, you could continue selecting this option to create as many scrambled tests as desired allowing you to provide the exact same test to students with (potentially) no two tests having the same question order. This option is perfect to help prevent cheating by students since their neighbors test could be quite different than their own. To assist in grading these tests, unique answer keys are created for every paper test you create at the end of each test. Matching up tests with answer keys is very simple because each test and answer key will have their own unique Test ID number. Therefore, simply match the answer key Test ID number with its corresponding test (Test ID number) to assure you have the correct answer key for a specific test. There is no way to recreate these custom (REV) answer keys at a later date. Only the original answer key may be re-created. Therefore, if you use the DUPLICATE & SCRAMBLE option, the REV answer key automatically created at the end of the test is your only chance. If you delete them they cannot be retrieved at a later time. Also available is the SEND TO MS-WORD button which will send the selected test to a new MS-Word document. This option will only work if you have MS-Word installed on the same computer. This feature allows you to use MS-Word and all its capabilities such as to edit or print the selected test file. In addition, all your formatting such as fonts and colors will remain the same as designed in Random Test Generator-PRO. You may have to adjust your margin settings inside MS-Word in order to obtain the exact same appearance. If MS-Word is not installed on your computer, you may save these files in .RTF format. This will allow you to open them up using many word processors including MS-Word while maintaining the exact same formatting, including images (if any).
Internet Tests (Web Tests)

The following procedures will create Internet Web (HTML) tests from existing test (.tst) files:
Select the CREATE HTML TEST FROM TST FILE option found in the TESTS menu item, select either the STANDARD or PRACTICE test option as desired.
96
Hirtle Software
Select the Test (.TST) File you wish to use to create your new HTML file with from the file directory.
Select the OPEN button when ready to begin the test.
Online Internet tests may be administered to as many students as you desire without requiring any action on your part between students. Once your test files are uploaded to your web server they may be accessed immediately by its Internet URL address such as; http://www.myserver.edu/myfolder/myfile.htm. If you are unfamiliar with this process, your web administrator should easily assist you with this procedure. The CREATE HTML TEST FROM TST FILE option does not change the original test (.TST) file in any way. It merely extracts the test data from the .TST file and creates a new Internet Test (Web Test) in HTML format. Internet (Web/HTML) tests will not use any special font formatting that may be used within your TestBanks and/or Student Test (.tst) files. This is because the formatting commands are different within HTML files in regards to font formatting. Therefore, any special font colors, bolding, underlining, symbols and sizes that you may have used will not be used when the HTML file is created. The HTML file will use a base font name and a single font color. Any underlining, bolding or special font symbols will not be used within the HTML file. If these font attributes are important, then you will need to edit the HTML file yourself once created. However, uppercase lettering (if any) will be retained. In addition, only embedded or linked images will be used for Internet (Web/HTML) tests. If you Inserted images directly into test questions or answer choices, they will not be carried over into your new HTML files. Only image files which have been used via the Embedded or Linked methods will be carried over to your HTML files. Therefore, if you intend to create Internet (Web/HTML) tests, you should not use the INSERT IMAGE option from the EDIT or pop-up (right-click) menus. If you are creating an Internet Web(HTML) test in Standard mode, you should verify that the e-mail address used is the correct address you wish student test answers to be sent to. To do this select the TESTS button from the OPTIONS window. Verify the e-mail address in the INSTRUCTORS EMAIL ADDRESS edit box and make any corrections to it necessary. This is the e-mail address which will be encoded into any new Standard test HTML file. Practice Web test student answers are not e-mailed and therefore this e-mail address will have no effect. Re-administering tests will retain all the original settings in which the test was created with such as Test Title, Passing Score value and Time Limit imposed (if any). If you do not wish to include these settings but retain the test items themselves, you may modify these settings from the CHANGE CREATED TEST VALUES option from the TESTS menu item. Changing any of the test setting values will modify them within the test (TST) file itself. Only test titles are used for Web tests. http://www.hirtlesoftware.com
97
Hirtle Software
Reviewing Completed Tests

Recalling a test is not the same as administering screen tests to students. Its purpose is to view tests which was already created (built) and administered to a student. Typically used by an instructor to view completed student tests and answer selections. Therefore, the REVIEW COMPLETED TEST option from the RECALL SCREEN TEST option in the TESTS menu will not regard you as a student taking the test. You are able to view student answer selections using a color code system to display the actual answers Vs student selections. If you plan on administering the exact same test (.tst) file to multiple students as screen tests, you must review the test (.tst) file between each students test since each time the same test file is administered, all the previous students answer selections will be erased in order to record the new students answer selections. Each new student who use the exact same test (.tst) file will overwrite any previous students test answers choices. Only a students overall grade is retained within the test (.tst) file and not their specific answer selections when a new student uses the same test (.tst) file. If you wish to provide multiple students the exact same test (.tst) file but permanently retain each students answer selections, the fastest method is to create multiple copies of the same test (.tst) file using Windows Explorer and change the file name for each as appropriate. Then provide each student their own file making sure that no two students use the same test file. This will ensure that the test is exactly the same and will allow each students answer selections to be retained since only one student will use each file. Follow these steps to review a completed screen test: Select the REVIEW COMPLETED TEST option from the RECALL SCREEN TEST selection located in the TESTS menu.
Select the test (.TST) file which you wish to recall. Any test file whether originally created as a paper, screen or WEB test will be acceptable. However, only screen tests administered to students can record student answer selections.
Select the OPEN button.
98
Hirtle Software
The REVIEW COMPLETED TEST window will recall the selected test (.TST) file and compare the actual answers against the answers the student selected. Each test item uses a color code system which indicates actual and student answers as well as matching answers. A color legend is provided to assist you in interpreting this information. You are unable to perform any test editing in this display.
Example of the REVIEW COMPLETED TEST display.
Color Code Legend

Student Answer displayed test item. Correct Answer Match
This is the answer choice item in which the student selected for the current This is the actual correct answer for the current displayed test item. This item is both the true correct answer and the student has selected it as well for the current displayed test item.
This software allows multiple correct answers and allows students to select multiple answers for multiple choice/true-false test items. Therefore, if you provide multiple true correct answers for a given test item, students would be required to have selected every correct answer for the test item to be considered correctly answered when automatically graded. These color codes only apply to the individual answer choice. When only the green (Match) color is displayed and no other answer choice displays blue (Student Answer) and/or yellow (Correct Answer), then the entire test item has been answered correctly by the student. When the blue or yellow color codes display they indicate that the student has not selected the correct answer choice(s) for the current test item. The blue color code specifically identifies what answer choice(s) the student has select. The green color code identifies the answer choice(s) the student has selected and that it is also the true correct answer choice(s). When students have been assigned a screen test in Practice test mode, they are automatically taken to this review screen test display. Since Practice tests are used for self assessment, they have the ability to review their answer selections and compare them against the true correct answers immediately after they have completed their screen test. Screen tests in Standard test mode will not allow students to review their tests.
99
Hirtle Software
Chapter 5 Grading Tests

The GRADE TEST option allows you to automatically have a completed student multiple-choice/true-false screen test graded. This function compares the actual answer(s) identified when test items were created against which answer(s) the student selected while taking the test. There are two options to choose from to grade a student screen test; DISPLAY GRADE RESULT and CREATE GRADE REPORT. The DISPLAY GRADE RESULT will simply be displayed on the computer screen while the CREATE GRADE REPORT will display as a printable form. Here are the steps to grade a completed student screen test: Select either the DISPLAY GRADE RESULT or CREATE GRADE REPORT item from the GRADE TEST option located in the TESTS menu.
100
Hirtle Software
Select the student's screen test (.TST) file which you wish to grade using the file dialog window.
Depending on which grade option you have selected is how the result will be displayed to you. The CREATE GRADE REPORT option provides a more detailed review of how each test item fared by displaying the student answer selection to the actual correct answer for each test item in the test (.TST) file and is setup for printing. Here are examples of the DISPLAY GRADE RESULT and CREATE GRADE REPORT displays:
DISPLAY GRADE RESULT screen
CREATE GRADE REPORT screen
The GRADE TEST function allows up to four different grading methods to be applied to student tests. Each grading method has its own advantages and disadvantages. However, in some circumstances one method may be better over another depending on the goal of your test. The grading method used is dependant upon which method is selected from the OPTIONS window in the TOOLS menu at the time the student concludes their test. Therefore, make sure the desired grading method is selected prior to administering a screen test to a student. Otherwise, whatever grading method is selected will be applied to the REVIEW TEST RESULTS history. The following are the available methods in which you may select to have students tests automatically graded by this software: Require 100% Multiple-Choice Match Method Typically the most common grading method. Students Must match every correct answer or the entire test item will be incorrect. Each test item (question) counts as one regardless of how many answer choices are actually correct. This method is a simple percentage of correct Vs. Incorrect. No direct penalties are applied to incorrect student answers. This method is recommended for most multiple choice tests where a percentage is desired for a grade. EXAMPLE: 20 total test items, student correctly selects the correct answer(s) for 14 test items. Final grade: 70%. http://www.hirtlesoftware.com
101
Hirtle Software
Available Choices Vs Student Picks Method - All answer choices available will count as one. Student correct choices will also count as one. No direct penalties are applied to incorrect students answers. This method is recommended for most multiple choice tests where more than one answer is correct. EXAMPLE: 20 total test items (questions) each with five answer choices totaling 100 possible answers. Student correctly selects 60 correct answers. Final grade: 60. Incorrect Answer Penalty Method - Factors in a penalty for incorrect student answer selections. This method is recommended when discouraging student guessing is desired. EXAMPLE: 20 total test items (questions) each with five answer choices totaling 100 possible answers. Student correctly selects 60 correct answers. Final grade: 20 (60 correct - 40 incorrect). Manually Assigned Point Values Method This grading method will exclusively use the manual point values that you have been assigned from the TestBank editing window. Each test item answer choice may be assigned a point value if selected by a student while being administered a test. The point values are completely assigned by you. They may be positive or negative (subtracted) values. The automatic GRADE TEST function is designed for multiple choice/true-false questions only. Fill-in-theblank and essay test items will not be graded regardless of grading method selected. If your test has a mixture of multiple choice and fill-in/essay answers, then these fill-in/essay answers will be ignored and will not factor into the final grade in any way. The fill-in/essay test items will not factor into the total questions as well. Therefore using a percentage grading method will only consider correct Vs. incorrect multiple choice/true-false question types when a final grade is determined. You must manually grade fill-in/essay questions and factor them into your overall grade if you wish to use the GRADE TEST function which includes fill-in/essay test items. The GRADE TEST option will list the number of questions correct and number of questions incorrect will be listed along with the final score value. If a passing score value was provided when the test was created, this value will display along with a "Passed" or "Failed" label as appropriate to the students final score. It is very important that every question you create have an identified correct answer with it. If any are left blank, then no correct answer has been identified and the test item will be considered incorrectly answered by the GRADE TEST function regardless of what answer choice students have selected for those test items. In order to automatically grade tests correctly, the correct answers must be identified in all your test items. To identify the correct answer for a test item while entering questions in TestBanks, select the answer choice button (A, B, C, D or E) which correctly answers the question. The CORRECT ANSWER label will show the letter that you selected and will be stored in the TestBank file. In addition, if a correct answer is supplied the background color for that answer choice will change to yellow. Students who are administered screen tests will have their answer selections automatically recorded (in the background) in the appropriate TestBank for each QID in which they answer. These selections may be reviewed using the TEST ITEAM ANALYSIS option from the STATISTICS menu. The GRADE TEST feature will not add or modify this automatic recording. Therefore, it is not necessary to use the GRADE TEST option for the TEST ITEM ANALYSIS tool to record student answers, this recording of student answer selections is automatic when students select their answer choices when administered screen tests. The automatic Grade Test function simply compares student's answers against the true correct answers in which the TestBank creator assigned them as. Therefore, if the creator identified the wrong correct answer, then even if the student's answer was truly correct, it will still be considered incorrect. In addition, if the creator did not identify any correct answer at all, then any student answer will be considered incorrect. Great care should be used when new questions are added or edited in TestBanks to ensure the true correct answer is identified. Automatic grading and printed answer keys are completely dependent upon the creator's correct answer decision. If a passing score was provided by the creator when the test was developed, this passing score will appear on the automatic grading function. If the automatic grade is less than the passing score value then a 'Failed' label will display. To adjust the passing score value select the CHANGE CREATED TEST VALUES option from the TESTS menu item. http://www.hirtlesoftware.com
102
Hirtle Software
In addition to printing, GRADE REPORTS may be saved as Rich Text files (.RTF). This file type may be used directly with most word processing applications such as MS-Word. Your grade reports will be saved with the exact same formatting as you see, including any images, font names, colors and sizes. Therefore, saving your grade reports as .RTF files is an ideal way to maintain electronic copies of your reports. To save your GRADE REPORTS as .RTF files, follow these steps: Make sure the GRADE REPORT you wish to save is the active window by clicking on it once. Select the SAVE AS option from the FILE menu
Type-in the file name you wish to save it as and make sure that the SAVE AS TYPE list box below is RICH TEXT FILE (.RTF) and the directory location you wish to save your file into.
Select the SAVE button
You may open these .RTF files directly from your word processor or back into Random Test Generator-PRO any time by using the RICH TEXT FILE (.RTF) option from the FILE menu. The SEND TO MS-WORD button on your printable form will send the contents of your report to a new MS-Word (if installed) document. This allows you to bypass the saving as an .RTF file if you desire. Therefore, no file is saved unless you do so either in Random Test Generator-PRO or in MS-Word. You may also save your GRADE REPORTS as text (.TXT) files using the same steps above but select the SAVE AS TYPE list box to TEXT (.TXT) vice RICH TEXT FILES (.RTF). However, saving files as text will strip any font formatting from the report when saved. Therefore, you should consider this before deciding the file type to save as. Its important to understand that only screen tests may be automatically graded using this software. Internet/Web Practice tests are automatically graded from a web browser. Student answer selections are only kept within the web browser and cannot be recorded for test item analysis. In addition, Standard Internet/Web tests contain student answer selections via an e-mail message. This e-mail message cannot be automatically graded and student answer selections cannot be automatically recorded for Test Item Analysis. Instructors may grade these Standard Internet/Web tests manually by simply creating an answer key from the TESTS menu and comparing the student answer selections against the answer key. Test Item Analysis information may be manually updated for paper and Internet/Web tests using the TEST ITEM ANALYSIS EDITOR option from the STATISTICS menu. Please refer to the Test Item Analysis chapter later in this manual for details about this process. http://www.hirtlesoftware.com
103
Hirtle Software
Creating Test Answer Keys

Answer keys are automatically created and placed at the end of every printable test file. However, you may also manually create student test answer keys for any student test (.TST) file manually at any time. To create your own student test answer key follow these steps: Select the CREATE TEST ANSWER KEY option from the TESTS menu and choose either the TEXT FORMAT or BUBBLE FORMAT options as you wish.
Select the desired test (.tst) file from the dialog box.
Select the OPEN button. Press the Print Icon print your answer key. from the toolbar when ready to
Text answer keys simply display the answers to each test item as text while Bubble answer keys display test item answers as darkened-in circles. You may also create Bubble formatted Student Answer Sheets (from the TESTS menu) to allow students to use the darken-in circle methods of providing test answers to you. Examples of both answer key designs are shown below:
Text Answer Key form
Bubble Answer Key form
104
Hirtle Software
Every printed test as well as answer keys will print a Test Identification (Test ID) number. This number will stay constant for the same test (.TST) file. Therefore, no matter how often or many times you use the same test file, the same Test ID number will print. Matching-up student tests and answer keys are easily done simply by matching the student test with the answer key Test ID numbers. If they match, the answer key is the correct one for that test. When using the DUPLICATE & SCRAMBLE button with printable paper tests, every duplicate test and answer key created from the same Test (.TST) file (Test ID) will be provided a REV (Revision) number to the Test ID in order to distinguish themselves from each other. Therefore, you should match-up the Test ID and its REV number in these circumstances for tests and answer keys. You should use the answer key which automatically generates at the end of paper tests when using the DUPLICATE & SCRAMBLE button as you will not be able to manually create answer keys for revised (REV) tests. Creating answer keys from test (.TST) files at a later date will only create the original answer key for that test, not REV answer keys. By default text answer keys are automatically created at the end of your paper tests. Bubble answer keys may only be manually selected from the TESTS menu. Therefore, only Text not Bubble answer keys are used when the DUPLICATE & SCRAMBLE button is selected. Currently you are not able to create Bubble answer keys for REV tests. Please note that Answer keys are based on the order which is selected from the TESTS button in the OPTIONS window from the TOOLS menu item. At the bottom of this window, the options to ORDER STUDENT TESTS BY QID NUMBER and ORDER STUDENT TESTS RANDOMLY are available. These options not only allow you to format the order that test items are placed within tests, but will also follow the same order for answer keys. Therefore, if you create a test using one choice you Must use the same format when creating an answer key at a later date. Otherwise, your answer key may not match the order of the test items. This is very important to understand. Even though they will both display question numbers in what seems the right order because they flow sequentially, they will not be correct because the question number is unrelated to the order of the test items. This is why it is best to use the same answer key which is automatically created at the end of all printed tests, rather than to manually create an answer key at a later date. If you create answer keys manually please verify that you are using the same test ordering format as the original test was created in to avoid test/answer key mismatches. If you intend to use your own manually assigned point values for grading and wish these point values you have assigned to be printed along with your answer keys, you may do so by selecting the PRINT MANUALLY ASSIGNED POINT VALUES IN ANSWER KEYS checkbox from the GRADING area of the OPTIONS window. This will then print the point values assigned for every test item answer choice along with the true correct answers In addition, ANSWER KEYS may also be saved as Rich Text files (.RTF). This file type may be used directly with most word processing applications such as MS-Word. Your test files will be saved with the exact same formatting as you see, including images, font names, colors and sizes. Therefore, saving your paper test files as .RTF is an ideal way to maintain tests which you wish to administer over and over again. To save your ANSWER KEYS as .RTF files, follow these steps: Make sure the ANSWER KEY you wish to save is the active window by clicking on it once.
105
Hirtle Software
Select the SAVE AS option from the FILE menu
You may open these files directly from your word processor or open them back into Random Test GeneratorPRO any time by using the RICH TEXT FORMAT (.RTF) option from the OPEN option of the FILE menu. The SEND TO MS-WORD button on your printable forms will make a copy of the current active form and send its contented to MS-Word (if installed). This bypasses the saving as an RTF file. Therefore, no file is saved unless you do so either in Random Test Generator-PRO or in MS-Word. You may also save your ANSWER KEYS as text (.TXT) files using the same steps above but select the SAVE AS TYPE list box to TEXT (.TXT) vice RICH TEXT FILES (.RTF). However, saving files as text will strip any font formatting from the report when saved. Do NOT save Bubble answer keys as Text (.txt) files. This is because the circled letters which display in Bubble answer keys are images and cannot be saved into text files.
106
Hirtle Software
Using the Passing Score Setting

The PASSING SCORE setting is used with the GRADE TEST utility. When a passing score value is provided, this value is retained in the test (.TST) file when the GRADE TEST feature is activated. Passing score values are initially set from the TEST BUILDER option from the TESTS menu item when tests are created. Simply use the vertical scroll bar to identify the value at which the test will be successfully passed in percent. This is an option and not required. However, it is used when screen tests are automatically graded to assess a Pass or Fail grade. After a test (.TST) file has been created the passing score value may be changed from the CHANGE CREATED TEST VALUES option from the TESTS menu item. Follow these steps to change the passing score value in a student test (.TST) file: Select the CHANGE CREATED TEST VALUES function from the TESTS menu.
Select the test (.TST) file you wish its values to be changed. Then select the OPEN button.
Modify the PASSING SCORE value in the CHANGE TEST SETTINGS window to the value you wish.
Select the ACCEPT button when you are completed. http://www.hirtlesoftware.com
107
Hirtle Software
When the GRADE TEST option is used, this passing score value will be displayed under the actual score the student received. If the student received the same score or greater, you will see a flashing PASSED label appear near the bottom of the display. If the test score received is lower than the passing score value then a flashing FAILED label will appear. In addition, the PASSING SCORE value is stored in the REVIEW TEST RESULTS option from the RECALL SCREEN TEST option from the TESTS menu item for each student who is administered a screen test. The GRADE TEST and PASSING SCORE functions are based on the GRADING METHOD selected. The GRADE TEST function allows up to four different grading methods to be applied to student tests. Each grading method has its own advantages and disadvantages. However, in some circumstances one method may be better over another depending on the goal of your test. The automatic GRADE TEST function is designed for multiple choice/true-false test items only. Fill-in-theblank and essay questions will not be graded regardless of grading method selected. If your test has a mixture of multiple choice and written answers, then the written answers (fill-in/essay) will be ignored and will not factor into the final grade in any way. The written answer questions will not factor into the total questions as well. Therefore using a percentage grading method will only consider correct Vs. incorrect multiple choice/true-false question types when a final grade is determined. You must manually grade fillin/essay questions and factor them into your overall grade if you wish to use the GRADE TEST function which includes written answers.
108
Hirtle Software
Chapter 6 Reports and Analysis

Assessing a students performance against other students is very often a good method to judge the validity of your tests. Moreover, assessing individual test questions within tests is vital to assure that your test items are sound. Random Test Generator-PRO automates this process thereby allowing you to make these assessments based on these performance results. This software records student test results by name and overall performance for all screen tests administered automatically. In addition, every student answer selection (screen tests) is also automatically recorded to not only identify if students select correct or incorrect answers, but specifically which answer choices they actually chose for every multiple-choice and/ true/false test item in your TestBanks. Therefore, you are able to easily see which answer choices they are selecting more than others. This information will help you assess such things as whether your answer choices are invalid, possibly that more than one correct answers exist in a test item, possibly that the test item was not discussed in class, or lectured incorrectly in class or that the test item is incorrect or badly worded. These Test items can be flagged to alert you that students are selecting the incorrect answer at a high rate. Random Test Generator-PRO provides three options to help you view overall test scores for each student, perform test item analysis for any TestBank, and manually add test data to your TestBanks when you administer paper and/or Web Internet tests. This chapter will discuss these options to help your test and test item assessments.
109
Hirtle Software
Grade Report
Random Test Generator-PRO comes with two types of built-in grade reports; Comprehensive and Incorrectly Answered. The Comprehensive Grade Report lists each test item within the test and provides both the true correct answer and the student selected answer regardless of whether the student selected the correct answer. The Incorrectly Answered Report list only those test items in which the student incorrectly answered. Therefore, depending on what type of information you wish to gather on a given test is which grade report you should select. These grade reports only analyze the last student which was administered a given test file (.tst). Therefore, if you wish to use the exact same test file you should create these reports after each student completes their test. Otherwise, all the previous answer selection data will be lost when a new student is administered the exact same test file. A good method to present the exact same test to multiple students is to make copies of the test (.tst) file for each student. Therefore, you can present the exact same test to multiple students but provide each student their own test (.tst) file. In this way no data will be lost since the file will be only used for a single student. Within the TEST BUILDER you may create multiple test files when creating tests as well. The difference is that when you select to make multiple tests within the TEST BUILDER, each test (.tst) file created will be unique. In this case each student will have their own test (.tst) file but also a randomly selected unique test. By copying a single test (.tst) file in Windows, you are making an exact copy thereby presenting multiple students the exact same test. The choice of course is yours depending if you wish the students to have different tests or the exact same one. To create either a Comprehensive or Incorrectly Answered report follow these steps:
Comprehensive Report
Select COMPREHENSIVE from the GRADE REPORT menu selection within the REPORTS menu item.
Select the student test (.TST) file you wish to receive the report on. Then select the OPEN button.
Incorrectly Answered Report

Select INCORRECTLY ANSWERED from the GRADE REPORT menu selection within the REPORTS menu item.
Select the student test (.TST) file you wish to receive the report on. Then select the OPEN button.
110
Hirtle Software
Test Performance Analysis

When students are administered the same screen test (.tst) file, their names and overall scores are maintained within these test files as well. Therefore, a historical record is maintained for every student who is administered screen tests. Screen tests are automatically graded in the background when students complete them and recorded inside the test file. This process is transparent to everyone. You are not bound by these test results and may ignore them if you desire. However, if you wish to use this process and view student test results, you may do so quickly and easily. You should understand that student test scores are graded based on the grading method selected from the GRADING button from the OPTIONS window from the TOOLS menu. Therefore, you have four grading choices (methods) available as fully explained in the previous chapter. You should make sure that the appropriate grading method in which you wish to use is selected prior to administering tests to students. Otherwise, a grade result will be recorded in test files for an unintentional grading method. These methods vary greatly. You should not mix grading methods between students using the same test (.TST) files as this will drastically display final scores which are unrelated to each other, then it will average these scores together, causing an apples and oranges overall test performance result. You may view or create Test Performance Reports suitable for printing. To view or create a Test Performance Report for any test file follow these steps: Select DISPLAY TEST PERFORMANCE RESULT or CREATE TEST PERFORMANCE REPORT from the TEST PERFORMANCE option located in the TESTS menu.
Select the student test (.TST) file you wish to receive the performance result/report on. Then select the OPEN button.
View the performance result or report. If report, you may then print it if desired. You may also send your report to MSWord (if installed).
111
Hirtle Software
Example of Test Performance Result Display
Example of Test Performance Report
In addition, TEST PERFORMANCE REPORTS may also be saved as Rich Text files (.RTF). This file type may be used directly with most word processing applications such as MS-Word. Your test files will be saved with the exact same formatting as you see, including font names, colors and sizes. Therefore, saving your TEST PERFORMANCE REPORTS as .RTF files is an ideal way to maintain these reports in electronic format. To save your TEST PERFORMANCE REPORTS as .RTF files, follow these steps: Make sure the TEST PERFORMANCE REPORT you wish to save is the active window by clicking on it once. Select the SAVE AS option from the FILE menu.
Select the SAVE button.
You may open these files directly from your word processor or open them back into Random Test GeneratorPRO any time by using the RICH TEXT FORMAT (.RTF) option from the OPEN option of the FILE menu. The SEND TO MS-WORD button on your printable forms will make a copy of the current active form and send its contents to MS-Word (if installed). This bypasses the saving as an .RTF file. Therefore, no file is saved unless you do so either in Random Test Generator-PRO or in MS-Word. You may also save your TEST PERFORMANCE REPORTS as text (.TXT) files using the same steps above but select the SAVE AS TYPE list box to TEXT (.TXT) vice RICH TEXT FILES (.RTF). However, saving files as text will strip any font formatting from the report when saved. Therefore, you should consider this before deciding the .TXT file type to save as. http://www.hirtlesoftware.com
112
Hirtle Software
Test Item Analysis

A good test question involves good answer choices besides the question itself. Often a great question can be marred by bad choices. Sometimes two answer choices may have a similar meaning leaving the student perplexed as which to choose, while strict grading only permits the designated answer choice as the only correct answer. Test Item analysis is designed to assist instructors to identify bad or potential bad test question and/or their associated answer choices. Random Test Generator-PRO keeps track of every screen test taken on the computer, as students select their answer choices per question, their selections are immediately recorded within the original TestBank (not student test (.tst) file). Each test item created will automatically record student selections when they are used within a student test administered on the computer. This analysis tool will flag bad test items by keeping track not only when students select correct/incorrect answers but exactly which answer choices they are choosing (correct or not). In this way you can plainly see which answers choices students are selecting. This provides a wealth of information to assess the validity of the test items as related to its answer choices. Prior to selecting reports for your TestBanks, you should have administered screen tests to students which have included your TestBanks. This is necessary in order to record student answer selections. Every student selection will be recorded if the test was administered on the computer (screen test). The original TestBank file will maintain a history of student selections for each test item included. Only test items selected by the randomizer which students have answered will have analysis data to review. The information supplied in this report is based on every student who was administered a screen test involving test items from the selected TestBank. To create a Test Item Analysis Report for a TestBank follow these steps: Select TEST ITEM ANALYSIS from the REPORTS menu.
Select the TestBank .MDB file (not student .TST test file) you wish to receive the Test Item Analysis Report on.
113
Hirtle Software
Example of TEST ITEM ANALYSIS REPORT Text
Example of TEST ITEM ANALYSIS REPORT Graph
Since the test item analysis data is based on QID numbers, you can see why it is very important to use QID numbers which are not duplicated within a TestBank or even between TestBanks. The QID number should be your own number which acts similar to a serial number. This will allow you to easily locate test items in your TestBanks. Duplicating QID numbers will make it much more difficult to locate the specific test items.
114
Hirtle Software
Test Item Analysis reports display in a printable form based on test item QID numbers. The first information displayed is the overall values of the TestBank including the totals of correct Vs. Incorrect and overall answer correct percentage. Below will be a text chart showing every QID test item within the TestBank and student performances against them. Finally, you will observe bar or line graphs based on the text information above. The text and graph information will increment every 20 test items in order to be easily readable. Only multiple-choice and true/false questions types will record test item analysis data. However, QIDs will still be displayed for fill-in/essay questions. However, no student answer information will be displayed for these question types and they will not factor into individual and overall test values. You can control whether or not to display graphs in your TEST ITEM ANALYSIS REPORTS and whether they will be bar or line graphs from the ANALYSIS button in the OPTIONS window from the TOOLS menu.
In addition, instructors may update this information manually for students who have been administered paper or Web (HTML) tests using the TEST ITEM ANALYSIS EDITOR from the STATISTICS menu. Although, it is optional to manually update Test Item Analysis data for paper and Web (HTML) tests, it is highly recommended in order to obtain the most accurate picture of how your individual test item are performing. You may also edit the report information itself, but any editing to the report will not be updated with the TestBank if it involves student data. Therefore, if you wish to edit student data, you should only do so through the TEST ITEM ANALYSIS EDITOR from the STATISTICS menu and re-create your report. Otherwise you changes will not be permanent. Editing TestBank student selection data will be further discussed in the following topic in this chapter.
Understanding the Text Area of the Report

The text area of this report displays all the numeric information about student selections as well as showing you what is the actual correct answer to each question along with the total number of correct answer selections Vs the total number of times an incorrect answer was selected. Below is an example of a text display of a Test Item Analysis Report for a TestBank with two questions in it. QID 875 880 TOTALS: ANS. C D COR. 122 67 INCOR. 34 58 PCT 78.21 53.60 67.26 A 7 6 B 9 43 C 122 4 D 11 67 E 7 5
115
Hirtle Software
Understand the Displayed Graphs?

A typical Report may display a bar or a line graph (if desired) of each test item identified by its QID number contained within the selected TestBank. Each graph point represents the percentage of the time students have selected the correct answer for the associated QID number from 0% to 100%. It will reflect the same figure as in the text area for the same QID number for its PCT value. Therefore, you may or may not wish to keep these graphs. To permanently change your graph settings, select the ANALYSIS button in the OPTIONS window from the TOOLS menu.
Interpreting Test Item Analysis Information

Many training institutions have testing guidelines to judge their test items against. For instance, a common rule used is to throw out test items which at a minimum 50% of the time students answer them incorrectly, because they are too hard. In addition, throw out test items if more than 90% of the time they are answered correctly, because they are too easy. These are just a couple examples of how analysis is often performed on test items. However, This software goes beyond those simple rules by providing you exactly which answer choices students are in fact selecting, not just if they are selected correctly or not. In the Text Chart above, you will notice that QID 875 seems to be a reasonable test item. The correct answer is by far the students choice while the test items incorrect choices do not display a discernible pattern. On the other hand QID 880 clearly draws students to incorrect answer choice B. This test item definitely needs evaluating. The question may be badly worded or answer choice B may be correct as well as true identified correct answer choice D This is valuable information. Instead of throwing questions out solely based on a correct Vs incorrect percentage, you are able to understand which choices students feel are the correct answer(s). This may tell you many things. Among them: Is the answer choice confusing? Did the instructor correctly disseminate the information? Was the information even taught? Is the incorrect answer choice too close to the correct answer? Is the question badly worded? Are all the answer choices incorrect? For example, if 90% of the students select an incorrect answer in one class while the same question never displayed any problems in previous classes, you could wonder if the information was actually taught to the students or taught correctly. If students seem to select incorrect answer choice B for a particular test item, you could ask yourself if this answer choice is too similar to the true identified correct answer choice. Or that maybe the true answer to this test item was stated incorrectly by the instructor. These are just some of the ways Test Item Analysis can be performed and judged. However, you will have to perform your own assessments as to their meanings as pertained to your own test items. There can be many reasons why students select incorrect answers to questions. The real goal of this tool is to alert you when test items have unbalanced answer selections. Understanding why students are selecting incorrect answer choices to test items is like a leaky roof, the location of where the water is dripping is not necessarily where the hole is in the roof itself. Therefore, students who seem to continuously select an incorrect answer choice for a particular test item, does not necessarily mean that the answer choice is bad, it could mean the question is bad or the information was taught incorrectly, not at all, etc. However, in any case this test item analysis information is a valuable tool to warn you when potential problems exists with your test items and provide you a much quicker way to diagnose test item deficiencies. http://www.hirtlesoftware.com
116
Hirtle Software
In addition, TEST ITEM ANALYSIS REPORTS may also be saved as Rich Text files (.RTF). This file type may be used directly with most word processing applications such as MS-Word. Your test files will be saved with the exact same formatting as you see, including images, font names, colors and sizes. Therefore, saving your paper test files as .RTF is an ideal way to maintain tests which you wish to administer over and over again. To save your TEST ITEM ANALYSIS REPORTS as .RTF files, follow these steps: Make sure the TEST ITEM ANALYSIS REPORTS you wish to save is the active window by clicking on it once. Select the SAVE AS option from the FILE menu
Type-in the file name you wish to save it as and make sure that the SAVE AS TYPE list box below is RICH TEXT FILE (.RTF) and the directory location you wish to save your test file into
You may open these files directly from your word processor or open them back into Random Test GeneratorPRO any time by using the RICH TEXT FORMAT (.RTF) option from the OPEN option of the FILE menu. The SEND TO MS-WORD button on your printable forms will make a copy of the current active form and send its contented to MS-Word (if installed). This bypasses the saving as an RTF file. Therefore, no file is saved unless you do so either in Random Test Generator-PRO or in MS-Word. You may also save your TEST ITEM ANALYSIS REPORTS as text (.TXT) files using the same steps above but select the SAVE AS TYPE list box to TEXT (.TXT) vice RICH TEXT FILES (.RTF). However, saving files as text will strip any images (graphs) and font formatting from the report. Therefore, you should consider this before deciding to save as text (.TXT) files. It is vitally important to understand that test item analysis information is stored in TestBanks (.mdb) NOT student test (.tst) files. When students are administered screen tests their answer selections are also being recorded back to the original TestBank files used to build the tests from. The folder locations of these TestBanks are stored when student tests are being built from the TEST BUILDER. If you subsequently move the location of these TestBank files after the student test (.tst) files are built, there is no way to know the new location based on the previously created test files. Thus, test item analysis information will not automatically be recorded for those student tests. Therefore, it is best to find a permanent folder location(s) of all your TestBank files before building any student tests. If you do need to move the TestBank file locations, then it is best to create new student test (.tst) files after the TestBanks have been moved to be assured that student answer selections will find their way back to these TestBanks for analysis. http://www.hirtlesoftware.com
117
Hirtle Software
Test Item Analysis Editor

Since paper and Web tests have no way to record student answer selections automatically for test item analysis, Random Test Generator-PRO provides a manual method to input student paper and Web test data. Every multiple-choice/true-false test item created in any TestBank has test item analysis capability. The key to manually inputting student answer selections into the Test Item Analysis Editor is knowing which TestBank(s) the items where obtained from. The easiest way is to record the starting and ending QID numbers for each TestBank. Then locate your TestBank by the test item QID number. QID numbers are the method to locate and input student answer selections into the editor. Again, it is always best to have every test item have its own unique QID number. To use the editor follow these steps: Select TEST ITEM ANALYSIS EDITOR from the STATISTICS menu.
Select the TestBank .MDB file (not student .TST test file) you wish to edit student answer selections for.
Select the OPEN button. Correct Vs. Incorrect for QID only
Number of times students have selected each answer choice
Correct Vs. Incorrect for entire TestBank
Example of TEST ITEM ANALYSIS Editor
The Editor form will display the QID number, test question, answer choices, reference and correct answer to the left of the form. The right side will contain the analysis data in numeric format. You will see a display for total correct, total incorrect, totals for Items A through E (if available). At the bottom of the form is the navigation bar similar to the navigation method used for TestBanks and student tests. http://www.hirtlesoftware.com
118
Hirtle Software
Simply click the VCR type buttons in the direction you wish to go, or select the GO TO button to go directly to a specific QID number. When you find a QID number which you wish to edit, simply add one digit to the displayed number for correct or incorrect (depending if the student answered the test item correctly or incorrectly) as well as which answer choice(s) the student selected for this test item. Using the example above, if the test item was answered incorrectly and the student selected answer choice B, then whatever number resides in the TOTAL INCORRECT field (currently 3), TOTAL ITEM B field (currently 4) and TOTAL INCORRECT TESTBANK NAME field (currently 1500) should be one number higher. Therefore, in this example, you should change the TOTAL INCORRECT field to 4, TOTAL ITEM B field to 5. The TOTAL INCORRECT TESTBANK NAME field will automatically change to 1501 and The Percentages fields will automatically calculate the new percentage upon the next update. You can obtain an update to all the statistics for the TestBank by selecting the UPDATE STATS button. Also, by moving to another test item and then coming back to the current item, the statistics for the test item will automatically update. If the student correctly answered this test item, you would modify the TOTAL CORRECT fields higher one digit. You may find it easiest to modify the same QID number for more than one student rather than continuing with the same student to edit the analysis data prior to moving to the next student. Your Test Item Analysis edits will be permanently saved once you change the field contents. Therefore, please make sure you are certain about your changes prior to editing. The automatic recording for screen tests will simply use your edits to add one digit higher when it encounters student selections for QID numbers which you have edited. Therefore, it is a continuous flow between manual and automatic editing.
Test Item Graph

On the right-hand side of each test item you will see a graph. This graph represents how the individual test item is performing. The top green bar represents the test items overall accuracy rate. In this example, 50% of the time it was correctly answered. The second bar (yellow) represents the TestBanks overall accuracy rate. In this example 66.7% an item from this TestBank was answered correctly. The remaining bars represent each answer choice letter for the individual test item and how often in percentages that each answer choice was selected. In this example 50% of the time answer choice A was selected as well as 50% of the time answer choice B was selected by students. Answer choice C has never been selected by a student. The blue color represents the actual true correct answer to the test item. The white bars represent incorrect answer choices.
Example of TEST ITEM ANALYSIS Graph
Resetting Counters
Test Item Analysis keeps track of individual test items and entire TestBanks performances by counting each answer selection chosen by students. These statistics are used to identify valid as well as invalid test items. Since test items are easily updated or even completely re-written, you may wish the statistics to start over for these items to reflect an accurate count for modified test items. In some cases you may want to reset an entire TestBanks counter. To reset counters for test items or TestBanks follow these steps: http://www.hirtlesoftware.com
119
Hirtle Software
Select the TEST ITEM ANALYSIS EDITOR function from the STATISTICS menu item.
Select the TestBank (.MDB) file which you wish to reset its counter.
Select the OPEN button. To reset the counter for a specific test item (QID), move to the test item and then select the RESET QID X TO ZERO button. (X is the actual QID number). Your test item will immediately reset all counts to zero. To reset the entire TestBank, select the RESET ALL COUNTS TO ZERO button. Then select the YES button when prompted. Every count in your TestBank will immediately be reset to zero.
Please be careful that you select the individual test item prior to the selecting the RESET QID X TO ZERO button, otherwise whatever QID is displayed will be reset. Please verify the test item to reset by its QID number. Once any reset has taken place, there is no way to recover the data. Therefore, caution is advised prior to resetting test items or TestBank counts. The FIND INVALID TEST ITEMS button on the TEST ITEM ANALYSIS EDITOR when selected will search through your TestBank and search for any Test Item which does not meet the minimum TEST ITEM VALIDY PCT and stop on any test item it finds that has a student answer response below this level. You may then review the test item in question or move to the next test item which has a low student correct answer percentage by selecting the NO button on the message box. To verify that no test items in your TestBank has a low student correct answer response, you should run the FIND INVALID TEST ITEMS option until it searches through your entire TestBank without alerting you about a low student response.
120
Hirtle Software
The TEST ITEM VALIDY PCT value is set from the GENERAL button in the OPTIONS window from the TOOLS menu. You may set the threshold to any percentage between 0% and 100%. This value will then be used in the TestBank VALIDATE button within the TestBank edit window as well as the FIND INVALID TEST ITEMS button on the TEST ITEM ANALYSIS EDITOR window.
The UPDATE STATS button will re-compute the mathematics for each test item as well as the entire TestBank. If you may manually made changes to individual test item information, selecting the UPDATE STATS button will then re-tally the information and provide updated statistical data with your changes factored in.
121
Hirtle Software
Chapter 7 Accounts Administration

Random Test Generator-PRO allows you to setup Student and Instructor accounts to gain access to this software. Student account access only allows the student to take an assigned test. Students do not have any other access to this software. Instructor accounts allows individuals to have full access to this software once they login with their assigned login name and password. Those with Instructor accounts can assign tests to student accounts. When the assigned student then logs into the software using their login name and password, this software will then automatically administer the assigned test to the student. The goal of this functionality is allow instructors the ability to assign tests and students to take those tests without the instructor needing to monitor the student. Instructors may assign tests to any student account. However, only one test may be assigned per student account at a time. Test results are stored within the test (.tst) file itself which may then be reviewed by the instructor at a later date/time. Student and Instructor accounts may be created, modified and deleted at anytime. However, account access only takes effect when the REQUIRE LOGIN NAME AND PASSWORD AT START-UP checkbox is selected from the SECURITY area of the OPTIONS window has been selected. If this checkbox is not selected, then this software will not require login names and passwords to gain access thus allowing full http://www.hirtlesoftware.com
122
Hirtle Software
access whenever the software is started. However, when this checkbox is selected, it will then require everyone to login to gain access and begin enforcing exact login names and passwords for existing accounts or the Application's MASTER PASSWORD. The MASTER PASSWORD is at an Instructor level.
123
Hirtle Software
Administrating Applications Master Password

The Master Password is a general login which allows full access to the RTG-PRO software when the password feature is activated to require a user name login to access this software. This Master Password is unrelated to instructor/student login accounts. The master password is computer specific. That means in a network environment each individual computer may have its own Master Password. You may change them all to the same password, but you must set them individually for each computer. You may desire not to use the Master Password and opt to use specific Instructor/Student login accounts or even do not use the login feature all together. Here are the steps to create/modify the Applications Master Password:
Assigning a New Master Password

Select the OPTIONS function from the TOOLS menu.
Select the SECURITY button on the OPTIONS window.
Type-in the current password in the CURRENT PASSWORD field. The first time it is set to password. Therefore, initially you should type-in password in this field.
Type-in your new password in the NEW PASSWORD field.
124
Hirtle Software
Re-enter your new password in the RE-TYPE NEW PASSWORD field.
Select the REQUIRE LOGIN NAME AND PASSWORD AT START-UP checkbox. Note: This checkbox if selected will require either the Master Password or any existing Student/Instructor login name and password to gain access once the software is re-started or the LOGOUT option from the FILE menu is selected.
Deactivating Login Names and Passwords (If not already deactivated)

Here are the steps to deactivate login requirements when starting the software: Select the OPTIONS function from the TOOLS menu.
Select the SECURITY button on the OPTIONS window.
Deselect the REQUIRE LOGIN NAME AND PASSWORD AT START-UP checkbox.
125
Hirtle Software
The current Applications Master Password remains stored, even if login requirements are deactivated. The REQUIRE LOGIN NAME AND PASSWORD AT START-UP checkbox simply sets this software to require the logins before allowing access to the software or not. It has no effect on the current Applications Master Password. Therefore, activating this feature at a later date, without entering in a new password will require the same Master Password. You do not have to create a new password every time you select this checkbox. The PASSWORD HINT field is designed to assist you in case you have forgotten the MASTER PASSWORD. The idea is for you to enter a sentence about something which will trigger your memory of the identity of the MASTER PASSWORD, but not make it too obvious since everyone will be able to read it. Using this field is optional. When the login screen appears there will be a HINT button displayed which will display the hint sentence you have provided (if any). If you have not provided a password hint, then this HINT button will not be displayed. The first time the Applications Master Password feature is activated without a new password entered in it, the password to access the software is set to password (all lowercase letters). Once a new password is entered, this default password will no longer work. Please be careful to note all new passwords entered, since access to this software will only be allowed with the correct Master Password or a correct Student/Instructor login name and password if the REQUIRE LOGIN NAME AND PASSWORD AT START-UP option is selected. When the software login screen appears and you are using the Master Password to gain access, the LOGIN NAME field must be blank (empty). Otherwise, the Master Password will not work.
This softwares login name and password feature only applies to accessing this software. It does not apply to gaining access to the computers operating system or any other software product. An attempt is made by this software to prevent access to any other computer operation while the login screen is displayed. The TestBank (.MDB) and Test (.TST) files themselves are not password protected using this feature. For instance using MS-Access software will give anyone access to TestBanks and student test (.tst) files. This software does allow you to password protect individual TestBank and Test files in which even MS-Access will not be able to open them without the correct password supplied. Later in this manual we will discuss how to password protect your TestBank and student test files individually.
126
Hirtle Software
Administrating Student/Instructor Accounts

In the preceding topic we discussed the use of the Applications Master Password. This topic will present information about creating, modifying and deleting specific personal Student and Instructor Accounts. These accounts allow individuals the ability to login using their own login names and passwords. Student account access allows students to be automatically administered assigned tests only while Instructor level accounts provide for access to all features of this software, including assigning tests to student accounts. However, in order to use accounts they must be created first. You may also modify existing accounts and even delete accounts. Here are the steps to create, modify and delete personal Student and/or Instructor accounts:
Creating New Accounts

Select the ACCOUNTS option from the ADMINISTRATION menu.
Select the CREATE ACCOUNT button for either the INSTRUCTOR or STUDENT column as appropriate.
Complete all the fields in the New Account window. Create your own Login Name and Password you wish to assign for the new account. Then select the CREATE button. Note: Once created the new account will appear in the appropriate Account Administration window. This is your indication that it is an active account. You of course would then need to notify the individual that their account is active and provide them their Login Name and Password you have assigned to them.
127
Hirtle Software
Modifying Existing Accounts

Select (highlight) the account you wish to modify in the appropriate list-box and then select the MODIFY ACCOUNT button for either the INSTRUCTOR or STUDENT column as appropriate.
Complete the changes in the Modify Account window. Then select the MODIFY button. Note: The changes will take effect immediately. You of course would then need to notify the individual that their account is active and provide them their Login Name and Password if this information was modified.
Deleting Existing Accounts

128
Hirtle Software
Select (highlight) the account you wish to delete in the appropriate list-box and then select the DELETE ACCOUNT button for either the INSTRUCTOR or STUDENT column as appropriate.
Select the YES button to delete the account or the NO button to keep it active in the message box window. Note: Deletion will take effect immediately.
Both Student and Instructor account and test assignments (if any) information is stored to the ACCOUNTS.AZZ file which is installed into the same folder as Random Test Generator-PROs executable file. This file is necessary and should never be moved or deleted. In addition, the file name should never be changed. If you encounter any problems with this file you can use the REPAIR/COMPACT FILE option from the TOOLS menu to try to correct the problem. You may wish to backup this file on occasion as part of routine maintenance. The Applications Master Password information is not stored in this file.
129
Hirtle Software
Assigning Student Tests

Once Student accounts are set-up, you are then able to assign student screen tests to them. Tests assigned to student accounts will automatically be administered to them the very next time they login into the software using their account login name and password. Therefore, the REQUIRE LOGIN NAME AND PASSWORD AT START-UP checkbox must be selected from the SECURITY area of the OPTIONS window in order for the login process to take place. This automated test administration feature will only work if a student logs into the software using their login name and password and they have been assigned a test. If they login and there is not a test assigned to them, the software will tell them so and log them out to allow others to login. Instructor accounts have full capabilities of this software and they may also assign tests to student accounts. In order to assign student screen tests, these tests must first be created from the TEST BUILDER window. Once student tests have been created you may then assign them to specific student accounts. Here are the steps to assign or modify tests to student accounts:
Creating/Modifying Test Assignments

Select the TEST ASSIGNMENTS option from the ADMINISTRATION menu.
Select (highlight) the student account you wish to assign a test to from the list-box to the left of the Assignment window.
Press the SELECT button and choose the test (.tst) file you wish to assign to the selected student account.
Select whether you wish the test to be administered as a STANDARD or PRACTICE test to the student. Note: Tests assigned to student accounts will only be presented as Screen tests, either as Standard or Practice tests. You cannot assign Internet/Web or Paper tests to student accounts.
130
Hirtle Software
Optionally type-in a class identification number in the CLASS ID field.
Optionally type-in special test instructions which will be displayed to the student prior to the test starting in the INSTRUCTIONS TO STUDENT field. Note: All your selections are immediately saved. There is no Accept button. You can close the window or assign another test to a different student. The TEST RESULTS area below is automatically updated after the student has completed the assigned test.
Selecting the REMOVE ASSIGNMENT button will remove the current assigned test. If you wish to modify the current assigned test, there is no need to select the REMOVE ASSIGNMENT button first, you can simply re-select a different test file and it will replace the current one. If this Test Assignment window is open while you are also creating/modifying student accounts, those changes will not display in this Test Assignments window unless you close it, then re-open it or select the REFRESH button just below the student accounts list. Once an assigned student test has been completed by the student, the results will display in the TEST RESULTS AREA along with other information. The automatic grading system used to score the test is based on the test grading choice selected from the OPTIONS window. Whether a test is administered as STANDARD or PRACTICE, all test scores are recorded directly in the test (.tst) file itself. Therefore, you may also review these test scores from the DISPLAY/CREATE TEST PERFORMANCE RESULT option in the TESTS menu. Completed tests are automatically graded based on the grading method selected from the OPTIONS menu. Test start and stop times are recorded for all assigned tests. You are able to review this information in the TEST RESULTS AREA of this window as well as the total minutes the student took to take the test. This information is recorded whether there is a time limit imposed on tests or not. This information can assist you in a variety of ways such as to understand the length of time it takes students to complete your tests and whether specific students are rushing through their tests. In addition, the Activity Log records login and logout times of everyone who gains access to this software while the REQUIRE LOGIN NAME AND PASSWORD AT START-UP checkbox is selected from the SECURITY area of the OPTIONS window. This could also assist you. There are three status indicators available in which you will see below the SCREEN TEST ASSIGNMENT field, here are their meanings: No Assignment - This means there is no current test assignment assigned to the selected student account. Either there never was an assignment associated to the selected student account or the REMOVE ASSIGNMENT button was selected.
131
Hirtle Software
Assignment Active (Test Not Completed) - This means the current test (.tst) file is setup and assigned to the selected student account. The next time this student logs into this software using their login name and password, this test assignment will automatically start. Assignment Inactive (Test Completed) - This means that a student has logged into their account and has been administered this assigned test. They have completed this test assignment. You should see their test score in the TEST ASSIGNMENT AREA. You may review their test answers selecting the REVIEW TEST button. Both Student and Instructor account and test assignments (if any) information is stored to the ACCOUNTS.AZZ file which is installed into the same folder as Random Test Generator-PROs executable file. This file is necessary and should never be moved or deleted. In addition, the file name should never be changed. If you encounter any problems with this file you can use the REPAIR/COMPACT FILE option from the TOOLS menu to try to correct the problem. You may wish to backup this file on occasion as part of routine maintenance. The Applications Master Password information is not stored in this file. As a reminder, tests assigned to student accounts will only presented to them as screen tests. You cannot assign Internet/Web tests to student accounts. Internet/Web and paper tests cannot be automatically presented to students from RTG-PRO. Internet/Web tests are designed to be uploaded to your web server which will have a web address known as a URL. Simply provide the URL address to students when you are ready for them to take an Internet student test. They may take the Internet test from anywhere in the world and they do not need RTG-PRO software once your Internets tests reside on your web server. Paper tests are designed for printing and should be handed to students in that way. Therefore, students do not have the ability to login and paper tests be printed automatically. Any student test (.tst) file may be assigned to student accounts regardless if they was originally created for screen, paper or Internet/Web testing. But again, they will only be presented as screen tests to students when they have been assigned a test (.tst) file to their login account.
132
Hirtle Software
Activity Log
When the REQUIRE LOGIN NAME AND PASSWORD AT START-UP checkbox is selected from the SECURITY area of the OPTIONS window, this will then require all access to the software using either the Applications Master Password or specific Student/Instructor login accounts. As a security measure, all attempted logins whether successful or not are written to the ACTIVITY LOG file. Reviewing this file will display who has logged-in and the exact times they have logged-in and out. It will also display any unsuccessful login attempts to assist you in determining if any unauthorized activity has taken place. This should help you determine if changing login names and passwords is a good idea. Also because of the login and logout times, this will also help you determine exactly who was logged in when and how long. You can also observe how long students where logged in while taking their assigned test whether the test had a time limit imposed or not.
The activity log is kept within a standard text file and may be viewed using any text viewing software such as MS-Notepad. The default text viewing software will be started when you view the Activity Log using Random Test Generator-PRO. Here are the steps to view and clear the Activity Log:
Viewing The Activity Log

Select the VIEW ACTIVITY LOG option from the ADMINISTRATION menu.
Clearing The Activity Log

Select the CLEAR ACTIVITY LOG option from the ADMINISTRATION menu. Note: You can also clear/edit this log file manually with your text editing software.
133
Hirtle Software
Chapter 8 Advanced Tools

Repair/Compact Files
On rare occasions a MS-Access database file may get corrupted. Since TestBank (.MDB) and test (.TST) files are in MS-Access format, this potentially could happen to them as well. Corrupted files can often be repaired with no or minimal damage done using the built-in REPAIR/COMPACT FILES function available in Random Test Generator-PRO. This handy feature is the exact same as what comes with Microsoft Access itself. In addition, this option will also compact your TestBank and student test files at the same time. MS-Access database files do not automatically recapture disk spaced used when items (records) are deleted or data is removed. Therefore, choosing this option will compact files to the smallest possible size by recapturing unnecessary disk spaced used. You cannot perform this option if the file you wish to repair/compact is open at the time. Here are the steps to repair and compact TestBank or student test files: Select the REPAIR/COMPACT FILES item from the TOOLS menu.
134
Hirtle Software
Select the file (.MDB, .TST, .TPL or .AZZ) which you wish to repair/compact using the file dialog window.
In a matter of seconds your file should be repaired and compacted. If your file is corrupted, in most cases your data should be unharmed after repaired. A thorough inspection of your file should be performed to verify its integrity. It is always a good idea to backup TestBank files periodically as another method to safeguard your data. A message box will appear which will provide you that the repair/compact process was successful and a before/after value of the disk space it was able to reduce the file down to. You should be able to recover substantial disk space if you have deleted test items and/or embedded multimedia files and then run the REPAIR/COMPACT FILES option. Using the REPAIR/COMPACT FILES procedure will not harm your files in any way. It is not necessary to use this tool only for repairing possible damaged files, you may use it to simply compact your TestBank or Test files as well. Whenever you delete test items, especially if they included embedded multimedia files, it is always a good idea to use the REPAIR/COMPACT FILES tool. The compacting method can recapture the disk space used by your files, in many cases it will significantly reduce your TestBank and student test file sizes.
135
Hirtle Software
Backing Up TestBank Files

An effective way to safeguard your data from accidental deletion or corruption is by backing them up periodically. This will aid in safeguarding your data and hard work. It is recommended that all backup files be stored on a separate media device than the original. A hard disk crash would destroy both the original and backup, if the backup was simply stored in a separate folder on the same drive. In order to backup a TestBank file it must be open and active first. While the file is open, here are the steps to backup your TestBank files: Select the BACKUP TESTBANK option from the TOOLS menu.
Select the OK button when prompted.
All backed up files will have the word "_BACKUP" added to the end of the original file name. For instance, if you request to backup a file called HISTORY101.MDB, the backup will save it as "HISTORY101_BACKUP.MDB created in the same folder. This backup feature will only work for TestBank (.MDB) files. However, you can use Windows Explorer to backup student test files or any other files you wish very easily.
136
Hirtle Software
Viewing TestBank Properties

There are two types of properties which can be viewed by users, FILE and TESTBANK. File properties will show a typical MS-Windows property window indicating the file name, location, size, creation and modified dates, and attributes such as read-only, hidden and archive. These attributes can be changed from this window if desired. TestBank properties will breakdown the contents of the TestBank file by total questions contained, how many of which include a Graphic, AVI, Animated GIF, WAV, MIDI, Other and text only questions and the QID numbers contained within the selected TestBank. In order to view properties, a TestBank file must be open and active beforehand. Here are the steps to view both property types:
File Properties
Select the PROPERTIES item from the FILE menu.
Next, choose the FILE option.
Example of FILE PROPERTIES window
137
Hirtle Software
TestBank Properties
Select the PROPERTIES item from the FILE menu.
Next, choose the TestBank option.
Example of TESTBANK PROPERTIES window
138
Hirtle Software
Changing Print Margins

To change the top, bottom and left, right print margins follow these steps: Select the PAGE SETUP item from the FILE menu.
Select the margin settings you wish from the appropriate pull-down menus.
Select the OK button.
Changing printers and other options may be done when using the Print Preview screen, the Print dialog box will allow you to change these settings from it. You may notice that when you send data to MS-Word, that your margin settings may be different. This is an MS-Word situation which has its own default settings for new document margins. Therefore, if you wish to have the same margins as you have in Random Test Generator-PRO, you must change your default margin settings in MS-Word to match or edit the document through the MS-Word PAGE SETUP option for each time you send to MS-Word.
139
Hirtle Software
Password Protecting TestBanks and Student Tests

This application allows you to password protect it from unauthorized access if the REQUIRE LOGIN NAME AND PASSWORD AT START-UP checkbox is selected from the OPTIONS menu. This prevents unauthorized users from gaining access to this software but has no effect on TestBanks (.MDB) and student tests (.TST) files themselves. For example, if anyone has access to the computer itself where your TestBank and Test files reside, they potentially could gain access to this information by using MS-Access software directly. If they have an Instructor account or use the Master Password they can use this software to edit TestBank files. However, this software provides an option to add, change or remove passwords for individual TestBanks (.MDB) and test files (.TST) using Microsoft's own MS-Access password protect security feature for databases. Therefore, even if someone uses MS-Access, they cannot gain access to these files unless a valid password is supplied. Although Random Test Generator-PRO can password protect your TestBank and student Test files, it cannot open these files while they are password protected. Therefore, you should remove the password on any file you intend to use. Otherwise it will alert you that the files cannot be opened. Passwording files is simply for protection from unauthorized access. Here are the procedures to add, change or remove passwords for Random Test Generator-PRO TestBank and student test files:
Adding Passwords To TestBank And Test Files

Select the PASSWORD FILE MANAGER option from the TOOLS menu item.
Select the TestBank (.MDB) or test (.TST) file you wish to password protect, then select the OPEN button.
Type in your password in the NEW PASSWORD field (leave the OLD PASSWORD field blank if there is no current password protection for this file).
140
Hirtle Software
Changing Passwords For TestBank And Test Files

Select the TestBank (.MDB) or test (.TST) file you wish to change its password, then select the OPEN button.
Type in the current password in the OLD PASSWORD field.
Type in the new password in the NEW PASSWORD field.
Please remember your new password. You cannot gain access to these files unless you provide the correct password. You must provide the current (old) password in order to change it, otherwise the password will not change.
141
Hirtle Software
Removing Passwords From TestBank And Test Files

Select the TestBank (.MDB) or test (.TST) file you wish to remove its password, then select the OPEN button.
Type in the current password in the OLD PASSWORD field (leave the NEW PASSWORD field blank).
Select the REMOVE PASSWORD button.
You must provide the current (old) password in order to remove it, otherwise the old password will stay in effect. Please remember your passwords. You cannot gain access, to these files unless you provide the correct password for them once they are set. You also cannot change or remove a password which has been set unless you supply the old (current) password first. Important: Password protecting files makes them unusable while they are set. You cannot edit TestBanks or create student tests unless the password has been removed from those files first. Therefore, you should remove the password (if set) before using the TestBank files in any manner with this software, otherwise you will receive file errors when this software attempts to open them. This password feature is meant only to protect your files from unauthorized access. In addition, if an attempt is made to open these files in MSAccess while a password is in effect, MS-Access will then require the same password in order for these files to be opened with it as well. Therefore, password protected files is a very secure method to protect your TestBanks and student tests from prying eyes regardless of what software is used to attempt to gain access to them.
142
Hirtle Software
Using Speech Capabilities

This software will automatically install a Text-To-Speech (TTS) engine. This TTS software allows you to hear your TestBanks and/or student tests as well as read them. This powerful TTS feature actually reads your test items and audibly pronounces them through your computer's sound system (if available). This advanced technology provides a crisp synthesized voice sound system to TestBank and screen test administration. Students may hear test questions, answer choices and their own answer selections as they take their screen tests. In addition, you may set the TTS engine to pronounce these test items while you are developing them. An added feature allows animated characters to appear (if desired) which works in conjunction with TTS. This software installs only the English (USA) language and the Genie animated character. However, numerous other TTS voice languages and animated characters are available to choose from and may be downloaded and used for FREE. TTS Has numerous settings which are available to design the format in which you wish to administer this feature. To enable/disable and/or modify these settings, go to the SPEECH SETTINGS option from the TOOLS menu.
143
Hirtle Software
Available TTS settings

ENABLE TEXT-TO-SPEECH Selecting this option will start TTS in TestBank, Test Administration and/or Login Screen modes. DISABLE TEXT-TO-SPEECH Selecting this option will turn-off TTS in TestBank, Test Administration and/or Login Screen modes. DISPLAY CHARACTER Selecting this option will make the TTS character visible as it pronounces test items in TestBank, Test Administration and/or Login Screen modes. DISPLAY BALLOON - Selecting this option will make the balloon text object visible as it pronounces test items in TestBank, Test Administration and/or Login Screen modes. VOICE PITCH - This slider bar allows you to adjust the pitch of the synthesized voice to a desired level. This setting effects TestBank, Test Administration and Login Screen modes equally. VOICE VOLUME - This slider bar allows you to adjust the volume of the synthesized voice to a desired level. This setting effects TestBank, Test Administration and Login Screen modes equally. TALKING SPEED - This slider bar allows you to adjust the speed of the synthesized voice to a desired level. This setting effects TestBank, Test Administration and Login Screen modes equally. LOAD NEW CHARACTER - This button allows you to set the default animated character for TestBank, Test Administration and Login Screen modes. The Genie character is shipped with this software. LANGUAGE - This pull-down menu allows you to set a new default language for the TTS engine for TestBank, Test Administration and Login Screen modes. English (USA) is shipped with this software. RANDOM QUOTES This applies only to the Login Screen. If the ENABLE TEXT-TO-SPEECH option is set for Login Screen mode as well as the Login Requirement is set in the OPTIONS menu, this feature will randomly speak out-loud famous educational quotations periodically while waiting for someone to log-in.
144
Hirtle Software
Text-To-Speech In TestBank Development Mode

If you have the SPEECH SETTINGS window set to ENABLE TEXT-TO-SPEECH for TESTBANK DEVELOPMENT, then when editing TestBanks the test items will be audibly read out-loud by this software. You may then use the SPEAK/STOP SPEAK and ENABLE SPEAK/DISABLE SPEAK buttons to control speech behavior. The SPEAK/STOP SPEAK button acts as a toggle to speak the current test item out-loud or stop speaking the current test item (in mid-sentence). The STOP SPEAK button only stops the current reading and does not permanently stop the speaking for other test items as you navigate between them. However, the ENABLE SPEAK/DISABLE SPEAK button acts as a toggle to permanently activate or deactivate the speech software. This allows you to control whether you wish to hear the speech software regardless of the speech settings that have been set from the SPEECH SETTINGS window. However, the character will still adhere to the other settings such as whether it visibly displays and whether it uses the balloon style text window when it speaks. Therefore, the SPEECH SETTINGS window settings for DISPLAY CHARACTER and DISPLAY BALLOON STYLE (for TESTBANK DEVELOPMENT) are permanent unless changed. These settings will be relied upon whenever you decide to enable the speech software. The setting to enable or disable Test-to-Speech in the SPEECH SETTINGS window is simply a default setting. When a TestBank is initially opened, this setting is what will occur. You may change your mind at anytime while in TestBank development mode. Any newly opened TestBanks will revert back to the settings in the SPEECH SETTINGS window as the default values.
Text-To-Speech In Student Screen Test Mode

If you have the SPEECH SETTINGS window set to ENABLE TEXT-TO-SPEECH for TEST ADMINISTRATION, then when Screen Tests are presented to students the test items will then be audibly read out-loud by this software. Students may then use the SPEAK/STOP SPEAK and ENABLE SPEAK/DISABLE SPEAK buttons to control speech behavior on their screen test window. The SPEAK/STOP SPEAK button acts as a toggle to speak the current test item out-loud or stop speaking the current test item (in mid-sentence). The STOP SPEAK button only stops the current reading and does not permanently stop the speaking for other test items as the student navigates between them. However, the ENABLE SPEAK/DISABLE SPEAK button acts as a toggle to permanently activate or deactivate the speech software. This allows students control as to whether they wish to hear the speech software regardless of the speech settings that have been set from the SPEECH SETTINGS window. However, the character will still adhere to the other settings such as whether it visibly displays and whether it uses the balloon style text window when it speaks. The student cannot control these settings while the screen test is in progress. Therefore, the SPEECH SETTINGS window settings for DISPLAY CHARACTER and DISPLAY BALLOON STYLE (for TEST ADMINISTRATION) are permanent unless changed. These settings will be relied upon whenever the student decides to enable the speech software while being administered screen tests. The setting to enable or disable Test-to-Speech in the SPEECH SETTINGS window is simply a default setting. When screen tests are first started, this setting is what will occur. However, the student may then change whether their individual screen test will use the speech software from the ENABLE SPEAK/DISABLE SPEAK toggle button on the screen test itself. They may change their mind at anytime while in screen test mode. Any follow-on students who are administered screen tests will revert back to the settings in the SPEECH SETTINGS window as the default values.
145
Hirtle Software
Using Languages Not Installed by This Software

Only English (USA) language is shipped with this software. In order to use any other language you must download the supporting software (see below) and then install it (its all FREE). Simply selecting a different language in the SPEECH SETTINGS window will have no effect unless the specific language supporting software has been installed. Here are the steps to download, install and activate a different language in Random Test Generator-PRO: Select the DOWNLOAD OTHER SPEECH LANGUAGES & CHARACTERS option from the HELP menu or connect to the Microsoft web site at: http://www.microsoft.com/msagent/downloads.htm#core
Choose a desired language from the SELECT A LANGUAGE pull-down menu at the Microsoft Web Site. Choose the DOWNLOAD SELECTED LANGUAGE link. Select a directory to save the file to your hard drive and press OK from the directory pop-up menu from your web browser. After download is complete, locate the file and execute it to automatically install the language file on your system. Start Random Test Generator-PRO if not already running. Select the specific language from the LANGUAGE pull-down menu located in the SPEECH SETTINGS option from the TOOLS menu.
Select either the ACCEPT or APPLY buttons to activate the language.
146
Hirtle Software
Adding speech languages does not replace any language files already in existence on your system. You may reselect any language which already exists from the LANGUAGE pull-down menu located in the SPEECH SETTINGS option from the TOOLS menu and it will immediately take effect. If you select a language which no files exist for, the previous successful selected language will be implemented. Only the Genie character is shipped with this software. In order to use any other character you must download them (see below) and install them on your system. All characters installed on your system will be located in the; C:\WINDOWS\MSAGENT\CHARS directory (or WINNT as appropriate). To download, install and activate a new character from the Microsoft web site follow these steps: Select the DOWNLOAD OTHER SPEECH LANGUAGES & CHARACTERS option from the HELP menu or connect to the Microsoft web site at: http://www.microsoft.com/msagent/downloads.htm#core
Choose a desired character from the SELECT A CHARACTER pull-down menu at the Microsoft Web Site. Choose the DOWNLOAD SELECTED Character link. Select a directory to save the file to your hard drive and press OK from the pop-up window. After download is complete, locate the file and execute it to automatically install the character file on your system. Start Random Test Generator-PRO if not already running. Select the specific character from the LOAD NEW CHARACTER button located in the SPEECH SETTINGS option from the TOOLS menu.
147
Hirtle Software
Select the character from the file list you wish to activate. If no .ACS files are shown, direct the path to; "C:\WINDOWS\MSAGENT\CHARS" or "WINNT" as appropriate
Select the OPEN button from the pop-up window. Select either the ACCEPT or APPLY buttons from the SPEECH SETTINGS window to activate the character.
Adding new characters does not replace character files already in existence on your system. You may reselect any character which already exists from the LOAD NEW CHARACTER button located in the SPEECH SETTINGS option from the TOOLS menu and it will immediately take effect. Many 3rd party characters are in existence besides Microsoft characters, see below for links to other web locations to obtain other characters. This TTS capability is an industry standard developed by Microsoft. A number of groups in addition to Microsoft support TTS in various ways. If you wish to add more capabilities such as additional animated characters and other languages, you may download these capabilities FREE of charge from the Microsoft site at: http://www.microsoft.com/msagent/downloads.htm#core In addition to Microsoft, many companies have created their own characters which may be used. Many are FREE of charge. Select the NON-MICROSOFT WEB SITE TO DOWNLOAD CHARACTERS option from the HELP menu to go to a web site which provides downloadable links to these characters as well as other resources which support Text-To-Speech. Or manually go to the following web links: http://www.msagentring.org http://www.agentry.net
148
Hirtle Software
Creating PDF Student Tests & Reports

Adobe PDF formatted files have become a very popular format. Many organizations use this format for their own forms. Creating PDF files require that you have Adobe Acrobat Distiller software. This should not be confused with the Adobe Acrobat Reader software which only allows you to view and print existing PDF files. Adobe Acrobat Distiller comes with the Acrobat installation which allows you to create PDF files. Adobe has seamlessly integrated their Acrobat Distiller with many other software products including MSOffice products. Therefore, you can create PDF files directly from any existing MS-Office files such as MSWord, MS-Excel and MS-PowerPoint. If the Acrobat Distiller is installed on your computer, you will see options for it within your MS-Office software to create files in PDF format. By using the RTG-PRO SEND TO MS-WORD button on printable forms, you will then enable MS-Word to create PDF files using the Acrobat Distiller software. In addition, Random Test Generator-PRO printable forms may also be used to create PDF files directly as long as Adobe Acrobat Distiller is installed on your computer. Here are the steps necessary to create any RTG-PRO printable form (such as student tests and reports) in Adobe PDF format: Have the printable form (student test, test item analysis report, etc...) displayed and active within RTG-PRO.
Select the PRINT option from the FILE menu.
Select the ACROBAT DISTILLER option from the PRINTER NAME pull-down list-box.
149
Hirtle Software
Make your setting changes (if any) to the other options available on the PRINT dialog box and then select the OK button when ready. Type-in the PDF file name you wish to call your new file in the FILE NAME field and then select the SAVE button when ready to create your PDF file.
Your new PDF file will be saved in the folder you have specified under the file name you typed-in. Simply double-click the file to open it up with your Adobe software. If the Acrobat Distiller is not an option on the PRINTER NAME pull-down box, the Adobe Acrobat software is probably not installed on the computer. Please verify it is actually installed and try again. Acrobat Distiller is installed as a printer. Therefore, it should be listed on your system from the PRINTERS display in the SETTINGS option of the START menu. If it isnt there, it is not installed. Again, do not confuse the Acrobat Reader with the Acrobat Distiller. They are separate software products. Besides saving your RTG-PRO student tests and reports in PDF format, you may also use these procedures to save them into any other format in which a Windows Printer (driver) is installed such as FAX software. This is completely depending upon the software which is installed on your computer and will vary greatly from computer to computer.
150
Hirtle Software
Chapter 9 Licensing/Support
Licensing
Licensing Random Test Generator-PRO is very easy. In fact, if you purchase online using our secure web servers you can have full access to this software in just minutes. Online purchases is the fasted method to license this software. Once your credit card has been accepted you will receive an e-mail (typically in just minutes) with your registration code. All you have to do is enter this registration code into the trial version of the software when prompted and you will then have full unrestricted access to the software. No additional downloading is necessary if you already have the trial version installed on your system. Below is our licensing costs based on the quantity purchased:
Software Licensing & Quantity Discounts

Quantity
1 5 10 50 100 500 4 9 49 99 499 Above
Cost Per License

$99.95 $89.95 $79.96 $69.96 $59.97 $49.97
Discount
0% 10% 20% 30% 40% 50%
Note: Prices subject to change without notice
151
Hirtle Software
This offer is subject to change without notice. Please refer to the choices under the HELP menu item of Random Test Generator-PRO for the available options to purchase this software online, by telephone, fax, purchase orders or postal mail. You may also go to the purchasing page at Hirtle Software for the latest information at: http://www.hirtlesoftware.com/purchase.htm LICENSE INFORMATION: License quantity should be based on computer systems in which the registered version of this software is planned to be installed onto (including Network systems), regardless of how many people use those computer systems. Licenses are NOT based on the quantity of students nor how many student tests you create with this software (unlike many other companies). Those items are unlimited. Therefore, base your quantity on computer systems you plan on installing the registered version of this software onto. Here are a couple of examples; If you have just one stand-alone computer you wish to install this software onto, then you only need one license. If you install this software on a network with 10 connections, then 10 licenses would be required. In both examples, the number of students or tests you wish to create are unlimited and have no effect on licensing. Shipping and handling charges do NOT apply to online purchases, since software is downloaded and registration codes are issued via E-Mail.
152
Hirtle Software
Random Test Generator-PRO Order Form

Name: _____________________ Date: _____________
E-Mail Address: _________________________ (Required) PRICING SCALE

QUANTITY PRICE PER LICENSE 1 - 4 $99.95 5 - 9 $89.95 10 - 49 $79.96 50 - 99 $69.96 100 - 499 $59.97 500 - Above $49.97 Quantity: ________ X DISCOUNT 0% 10% 20% 30% 40% 50%
Price Per License: $_________
Total Charge: $____________ Multiply the Quantity you wish to purchase by the Price Per License to obtain the Total Charge.
Payment MUST be in the form of Check or Money Orders only. We do not accept credit card payments or any other form of payment (including Purchase Orders) via postal mail. Checks and money orders MUST be in US Dollars drawn from a US Financial institution address. You will receive registration code(s) via e-mail which when entered into the software will unlock the restricted features in the downloadable version and provide you full access. Therefore, you will not receive any software delivery by postal mail. Because of this, we do not charge any shipping and handling fees whatsoever. LICENSE INFORMATION: License quantity should be based on computer systems in which the registered version of this software is planned to be installed onto (including Network systems), regardless of how many people use those computer systems. Licenses are NOT based on the quantity of students nor how many student tests you create with this software. Those items are unlimited. Therefore, base your quantity on computer systems you plan on installing the registered version of this software onto. Here are a couple of examples; If you have just one stand-alone computer you wish to install this software onto, then you only need one license. If you install this software on a network with 10 connections, then 10 licenses would be required. In both examples, the number of students or tests you wish to create are unlimited and have no effect on licensing. Prices subject to change without notice.
Payments MUST be made Payable to: Timothy L. Hirtle (NOT Hirtle Software)
Send Payment and order form to: TIMOTHY L. HIRTLE P.O. BOX 853073 MESQUITE, TX 75185-3073
153
Hirtle Software
Purchasing and Return Policy

Our Purchasing and Return Policy is very standard throughout the software industry. Because software can be duplicated electronically, very few software companies offer refunds. After software registration codes are issued, we regret we are unable to issue refunds. We do not ship CDs or Diskettes, this is why there is no shipping & handling charges. Customers are responsible for downloading (electronically) and trying the demo (shareware version) of the software available for all our products (free of charge) that they wish to purchase to ensure that the software will work on their system and that the customer already has the necessary hardware and correct software operating system. We provide this free 30 day evaluation period for you to determine that our software is suitable for your use before you must license it. You should use that 30 day period to evaluate the software. When we receive payment, we send customers a registration code to "unlock" the software restrictions and provide customers with access to the full version of our software. Once you have licensed (purchased) the software and we have issued you a registration code, you can continue to use the software unrestricted with no limitations whatever. We have no way of "un-issuing" the registration code. We believe that your licensing (purchase) indicates that you have determined the software is suitable for your needs. Accordingly, we will be reluctant to issue refunds except in very unusual circumstances. Hirtle Software is the sole decision maker on whether a customer will receive a refund.
154
Hirtle Software
Receiving Technical Support

Technical assistance is only provided to licensed customers. Limiting technical assistance to licensed customers allows us to focus our attention to our clients needs expediently. Unlike many other companies we do not charge for technical assistance. There are no technical assistance contracts to purchase. If you are a registered user of this product, you can obtain technical assistance in two ways:
Online Browser Form Method

Connect to the Internet. Select the ONLINE TECHNICAL SUPPORT option under the HELP option of Random Test Generator-PRO. Fill out the web form which displays in your browser in as much detail as possible. Select the SUBMIT TO HIRTLE SOFTWARE button on the form.
This form is the preferred method to obtain technical assistance. If you do not a form capable browser, then an alternative method for you is to simply send an e-mail message. You may also get to this form by going to the Hirtle Software WEB Homepage and selecting the TECHNICAL SUPPORT link or go directly to the Technical Support location at the following URL address: http://www.hirtlesoftware.com/support.htm
E-mail Method
Connect to the Internet. Run your e-mail software. Create a new e-mail message and address is to the following e-mail address: support@hirtlesoftware.com Type in your problem in the e-mail text field. Include as much detail as possible. Send your e-mail.
Currently these are the only 2 methods available for technical support. Please be aware that if you do not provide detailed information about the problem you are having and provide your computer configuration, you may receive a longer delay in a response. Therefore, please be as detailed as possible. Before submitting a technical support request, please read the following topic in regards to student paper tests and report formatting issues. If this issue is the problem you are observing please follow the instructions to correct it. We will probably not be able to provide anything other than the information provided in this topic if you request technical support for it.
155
Hirtle Software
Contacting Hirtle Software

You may contact Hirtle Software via e-mail at the following address: sales@hirtlesoftware.com You may contact Hirtle Software via postal mail at the following address: HIRTLE SOFTWARE P.O. BOX 853073 MESQUITE, TX 75185-3073 If you are a LICENSED user, technical support is handled via the Hirtle Software online technical support form (preferred method) or e-mail address from the following address: http://www.hirtlesoftware.com/support.htm support@hirtlesoftware.com Hirtle Softwares Internet Web Address is: http://www.hirtlesoftware.com

Random Test Generator-PRO - Software Manual

Enviado por

Dados do documento

Descrição original:

Direitos autorais

Formatos disponíveis

Compartilhar este documento

Compartilhar ou incorporar documento

Opções de compartilhamento

Você considera este documento útil?

Este conteúdo é inapropriado?

Direitos autorais:

Formatos disponíveis

Random Test Generator-PRO - Software Manual

Enviado por

Direitos autorais:

Formatos disponíveis

PC Windows 32-Bit Software

A Product of Hirtle Software