Delivery system/System requirements

• The server requirements is an NT server or above.
• The system runs on the Web (browser).
• Client requires any browser on any operating system.

Creating data banks and tests with the Online Examination System

• Online examination questions can be categorized according to topic, types, etc. (libraries)
• The online examination system makes provision for difficulty levels of items.
• A test can be compiled with questions from different topics/libraries.
• A “serial number” is provided for each question according to topic, etc.
• The “serial number” can be used to search for and select questions.
• Questions can be converted to the databank from existing databanks.
• Questions can be converted from word processing files.
• Tests can be created on a random basis per student.
• Specific questions can be flagged to be included/excluded in a test.
• The online examination system is suitable for surveys.
• The online examination system can automatically add the marks allocated in each question to determine the total mark for the test.
• A printed paper and a memorandum can be compiled.
• Different papers (shuffle code) and memoranda can be compiled.\
• Export question papers and memoranda to .txt or .doc file

Control mechanisms in the test

• A time limit can be set for the test.
• The sequence of questions can be randomized.
• Online Examination System allows jumping to specific questions based on the previous answer.
• The distractors/options per question can be randomized.
• The online examination system limits the number of times a student can write a test.
• Students can navigate within a test (i.e. backwards and forwards). Can be set.
  Navigation tools/buttons can be selected for a test, and these buttons can be switched.
• on/off per question/test, e.g. backward/forward buttons.
• Students can be forced to go through all the questions at least once, before exiting the test.
• Students can be allowed to exit the test before completing all the questions.
• After exiting a test, students can continue the test from the last question they answered.
• A specific date for a test to be active can be set.

Online Examination System Feedback

• Feedback on test results can be set on/off.
• Feedback per question can be set on/off.
• Customized feedback per question/test.
• The event of feedback can be set, e.g. after all the questions/after each question/ after a section or library/not at all.
• The examination system indicates what the student answered as well as the correct answer.
• Extra time can be set for students to work through the feedback after test completion.
• Score per question can be displayed in the feedback.

Question types of the Online Examination System

• The following question types are essential:

• Multiple Choice
  This question type allows the user to select ONE correct answer
  - Options can be randomised
  - More than one option can be correct but the user can only select ONE option
  - Score can be set per option
  - No limitation on number of options
  - If there are a number of Options, these can be presented in a column(s).
  
  
• Multiple Response
  This question type allows the user to select more than ONE correct answer
  - Options can be randomised.
  - Score can be set per option.
  - No limitation on number of options.
  - If there are a number of Options, these can be presented in a column(s).
  - The number of responses students enter can be limited.
  
  
• Information page
  This screen provides information but does not contain a question
  - No limitation on the amount of text (scroll bar).
  
  
• Fill-in the blanks
  This question type gives the user the opportunity to type in short text answers
  - More than one blank space can be specified to be filled in by the student.
  - System caters for multiple spelling variations.
  - System caters for multiple possible answers.
  - Boolean operators can be used for marking.
  - Score can be set per answer.
  
  
• Hot-Spot
  This question type gives the user the opportunity to identify an area on the screen (graphic/text)
  - Score can be set per hot spot area.
  
  
• Matching
  This question type gives the user the opportunity to match data in columns
  - The options in the selection box can be matched to more than one option in the column.
  - Score can be set per match.
  - The options in the selection box as well as options in the column can be randomised.
  - No limitation on the number of options in the column or selection box.
  
  
• Numeric
  This question type gives the user the opportunity to type in a numeric answer
  - Ranges can be set.
  - The number of decimal places can be limited.
  - The number of decimal places can be set.
  - Score can be set per answer.
  - No text answers can be typed.
  
  
• Calculated (questions are randomly created according to set parameters).
  This question type gives the user the opportunity to type in a numeric answer
  - Ranges can be set per parameter.
  
  
• Free format
  This question type gives the user the opportunity to type an open ended answer
  - The field shouldn't be limited.
  - Complete answers can be printed out to be marked by the lecturer.
  - Export answers to .txt or .doc format

• Other essential requirements of the Online Examination System:
  - Graphic(s) can be included as part of a question.
  - Sound can be included as part of a question.
  - Video can be included as part of a question.
  - Animations can be included as part of a question.
  - Scoring per option should be possible.
  - Negative marking should be possible in all the question types.
  - Preview of a question is available while setting up questions.

Programme requirements

• Text can be formated easily, e.g. bold, italics, underline.
• Text can be formated easily within a question, e.g. bold, italics, underline.
• Templates can be used to set the format of a test.
• Stylesheets can be used.
• Graphics and videos can be moved around the screen.
• There is a zoom facility for graphics and videos.
• If there are a number of options, these can be presented in a column.
• The online examination system can handle/insert the greek alphabet, subscripts and superscripts.
• The online examination system can handle/insert "special characters" such as arrows, etc.
• While setting up a test a student preview should be available.
• Completed papers of individuals can be exported to .txt or .doc format.
• The question number can be displayed.
• The number of questions answered can be displayed.
• Remaining time can be displayed. (Can student switch on/off?)

Other features of the Online Examination System

• Students can access tests they have completed.
• Both essay type questions and memorandums can be saved in databanks.
• A paper-based test paper can be generated from the databank.
• A test can be saved in text format.

Stability and Speed of the Online Examination System:

• The online examination system is stable while setting up a test.
• The online examination system is stable while students complete a test (at least 160 students per session).
• Answers can be saved in real time (if a power failure occurs the answers must be saved up to that point).
• The speed of delivery of test from the server to work station is acceptable.
• The speed for presenting each question per work station is acceptable.
• The speed for presenting videos and graphics per work station is acceptable.

Security

• Only registered students are able to access a test.
• The test can be made available on specific dates.
• The test can be made available at specific times.
• The number of times students access tests can be set.
• The login time per student is available.
• Logoff time per student is available.
• The online examination system can limit logins to a specific subnet.
• Text files with students details (i.e. names and student numbers) can be used to give students access to tests.

Reporting

• The following results on student performance can be obtained:
  • Student number, name and mark in Excel, Word and txt format.
  • Results per topic per student
  • Average of group
  • Average time used by the students
  • Date and time of test taken
  • Time taken for each individual student to complete the test.
    
• Full report per question is available, and includes:
  • The difficulty value of a question
  • Discrimination index
  • Standard deviation
  • Graphical presentation of results
  • Number of times a distractor has been selected
    
• Answers can be saved in real time (if a power failure occurs the answers must be saved up to that point).
• Papers can be remarked after editing a test, e.g if a question is deleted.
• Results must be presented according to the original question/id numbers.
• Report of each individual's answers

Support and training

• Technical support is available in South Africa.
• Extensive training is available to enable clients to use the online examination system to its full capacity.
• There is a quick response time in the event of technical problems.
• There is a service level agreement.

Evaluating the Online Examination System

• The client can have the complete online examination system on their network for a trial period.
• Clients have permission to use the online examination system in a “live” test situation for a specified period of time.
• All roleplayers (Telematic department, lecturers, IT) can be involved in evaluating the online examination system.
• The online examination system can be evaluated by various people.