Evaluation Of A Prototype Expert System For Configuring Underground Coal Mines

A prototype expert system for planning and designing underground coal mines has been developed in a doctoral study (Basu, 1991) at the University of Kentucky (U.K.). The objective of the study was to provide a design tool for configuring layout parameters, production systems, and for determining economic feasibility. Details of knowledge engineering and the prototype knowledge-based system for integrated and intelligent planning and design have been covered in the dissertation. The prototype demonstrates its robustness by allowing interaction among major design components, most notably among ventilation, ground control, and production planning. A plan for testing and evaluating the prototype, an important phase of software development, is presented here. Existing evaluation procedures for expert system prototypes are discussed and the evaluations for the underground coal mine design expert system prototype are included. The initial testing plan used senior-level mining engineering students to test the acceptance of the prototype. This test suggested the usefulness of such a system for training and instruction. This initial acceptance test was performed with the feasibility prototype. The other test objective, i.e., testing the model's accuracy, involved extensive participation of domain experts. For overall accuracy evaluation, an existing underground coal mine design was compared with the output from a design session using the expert system prototype. The testing procedure is not an isolated, independent development phase. Much of the accuracy evaluation is done at the time of knowledge base development. Therefore, the knowledgebase itself does not need a formal test phase. The major purpose of the field testing is to determine probable user acceptance. The acceptance test determines the completeness of the prototype and also will determine efficiency of user interfaces.