SYSTEM TESTING AND

DEPLOYMENT

Lecture Seven
(Chapter 7, Notes;
Chapter 8, Textbook)
Chapter 7: System Testing and Deployment

System Testing & Deployment after

Knowledge Codification
Capture Tools Intelligence
Programs, gathering Shells, tables,
books, articles, tools, frames
experts maps, rules

KNOWLEDGE KNOWLEDGE
CAPTURE CODIFICATION
(Creation)

DATABASES TESTING AND

DEPLOYMENT
Explicit Knowledge

KNOWLEDGE
SHARING

KNOWLEDGE
TRANSFER
KNOWLEDGE
BASE
7-2
 Chapter 7: System Testing and Deployment

Stages of KMSLC
Evaluate Existing
Infrastructure

Form the KM Team

Knowledge Capture

Iterative Rapid Design KM Blueprint

Prototyping
Verify and validate the KM
System

Implement the KM System

Manage Change and

Rewards Structure

Post-system evaluation
7-3
Chapter 7: System Testing and Deployment

Quality Assurance
KM system should meet expectations of
members represented in the KM team.
Performance depend highly on quality of
explicit/tacit knowledge stored in KB.
For expert, quality relates to reasoning
process that produces reliable and accurate
solutions.
For user, quality relates to systems ease of
use and efficiency.
For knowledge developer, quality relates to
how valid the knowledge sources are and
how well they are codified into KB.
7-4
Chapter 7: System Testing and Deployment

KMS Testing
To control quality, performance
and efficiency of both KB and
KMS.
Types of Testing
Logical Testing, make sure that
the system produces correct
results.
User Acceptance Testing,
follows logical testing and check
systems behaviour in a realistic
environment.
7-5
Chapter 7: System Testing and Deployment

Hurdles in KMS Testing

Subjective nature of tacit
knowledge.
Lack of reliable specifications
to guide testing
How to decide whether
knowledge is complete
Human errors
Lack of time
User interface un-friendly 7-6
 Chapter 7: System Testing and Deployment

Logical Testing Approaches

Knowledge base formation
Structure of knowledge as it
relates to circular or redundant
errors
Consistency, correctness, and
completeness of knowledge
base rules
Knowledge base functionality
Confidence

Reliability of knowledge base

7-7
Chapter 7: System Testing and Deployment

Logical Errors
Circular errors - contradictory in
meaning or logic
Redundancy errors - offer different
approaches to the same problem
Unusable knowledge - comes up
no matter conditions succeed or fail
Subsumption errors - if one rule is
true, one knows the second rule is
always true
Inconsistent knowledge - the same
inputs yield different results
7-8
Chapter 7: System Testing and Deployment

User Acceptance Testing

Approach
Select a person or a team for testing
Decide on user acceptance test criteria
Develop a set of test cases unique to
the system
Maintain a log on various versions of
the tests and test results
Field-test the system
7-9
Chapter 7: System Testing and Deployment

Requirements for Test Team

Independent of the design or
codification of the system
Understand the knowledge
problem and computer
technology
Well versed in the
organizations goals
Know how the system being
tested will fit into the
designated area of operation
7-10
Chapter 7: System Testing and Deployment

Content of Test Plan

Items of KM system that
require testing
Schedule of user
acceptance testing
Description of test methods
that are approved by user
and company
Guidelines for documenting
test results
7-11
Chapter 7: System Testing and Deployment

User Acceptance Criteria

Accuracy and correctness of
outcome for test items
Adequacy of the solutions
Adaptability to novel input
Ease of use
Face validity or credibility
Robustness
Technical/operational test

7-12
Chapter 7: System Testing and Deployment

User Acceptance Test

Techniques
Face validation

Test Cases

Sub-systems
validation

7-13
Chapter 7: System Testing and Deployment

Factors affecting System

Deployment
Technical

Organizational

Procedural

Behavioural

Political

Economical
7-14
Chapter 7: System Testing and Deployment

Steps in KMS Deployment

Transfer of KM System
from knowledge developer
to the organizations
operating unit.

Transfer of KMs skills

from knowledge developer
to the organizations
operators.
7-15
Chapter 7: System Testing and Deployment

Successful KM System
Deployment
User has prior experience with
computer applications
User has been involved in the
building of the KM system
Benefits of the KM system is
immediate and measurable
First impression
Management support the
system from start
Adequate user training 7-16
 Chapter 7: System Testing and Deployment

Factors affecting User Training

Primary
The users knowledge of
knowledge-based system
Complexity of KM system and
user interfaces ease of use
Secondary
Trainerstechnical experience/
communication skills
Environment of training venue

7-17
Chapter 7: System Testing and Deployment

Pre User Training Session

Define how the KM system
agrees with organizational
mission
Demonstrate how the system
can support organizational goals
Allocate adequate resources for
the training project
Advocate positive effects of the
system
Explain cost-benefit analysis of
the KM system
7-18
Chapter 7: System Testing and Deployment

Overcome Resistances to
Change
User attitude survey

Communication
sessions

Role negotiation
7-19
Chapter 7: System Testing and Deployment

Post-Implementation Review
How KM System has
changed accuracy/timeliness
of decision making
How KM System has affected
attitude of end users
Whether the system has
caused constructive
organizational changes?
Whether the system has
benefited the operation cost?
7-20
Chapter 7: System Testing and Deployment

Security Issues
The new system should
provide password /
protocol protection.
Security procedures
should be consistently
observed.
Access should be
restricted regarding
update of the KB.
7-21
Chapter 7: System Testing and Deployment

Circular Errors
Rule 1:
IF John and Rob are co-owners of
company A
THEN John and Rob own the same
company
Rule 2:
IF John and Rob own the same
company
THEN John and Rob are co-owners
7-22
Chapter 7: System Testing and Deployment

Redundancy Errors
Rule 1:
IF (Salary > 50,000 OR HOME > 100,000)
THEN Loan = yes
Rule 2:
IF (Salary > 60,000)
THEN Loan = yes

7-23
Chapter 7: System Testing and Deployment

Unusable Knowledge

IF humidity is 5% AND
heavy_rain = yes
THEN some actions

7-24
Chapter 7: System Testing and Deployment

Subsumption Errors
Rule 1:
IF A AND B, THEN D
Rule 2:
IF A AND B AND C, THEN D

7-25