Você está na página 1de 121

ExampleApp Functional Specification

Author:
Version:

Overview:

Structure:

ampleApp Functional Specification


Tony Heap
This is a living document and is not formally version controlled.

Accordingly, there is no formal sign-off of the document as a whole. Rather, each "acceptance crite
"Agreed" columns on the "Details" worksheet).

This document (together with a number of supplementary documents) is the functional specificatio
This document specifies what the system will do as opposed to how it will do it (i.e. It is not a techn
This document specifies only the changes to the system; it does not specify existing functionality.

The functional specification consists of a set of "stories".


Each story describes some aspect of the system's behaviour, either functional or non-functional.
A story is the smallest unit of system delivery - a story is either delivered or it is not.
In practice, stories are grouped together and delivered as (time-boxed) "increments" every 3-4 wee
The "Summary" worksheet is an inventory of all the stories, along with various information for eac

In particular, the "Status" column in the "Summary" worksheet indicates the status of each story, f
"gone live".
The "Details" worksheet contains the detailed specification for each story.
Each story is specified in "use case" format (ref. "Writing Effective Use Cases", Alistair Cockburn, 2

See the column heading comments on the "Summary" and "Details" worksheets for further details
The "Actors" workheet specifies all actors (users and external systems)
The "Stats" worksheets show development progress for individual increments, in the form of a "bu

Story ID Story Name

As a... (Actor)

S001

Timeout

Logged In User

S002

Submission Warning

Assessment
Submitter

S003

Submission E-mail

Assessment
Submitter

S004

Approval E-mail Log

DIP Team

S005

Thingy New User E-mail

XYZ ABC User

S006

Thingy "Not Relevant" Extras

Thingy
Assessment
Completer

S007

Thingy KB Doc Change

General User

S008

Thingy Footer Details

Thingy User

S009

Thingy Request Registration

Thingy User

S010

Add Widget Comments

Assessment
Completer

S012

View Widgets List


(Enhancements)

General User

S013

View Widget Header Information General User


(v8+)

S014

View Widget Description (v8+)

General User

S015

View Widget Guidance Text


(v8+)

General User

S016

View Knowledge Base Resources General User


(v8+)

S017

View Widget Origins (v8+)

General User

S068

View Widget Changes (v8+)

General User

S018

View Training Tool Text (v8+)

General User

S019

View Training Tool Custom Text


(v8+)

General User

S020

View Attainment Levels (v8+)

General User

S021

View Evidence Types

General User

S049

Expand and Collapse Widget


(v8+)

General User

S023

Indicate Widget As Not Relevant Organisation


(v8+)
User

S024

Enter Comments for an


Attainment Criterion

Organisation
User

S025

Add Custom Evidence Type

Organisation
User

S026

Indicate Evidence Obtained

Organisation
User

S027

Enter Evidence Comments

Organisation
User

S028

Specify External Evidence


Location

Organisation
User

S131

Specifiy Evidence Location


Improvement

Organisation
User

S030

Upload Evidence

Organisation
User

S031

View Evidence

Organisation
User

S029

Specify Duplicate Evidence

Organisation
User

S140

View Duplicate Evidence

Organisation
User

S139

Cannot Delete Referenced


Custom Evidence

Organisation
User

S149

Link to Existing Uploaded


Evidence

Organisation
User

S163

Link to Existing Uploaded


Evidence (Mark 2)

Organisation
User

S032

Configure Evidence Provision


Status

Sys Admin

S033

Indicate Attainment Criterion


Achieved

Organisation
User

S034

Indicate Attainment Level 0


(v8+)

Organisation
User

S036

Determine Current Attainment


Level (v8+)

Organisation
User

S037

Determine Widget Status

Organisation
User

S038

Grant Widget Exemption

XYZ ABC User

S039

View Widget Exemption

Organisation
User

S044

Grant Evidence Exemption

XYZ ABC User

S045

Grant Evidence Exemption to


Org Type

XYZ ABC User

S046

View Evidence Exemption

Organisation
User

S047

Save Widget

Organisation
User

S022

View Printable/Downloadable
Version of Widget

General User

S050

Download Widgets In Bulk

Logged In User

S076

Download Widgets In Bulk (PerInitiative Booklets)

Logged In User

S069

Download Widgets Spreadsheet General User

S056
S057
S058

Create Bulk Email


Add Bulk Email Attachments
Send Bulk Email

XYZ ABC User


XYZ ABC User
XYZ ABC User

S059

View Bulk Emails

XYZ ABC User

S060

Amend Bulk Email

XYZ ABC User

S061
S080
S102

Delete Bulk Email


View Bulk Email
Bulk Email Look & Feel

XYZ ABC User


XYZ ABC User
XYZ ABC User

S063

View Glossary Term Definition

General User

S070

View Glossary Term (Printable)

General User

S064
S071

View Glossary
View Printable/Downloadable
Version of Glossary

General User
General User

S082

Publish Widgets - Printable


Version

Sys Admin

S099

Publish Widgets - ZIP File


Downloads

Sys Admin

S100

Publish Widgets - Booklet


Downloads

Sys Admin

S101

Publish Widgets - Per-Initiative


Booklets

Sys Admin

S151

Publish Widgets - Spreadsheet


(Technology Spike)

Sys Admin

S072

Publish Widgets - Booklets with


Glossaries

Sys Admin

S067

Publish Glossary

Sys Admin

S073

View Assessment Summary

Organisation
User

S136

View Assessment Summary


Target Score

Organisation
User

S077

Look and Feel

General User

S104

Look and Feel v2

General User

S078
S096

Improved Navigation
Improved Navigation Information Mapping

General User
Information
Mapping User

S074

Navigate to Views Maintenance

XYZ ABC User,


Organisation
Administrator

S079

Home Page

General User

S091

Next Deadline Info

Logged In User

S125

View Submission Deadline on


Performance Update

Organisation
Admin

S092
S093
S090

Log In
Log Out
Register For an Account

General User
Logged In User
General User

S089
S083
S097

Contact Us
View "About" Info
Improved Navigation - Widgets

General User
General User
General User

S098

Home Page - What Next

Logged In User

S075

Search Knowledge Base

General User

S105

Context Sensitive Help


Mechanism

Developer

S108

Look & Feel - Widget Details

General User

S110

Can't Enter Widget Level


Comments

Organisation
User

S111

Smaller PQR Assurance


Statement Pop-up

Organisation
User

S112

Submission Email Log

Organisation
User

S117

Specify A Widget Owner

Organisation
Administrator

S113

Add Improvement Action

Organisation
User

S138

View Improvement Actions

XYZ ABC User

S114

Produce Improvement Plan and


Evidence Report

Organisation
User

S116

Send Ad-hoc Improvement


Action Reminders

Organisation
Admin

S115

Send Regular Improvement


Action Reminders

Organisation
Admin

S121

View Past Attainment Level

Organisation
User

S122

Set Target Attainment Level and Organisation


Date
User

S137

Set Target Attainment Level of


0, NR or EX

Organisation
User

S123

Mark Widget as Complete

Organisation
User

S124

Mark Widget as Confirmed

Organisation
Reviewer

S127

Odds and Ends

General User

S128

Unsubmit Baseline/Performance XYZ ABC User


Update: Changed Permissions

S129

Submit Baseline/Performance
Update Warnings

S130

Can't Delete Widget Owner User Organisation


Admin, XYZ ABC
User

S132

Beta Test Phase 1 Defects

General User

S133

Odds and Ends 2

General User

S135

Organisation Type Names

General User

S141

PQRT Release Cycle Info in


Approval Email Text

Organisation
Admin

S150

View Widget from Performance


Progress Report

Organisation
User

S153

View Widget Containing Table

General User

S154

View Widget Containing Main


Heading

General User

S157

View Widget Containing


Hyperlink

General User

S155

Incorporate Exemptions into


Report Scores

General User

Organisation
Admin

S156

Sumbit Assessment (Simplified


Interface)

Org User

S158

View Exemption in Widgets List

Org User

S159

View Assessment as an XYZ ABC XYZ ABC User


User

S161

Receive Dirty Flag Warning for


Widget

Org User

S103

Look & Feel - Forgotten User


Details

General User

S173

Assessment Summary Mark 2

Organisation
User

S176

Auto Create Assessment

Organisation
User

S166

Widget Details Page


Enhancements

General User

S183

Widget Details Page Callouts

Organisation
User

S167

Widget PDF Enhancements

General User

S169

Contact Us Page Mark 2

General User

S170

Registration Mark 2

General User

S171

Home Page Mark 2

General User

S174

Greyed Out Submit Buttons

Organisation
User

S175

Widgets List Mark 2

Organisation
User

S085

View Quick Start Guide

General User

S181

Odds and Ends 3

General User

S182

Maintain Users (Simplified


Interface)

Organisation
User

S184

Add Improvement Action


Usability

Organisation
User

S142

View Improved Assessment


Report

General User

S143

View Improved Assessment


Report (Own Org)

General User

S144

View Improved Assessment


Report - Breakdown by
Attainment Level

General User

S145

View Improved Assessment


Report - Stages and Targets

Organisation
User

S146

View Improved Assessment


General User
Report - Breakdown by Initiative

S177

New Org Type: Eyecare

General User

S084

View "Accessibility" Info

General User

S087

Alternative Browser Support

General User

S086
S094

View Terms & Conditions


View Updated Registration
Terms & Conditions

General User
General User

S206

Widget Number Prefix

General User

S207

Upload Evidence Last Chance


Saloon

Organisation
User

S185
S208

Miscellaneous Defects
Better Call-Outs on Widget
Details Page

Developer
Organisation
User

S109

Context Sensitive Help

General User

S202

Odds and Ends 4

General User

S203

Publish Widgets Without PDFs

Sys Admin

S190
S205

View Help Topics


General User
Improved Local File Specification Organisation
User

S147

View Improved Assessment


Report - HTML Version

General User

S148

Publish Widgets - Spreadsheet


(Report Sheet)

Sys Admin

S212

User Friendly Error Page

General User

S201

Publish Knowledge Base


Enhancements

Sys Admin

S209

Odds and Ends 5

General User

S210
S198

Misc Defects 2
Upload Audit Report

Developer
Organisation
Auditor

S199

Mark Widget as Audited

Organisation
Auditor

S200

View Widget Audit Stats

Organisation
Auditor

S066

Publish Knowledge Base

Sys Admin

S065

Publish Widgets - Online Version Sys Admin

S081

Publish Glossary (Advanced)

Sys Admin

S160

View Assessment as a General


User

General User

S165

View Assessment as a General


User (Mark 2)

General User

S152

View Improved Assessment


Report - Breakdown by Key
Widget Status

General User

S187

Accessibility

General User

S106

Publish Widgets - Spreadsheet


(List Sheet)

Sys Admin

S107

Publish Widgets - Spreadsheet


(Details Sheet)

Sys Admin

S172

Look and Feel Mark 3

General User

S204

Tri State Tick Boxes on Widget


Details Page

Organisation
User

S215
S214

Misc Defects 3
Odds and Ends 6

Developer
General User

S178
S179

New Org Type: Thingy HQ


XYZ ABC User
Import Thingy HQ Relationships Sys Admin

S180

View Thingy Reports as Thingy


HQ

Organisation
User

S189

Assessment Report - Graphs

General User

S195

Assign Organisation Auditor Role Organisation


Admin

S196

Organisation Auditor
Permissions

Organisation
Auditor

S197

Mark Assessment As Audited

Organisation
Auditor

S192

Approve Bulk Email

XYZ ABC User

S193

View Number of Recipeients for


Bulk Emails

XYZ ABC User

S188

Validate Email Address

General User

S213

Forgotten User Details


Enhanced

General User

S164

Use the Browser Back Button

General User

S211

Enter Own Password in


Registration

General User

S162

View Improved Assessment


Report - Drill Down on
Breakdown

General User

S040

Grant Criterion Exemption

XYZ ABC User

S041

Grant Criterion Exemption to


Org Type

XYZ ABC User

S042

View Criterion Exemption

Organisation
User

S043

Determine Current Attainment


Assessment
Level Given Criterion Exemption Completer

S168

View Widget PDF Variants

General User

S035

Capture Date Last Modified

Organisation
User

S048

Jump To Widget

Organisation
User

S054

Review My Assessment

Organisation
User

S055

Review Submitted Assessment

XYZ ABC User

S062

View Undelivered Bulk Emails

XYZ ABC User

S088

File Viewers

General User

S095

Show Environment Name and


Build Number

S118

Specify a Second Widget Owner Organisation


Administrator

S119

Auto Complete Improvement


Action Owners

Organisation
User

S120

Capture Improvement Action


Completion Audit Trail

Organisation
User

S134

Publish Tool Config Refactor

Developer

S216
S217
S218
S219
S220
S221

General User

I can... (Goal)

Status

Have the system log me out if I do not use


it for a period

Live

Receive a warning before I submit my


assessment

Live

Receive an e-mail confirming my


assessment submission

Live

Priority

Dependencie
s

View a record of the sending of an approval Live


e-mail
Send thingy-specific "new user" e-mails
when I create user accounts

Live

Be able to answer "not relevant" for certain Live


requirements
View an amended thingy Knowledge Base
document

Live

View helpdesk details in any page footer

Live

View helpdesk details when self registering Live


for a Thingy
Add and amend general comments for my
requirement response

Live

Better understand the requirements list

Implement

Must

View key information about a (v8+)


requirement

Implement

Must

View the requirement description for a


(v8+) requirement

Implement

Must

View the guidance text for a (v8+)


requirement

Implement

Must

View and access the knowledge base


resources that are relevant to a (v8+)
requirement

Implement

Must

View the requirement origins for a (v8+)


requirement

Implement

Should

View a list of material changes that have


been made in this (major) version of the
(v8+) requirements

Implement

Should

View the training tool text for a (v8+)


requirement

Implement

Should

View (v8+) requirement-specific training


tool text

Implement

Should

View attainment levels and attainment


criteria for a (v8+) requirement

Implement

Must

S075

View standard evidence types against each Implement


attainment criterion

Must

S020

Expand or collapse the various sections of


the (v8+) requirement page

Implement

Must

S014-S020

Indicate that a (v8+) requirement is not


relevant to my organisation

Implement

Must

Enter comments for an attainment criterion Implement

Must

Add a custom evidence type to an


Implement
assessment criterion (because the standard
evidence types are not appropriate for me)

Must

Indicate that I have obtained a particular


evidence type

Implement

Must

Enter comments against a specific


evidence type

Implement

Must

Specify an external location for my


evidence

Implement

Should

Specify an external location for my


evidence (improved UI)

Implement

Must

Upload evidence to the PQRT server

Implement

Should

View evidence files that I have previously


specified in my requirement response

Implement

Should

S028, S030

Indicate that an evidence type is a


duplicate of another one I've already
specified (and cross reference it)

Withdrawn

Must

S029

View duplicate evidence files that I have


previously specified in my requirement
response

Withdrawn

Should

Be prevented from deleting custom


evidence which is referenced from
elsewhere

Withdrawn

Must

Specify an existing uploaded evidence file


against another evidence item

Withdrawn

Must

Specify an existing uploaded evidence file


against another evidence item
(enhanced/simplified version)

Implement

Must

S028, S030

Configure whether evidence provision is


mandatory or optional for each org type

Implement

Must

Indicate a given attainment criterion as


achieved either directly or indirectly

Implement

Must

Explicitly indicate that my organisation is at Implement


Attainment Level 0

Must

Have the system determine my current


attainment level for a given requirement

Implement

Must

Have the system determine the status of


my requirement response

Implement

Must

Grant an exemption from a requirement to


an organisation

Implement

Must

View a requirement exemption granted to


my organisation

Implement

Must

Grant an exemption from a mandatory


evidence type to an organisation

Withdrawn

Could

Grant an exemption from a mandatory


evidence type to all organisations of a
specific type

Withdrawn

Could

S044

View an evidence exemption granted to my Withdrawn


organisation

Could

S044

Save changes I have made to my


requirement response

Implement

Must

View a printable/downloadable version of a Implement


requirement

Must

Download printable versions of


Implement
requirements in bulk, for viewing off-line or
for printing out

Must

Download printable versions of


Implement
requirements in bulk, for viewing off-line or
for printing out (specifically, per-initiative
booklets)

Should

Download the requirement set as a


spreadsheet for offline working

Implement

Must

Create bulk emails to be sent to users


Attach files to pending bulk emails
Have the system send all due bulk emails

Implement
Implement
Implement

Must
Must
Must

S056
S056

View bulk emails (both sent and pending)

Implement

Must

S056, S058

Amend a pending bulk email

Implement

Must

S059

S033, S034

S038

S050

Delete a pending bulk email


View a sent email
Have a nice look & feel for the bulk email
function

Implement
Implement
Implement

Must
Must
Should

S059
S059
S056, S057,
S058, S059,
S060, S061

View the definition of a term that is defined Implement


in the glossary

Must

S064

Identify glossary terms in the printable


version of a requirement

Implement

Must

S022

View the entire glossary


View a printable/downloadable version of
the glossary

Implement
Implement

Must
Must

Publish or re-publish the printable versions Implement


of the requirements

Could

S065

Publish or re-publish the ZIP file downloads Implement


for the requirements

Could

S065

Publish or re-publish the booklet downloads Implement


for the requirements

Could

S065

Publish or re-publish the per-initiative


booklet downloads for the requirements

Implement

Could

S065, S076

Publish or re-publish the XL spreadsheet


download for the requirements (simple
version to prove technology)

Implement

Must

S065

Publish or re-publish the booklet downloads Withdrawn


for the requirements, including a glossary
section

Could

S100, S101

Publish a new version of the glossary based Implement


on the data held in RAT

Must

View summary data about my assessment

Implement

Should

View my target score along with my


assessment summary

Implement

Should

Use the application easily and without


aesthetic insult to my eye

Implement

Must

Have an enhanced aesthetic experience,


with lovely soft curves caressing my visual
senses

Implement

Must

S077

Navigate the site more easily


Be able to navigate to the information
mapping functions

Implement
Implement

Must
Must

S078

Be able to access the Views Maintenance


function

Withdrawn

Should

View information on the home page

Implement

Must

Find out when my next assessment


deadline is

Implement

Should

Be told the (correct) submission deadline


when I do a Performance Update

Implement

Must

Log in to the system


Log out from the system
Register for an PQRT account

Implement
Implement
Implement

Must
Must
Should

S079
S079, S092

Contact XYZ ABC about the PQRT


Implement
Read general information about PQRT
Implement
Navigate more sensibly to the requirements Implement
list page

Must
Must
Should

S078
S078

Once I have logged in, view instructions on Implement


what I can do next

Must

Search for knowledge base documents


based on various criteria

Implement

Must

Implement context sensitive help in a


straightforward and flexible manner

Implement

Must

Have a nice look & feel for the requirement Implement


details page

Must

Not enter requirement-level comments for


a (v8+) requirement

Implement

Must

Be able to view the PQR Assurance


Statement Pop-up on an 800x600 screen

Implement

Must

View a record of the sending of an


submission e-mail

Implement

Must

Specify a user from my organisation as the Implement


owner for a given requirement

Should

Add an improvement action against a


specific attainment criterion

Implement

Should

View improvement actions

Withdrawn

Must

Produce an improvement plan for my


organisation

Implement

Should

Send ad-hoc email reminders to


requirement owners with outstanding
improvement actions

Implement

Should

Send regular email reminders to


requirement owners with outstanding
improvement actions

Implement

Could

View my attainment level for a (v8+)


requirement on my previous assessment

Implement

Must

S016

Set a target attainment level and date for a Implement


given (v8+) requirement

Must

Set a target attainment level of 0, NR or EX Implement

Must

Mark a (v8+) requirement response as


complete

Implement

Must

Mark a (v8+) requirement response as


confirmed

Implement

Must

See a range of random and unrelated point Implement


improvements across the site

Could

Unsubmit baselines and performance


updates whereas organisation admins
cannot

Implement

Must

Receive warnings when submitting


baselines and performance updates

Implement

Must

Not delete a user who is a requirement


owner

Implement

Must

See various defects/issues resolved that


appeared in Beta Test Phase 1

Implement

Must

See a range of random and unrelated point Implement


improvements across the site

Should

See better, shorter names for organisation


types

Implement

Must

Receive a message about the PQRT release Implement


cycle as part of the approval email

Must

View the correct "guidance" document from Implement


the Performance Progress Report for a v8+
assessment

Must

View a (v8+) requirement with a table


within the guidance text

Implement

Must

View a (v8+) requirement with a main


heading within the guidance text

Implement

Must

View a (v8+) requirement with a hyperlink


within any RATML field

Implement

Must

Have the system take exemptions into


account when calculating overall % scores

Implement

Must

Submit my (v8+) assessment once I have


entered a score for each requirement

Implement

Must

View the fact that I have been exempt from Implement


a requirement in the requirements list

Must

View an organisation's assessment details Implement


as an XYZ ABC user, with the relevant fields
visible but read-only

Must

Receive a warning if I attempt to leave the


Widget Details page without saving my
changes

Implement

Should

Get help with forgotten user details (org


code, user ID, password)

Implement

Should

See various enhancements as suggested


during Beta Test Phase 1

Implement

Must

Have the user auto create a new


assessment for me instead of having to
create it myself

Implement

Must

See various enhancements as suggested


during Beta Test Phase 1

Implement

Should

See "help" callouts on the requirement


details page

Implement

Should

See various enhancements as suggested


during Beta Test Phase 1

Implement

Should

See various enhancements as suggested


during Beta Test Phase 1

Implement

Should

See various enhancements as suggested


during Beta Test Phase 1

Implement

Should

See various enhancements as suggested


during Beta Test Phase 1

Implement

Should

See greyed out submit buttons on the


Assessment Summary page

Implement

Must

See various enhancements as suggested


during Beta Test Phase 1

Implement

Should

Get up to speed with using PQRT as quickly Implement


as possible

Must

See a range of random and unrelated point Implement


improvements across the site

Must

Create, amend and delete users within my


organisation user (using the simplified
interface)

Implement

Should

Be able to add improvement actions more


easily, with less reliance on pop-ups

Implement

Could

View an organisation's Assessment Report


with various enhancements

Implement

Must

View an organisation's Assessment Report


with various enhancements

Implement

Must

S142

View an organisation's Assessment Report


broken down by attainment level

Implement

Must

S142

View an organisation's Assessment Report


including baseline, performance update
and target scores

Implement

Must

S142

View an organisation's Assessment Report


broken down by initiative

Implement

Must

S142

Be able to view requirements and complete Implement


assessments for eyecare organisations

Should

Read information about PQRT accessibility

Implement

Must

Use the application via all XYZ ABC


supported web browsers

Implement

Must

View PQRT terms & conditions


View updated Terms & Conditions when
registering for an PQRT account

Implement
Implement

Must
Should

See the major version number as a prefix


to the requirement number (v8+ only)

Implement

Must

Be less confused when uploading evidence Implement

Should

S078

S078

Left over defects not yet fixed


Experience better call-out help on the
Widget Details page

Implement
Implement

Must
Could

Receive context sensitive help as


necessary across the whole site

Implement

Must

See a range of random and unrelated point Implement


improvements across the site

Must

Be able to publish the requirements without Implement


generating all the PDF files (to save time)

Should

View various help topics


Be able to type the file name, see the full
path view "local file" evidence

Implement
Withdrawn

Must
Should

Create an HTML version of the assessment


report

Implement

Should

S142-S146,
S152

Publish or re-publish the XL spreadsheet


download for the requirements (report
sheet)

Implement

Could

S107

Receive a user friendly error message when Implement


a system error occurs, including a reference
number to help ABC diagnose the problem

Should

Be able to republish the knowledge base


without wiping out links with requirements

Should

Implement

S105

See a range of random and unrelated point Implement


improvements across the site

Could

Left over defects not yet fixed


Upload an audit report for a give
assessment

Implement
Withdrawn

Must
Should

Mark individual requirements as audited

Withdrawn

Could

View statistics on the auditing of individual Withdrawn


requirements

Could

Publish a new version of the Knowledge


Base based on the data held in RAT

Test (Low)

Must

S075

Publish a new version of the requirements


based on the data held in RAT

Test (Low)

Must

S022, S066

Publish a new version of the glossary based Fix (Low)


on the data held in RAT (advanced version
including PDF generation within PQRT)

Could

View an organisation's assessment details


as a General user, with the relevant fields
visible but read-only

Fix (Low)

Must

View an organisation's assessment details


as a General user, with the relevant fields
visible but read-only

Fix (Low)

Should

View an organisation's Assessment Report


broken down by key requirement status

Fix (Low)

Should

Be able to access the site as a disabled


user

Fix (Low)

Must

Publish or re-publish the XL spreadsheet


download for the requirements
(requirements list sheet)

Fix (Low)

Must

S151

Publish or re-publish the XL spreadsheet


download for the requirements
(requirements list sheet)

Fix (Low)

Must

S106

Experience a yet further enhanced look and Fix (Low)


feel

Should

See "really" disabled tick boxes as greyed


out but see "auto tick by system" tick
boxes as not greyed out

Could

Fix (Low)

Left over defects not yet fixed


Fix
See a range of random and unrelated point Dev
improvements across the site

Could

Set up Thingy HQ users


Import relationships between pharmacies
and pharnacy HQs from TDB

Dev
Dev

Must
Must

Be able to view Performance Performance


Reports of Pharmacies as a Thingy HQ

Dev

Must

View graphs within my Assessment


Summary XL file

Dev

Should

Assign the "Organisation Auditor" role to


users within my organisation

Dev

Should

Access existing functions as appropriate to Dev


my status

Should

Mark an assessment as audited

Dev

Should

Approve a bulk email to be sent

Dev

Should

S067, S082

S142

See roughly how many users bulk emails


will be sent to

Dev

Should

Improve email validation within the


Dev
registration process by sending an email to
the user and forcing them to acknowledge
it

Should

Receive user details reminders for multiple Dev


accounts and with a more secure password
reset solution

Should

Have the browser "back" button operate


more gracefully

Req

Could

Enter my own password during registration Dev

Could

Drill down into the details of an assessment Dev


report for specific breakdown figures (e.g.
Key requirements met/not met)

Could

Grant an exemption from an attainment


criterion to an organisation

Dev

Should

Grant an exemption from an attainment


criterion to all organisations of a specific
type

Dev

Could

View a criterion exemption granted to my


organisation

Dev

Should

S040, S041

Have the system determine my current


attainment level for a given requirement,
given that I have a criterion exemption

Dev

Should

S040, S041

Be able to select from three variants of the Dev


requirement PDF

Could

Have the system capture and display the


"date last modified" for each individual
attainment criterion

Dev

Should

Navigate quickly from one requirement to


another

Req

Could

Review all the details I have entered for my Req


(v8+) assessment so far

TBC

Review a submitted (v8+) assessment prior Req


to approval

TBC

View a list of undelivered bulk emails so


that I can consider whether to amend user
details

Req

Could

Get access to the various file viewers I


need to view PQRT files (e.g. Acrobat
Reader)

Req

Could

S147

See which (non live) environment I am


Dev
connected to and also which software build
I am using

Should

Specify a user from my organisation as the Req


second owner for a given requirement

Could

Have the system auto complete the


improvement action owner as I type

Req

Could

Have the system capture and display the


Req
date and user who marked an improvement
action as complete

Could

Have a simplified configuration structure


for the Publish Tool

Could

Dev

S117

Story Points Dev


Dev Owner Dev
Increment
Complete
Date

Actual Dev Time Fixing


Time
Defects (man
(man days) days)

v7.3
v7.3
v7.3
v7.3
v7.3
v7.3

v7.3
v7.3
v7.3
v7.3
2 v8.0 (i1)

CC

2/4/2010

2 v8.0 (i1)

CC

1/26/2010

0.5 v8.0 (i1)

CC

1/27/2010

0.25 v8.0 (i1)

CC

1/27/2010

2 v8.0 (i1)

CC

1/29/2010

0.5 v8.0 (i1)

CC

1/27/2010

0.5 v8.0 (i1)

CC

1/27/2010

0.25 v8.0 (i1)

CC

1/28/2010

0.25 v8.0 (i1)

CC

1/28/2010

3 v8.0 (i2)

CC

2/24/2010

5 v8.0 (i2)

RJM

2/23/2010

5.5

2 v8.0 (i1)

CC

1/27/2010

1 v8.0 (i2)

CC

2/25/2010

1 v8.0 (i2)

CC

3/5/2010

4 v8.0 (i2)

RJM

3/8/2010

2 v8.0 (i2)

RJM

3/1/2010

2 v8.0 (i2)

RJM

3/2/2010

5 v8.0 (i3)

RJM

3/19/2010

2 v8.0 (i4)

RJM

4/7/2010

3 v8.0 (i4)

RJM

4/14/2010

2 v8.0 (i4)

RJM

4/16/2010

4 N/A

RJM

1 N/A

RJM

2 N/A

RJM

4 v8.0 (i5)

RJM

4/23/2010

1 v8.0 (i5)

RJM

4/30/2010

0.5 v8.0 (i3)

NL

3/18/2010

0.5

6 v8.0 (i3)

CC

3/23/2010

1.5 v8.0 (i3)

CC

3/18/2010

1.5

5 v8.0 (i3)

RJM

3/23/2010

1 v8.0 (i3)

NL

3/18/2010

0.25

3 v8.0 (i4)

RJM

4/19/2010

1 v8.0 (i4)

RJM

3/31/2010

0.5 v8.0 (i3)

RJM/CMC

3/25/2010

0.5

0.5 v8.0 (i2)

NL

2/22/2010

1.5

2 v8.0 (i2)

NL

3/4/2010

1 v8.0 (i2)

NL

3/4/2010

0 v8.0 (i3)

NL

3/8/2010

5 v8.0 (i1)
3 v8.0 (i2)
5 v8.0 (i5)

DES
DES
DES

2/10/2010
3/5/2010
5/14/2010

4.5

1 v8.0 (i1)

DES

2/12/2010

1.5 v8.0 (i1)

DES

2/12/2010

N/A

N/A

N/A

0.5 v8.0 (i1)


1 v8.0 (i1)
1 v8.0 (i5)

DES
DES
DES

2/12/2010
2/12/2010
5/14/2010

3 v8.0 (i1)

RJM

2/4/2010

0 v8.0 (i4)

TM

4/12/2010

RJM
RJM

2/8/2010
2/17/2010

0.5

4 v8.0 (i4)

TM

4/16/2010

3 v8.0 (i4)

TM

4/22/2010

4 v8.0 (i4)

TM

4/16/2010

2 v8.0 (i4)

TM

4/16/2010

2 v8.0 (i5)

TM

4/29/2010

2.5 v8.0 (i1)

RM

2/11/2010

6 v8.0 (i4)

NL

4/21/2010

1 v8.0 (i5)

NL

4/28/2010

6 v8.0 (i2)

TM

2/25/2010

5 v8.0 (i2)

TM

3/4/2010

2 v8.0 (i2)
1 v8.0 (i3)

DES
NL

2/18/2010
3/19/2010

2
0.5

TM

2/24/2010

2 v8.0 (i1)
0.5 v8.0 (i2)

N/A

N/A

2 v8.0 (i2)

3 v8.0 (i3)

NL

3/26/2010

0.5 v8.0 (i3)

NL

3/23/2010

2 v8.0 (i2)
1 v8.0 (i2)
2 v8.0 (i2)

TM
TM
DES

2/25/2010
2/24/2010
3/5/2010

1
0.5
3.5

2 v8.0 (i2)
0 v8.0 (i5)
1 v8.0 (i3)

DES
NL
NL

2/23/2010
5/7/2010
3/23/2010

2.5
0.25
0.5

2 v8.0 (i3)

NL

3/19/2010

0.75

5 v8.0 (i3)

DES

3/23/2010

2 v8.0 (i3)

RJM

3/24/2010

5 v8.0 (i3)

RJM

3/16/2010

0 v8.0 (i4)

CC

3/29/2010

0.25 v8.0 (i3)

CC

3/16/2010

0.25

0.25 v8.0 (i3)

CC

3/16/2010

0.25

3 v8.0 (i4)

DES

4/1/2010

3.5

5 v8.0 (i4)

DES

4/13/2010

6.5

6 v8.0 (i4)

DES

4/20/2010

4 v8.0 (i5)

DES

5/5/2010

4 v8.0 (i5)

DES

5/10/2010

4.5

0.5 v8.0 (i3)

RJM

3/25/2010

0.5

N/A

0.5 v8.0 (i4)

RJM

3/30/2010

1 v8.0 (i5)

RJM

4/26/2010

0.5

3 v8.0 (i5)

RJM

4/27/2010

2 v8.0 (i5)

RJM

4/27/2010

2 v8.0 (i4)

CC

4/15/2010

0.5 v8.0 (i4)

NL

4/9/2010

0.5

1 v8.0 (i4)

NL

4/9/2010

0.5

0.5 v8.0 (i5)

NL

4/22/2010

0.5

v8.0 (i5)

CC

4/26/2010

5 v8.0 (i5)

CC

5/13/2010

0.5 v8.0 (i5)

NL

4/22/2010

0.5

0 v8.0 (i5)

NL

4/22/2010

1 v8.0 (i5)

NL

5/10/2010

0.5

0 v8.0 (i5)

TM

5/5/2010

0.5 v8.0 (i5)

TM

5/5/2010

0 v8.0 (i5)

TM

5/5/2010

2.5 v8.0 (i5)

NL

5/14/2010

1.5

3 v8.0 (i5)

NL

5/12/2010

1 v8.0 (i5)

RJM

4/30/2010

0.5

0.5 v8.0 (i5)

RJM

4/27/2010

0.5

2 v8.0 (i5)

RJM

4/30/2010

0.5

2 v8.0 (i5)

NL

5/7/2010

1.5 v8.0 (i5)

CC

5/18/2010

0 v8.0 (i5)

CC

5/13/2010

0.5

2 v8.0 (i6)

RJM

5/21/2010

2 v8.0 (i6)

RJM

6/4/2010

2 v8.0 (i6)

CC

5/26/2010

0.5 v8.0 (i6)

DES

5/18/2010

1 v8.0 (i6)

DES

5/19/2010

3 v8.0 (i6)

DES/CMC

6/4/2010

0 v8.0 (i6)

CC

5/18/2010

0.5

2 v8.0 (i6)

RJM

5/25/2010

0.5 v8.0 (i6)

RJM

6/4/2010

0.5

2 v8.0 (i6)

0.5 v8.0 (i6)

6/4/2010

CMC

5/27/2010

2 v8.0 (i6)

RJM

5/28/2010

4 v8.0 (i6)

CC

5/27/2010

3.5

2 v8.0 (i6)

CC

5/27/2010

0.5

3 v8.0 (i6)

CC

5/28/2010

0.5

2 v8.0 (i6)

CC

6/1/2010

5 v8.0 (i6)

CC

6/2/2010

0.5 v8.0 (i6)

CC

5/27/2010

0 v8.0 (i7)

RJM

6/17/2010

1.5 v8.0 (i7)

RJM

6/15/2010

1.5

0 v8.0 (i7)
0 v8.0 (i7)

RJM
RJM

6/17/2010
6/18/2010

0
0

CC

6/18/2010

0.5

RJM

6/22/2010

0.5 v8.0 (i7)

1 v8.0 (i7)

v8.0 (i7)
1 v8.0 (i7)
1 v8.0 (i7)

RJM

6/25/2010
6/23/2010

RJM

6/11/2010

3 v8.0 (i7)

6/25/2010

1 v8.0 (i7)

TM

6/18/2010

0.5 v8.0 (i7)


N/A

NL

6/24/2010

0.5

3 v8.0 (i8)

CC

7/21/2010

5 v8.0 (i8)

TM

7/5/2010

4.5

1 v8.0 (i8)

RJM

7/1/2010

3 v8.0 (i8)

TM

7/21/2010

DES

3/17/2010

TM

3/30/2010

2 v8.0 (i8)
v8.0 (i8)
2 N/A
3 N/A
1 N/A
6 v8.0 (i3)

12 v8.0 (i3)

3.5

4 v8.0 (i1)

RM

2/12/2010

2 v8.0 (i5)

RJM

4/29/2010

0.5 v8.0 (i5)

RJM

4/30/2010

6/1/2010

0.5

3 v8.0 (i6)

CC

2 v8.0 (i7)

RJM

6/17/2010

2 v8.0 (i7)

TM

6/10/2010

7 v8.0 (i7)

TM

6/23/2010

2 v8.0 (i7)

DES

6/25/2010

1 v8.0 (i8)

RJM

6/30/2010

1.5
1

2
0.5
2
1
2

1
3

2
1
3

CC

CC

Notes

Beta Test
Phase

Phase 1
Phase 1
Phase 1
Phase 1
Phase 1

Phase 1
Phase 1

Phase 1

Tester

Phase 1
Phase 1

Phase 2
Much more complicated than Phase 1
initially estimated for
more complicated than
Phase 1
originally thought. Required
integration with main page
for testing save functionality
Phase 1
Phase 1
Phase 1
Was more complex than
anticipated, plus all of the
associated bubbling of
events needed to be
changed.

Phase 1

Phase 2
Phase 2

N/A

N/A

N/A

Superseded by S163

N/A

Phase 2

N/A

Phase 1

Phase 1
Phase 1

Phase 2

N/A

N/A

N/A
0.5 days. Most of the
functionality was already
implemented through other
stories.

Phase 1

nili: Time Taken includes


configuration and set-up
time

Phase 1

Phase 2

Phase 2

Phase 2

NL

Phase 1
Phase 2
Phase 1

Phase 2
Phase 2
Phase 2
Phase 2

Phase 2

Decided we don't want to


include a 30 page glossary
at the end of every booklet

N/A

Phase 2
Phase 2
Phase 1
Phase 1

Phase 1
Phase 1
Delay until we agree
N/A
whether we are getting rid of
Views
Phase 1

Phase 1
Incorporated Full-text search Phase 1
Phase 1
Phase 1
Phase 1

Phase 1
Phase 1
Phase 1
N/A

N/A
Phase 2
Had some issues with the
jQuery Datepicker
formatting.

Phase 2

N/A
Phase 2

EP

Phase 2

EP

Phase 2

EP

Problem with persisting


Phase 2
related data to the database.
Found bug in v7 fixed with
CMC help.
Phase 2

Phase 1

WidgetOwner is already
checked, but there were a
number of other tables
which referenced the
OrganisationUserID which
were not being checked.

actual dev time includes


time for work done for S141
actual dev time included in
time for work done for S135

Nb CMC also spent some


time on this

More than estimate as


Phase 2
existing screen wasnt fully
working therefore extra
effort was required to rework/fix existing
functionality. Hence spilled
over into Increment 5 period
by a day or so

CMC:Was actually bit longer Phase 2


from when gave estimate as
encompassed the new
"Reset" functionality on
assessment details page.
Have also changed the
description for auto-created
assessments to match the
new Version 8 (2010-2011)
format

Phase 2
Phase 2
Phase 2

Had to completely re-write


the entire wizard to
implement the 'primary key'
CSS
Phase 2

More than estimate owing to Phase 2


fact that the tooltip wordings
were status specific
Phase 2
Phase 2
Phase 2
(priority
"Highest"
items only)

Phase 2

Phase 2

NL

Phase 2

NL

Phase 2

NL

Phase 2

NL

Phase 2

NL

Phase 2

Needs to include markup to


force IE8 to operate in IE7
compatibility mode

EP

EP

EP
1 day sofar. Implemented on Phase 1
a number of pages specified
in the ContextHelp.xml file

See the ebay "Easy Lister"


photo upload pop-up for an
example of showing the full
path name.

Including integrating with


the Ratty tool and
Developing Staging
Database build project
Phase 2

EP

Phase 2

NL

EP
Phase 2

Phase 2

GT
GT

N/A

Story
ID

Story Name

As a... (Actor)

I can... (Goal)

Flow

Step When I... (Action)

S012

View Widgets List


(Enhancements)

General User

Better understand the


widgets list

Main

Then... (Acceptance Criterion)

Prototyped Agreed
PW/MG

The column headings indicate what happens


when the column content is clicked

11/18/2009

Agreed TUG Agreed Dev Notes

11/25/2009 CMC

Test Status Defect

Pass

Column 1 header is "Req No" (previously "Seq


No")

11/18/2009

11/25/2009 CMC

Pass

The widgets are grouped by initiative (with


initiative sub-headers and colour coding)

11/23/2009

11/25/2009 CMC

Pass

A new column "Key Req" indicates whether key


widget (including use of icons and/or colour)

11/23/2009

11/25/2009 CMC

CMC: Will need to have ALT text for the Pass


Icon as well for accessibility

For each answered key widget, the Attainment


Level column includes a "status" indicator
showing whether or not Attainment Level 2
reached

11/23/2009

11/25/2009 CMC

CMC: Again also needs ALT text for icon Pass

Pass

S013

S014

View Widget Header


Information (v8+)

View Widget Description


(v8+)

General User

General User

View key information


about a (v8+) widget

View the widget


description for a (v8+)
widget

Main

Main

View Widget Guidance Text General User


(v8+)

View the guidance text for Main


a (v8+) widget

The header panel is re-organised to list key data Y


down the RHS (widget no, initiative, whether key
widget, org type, widget version number)

11/16/2009

11/25/2009 CMC

The version number is of the format


Y
<major>.<minor> e.g. 8.0. Note that individual
widgets in the same set can be at different minor
versions.

11/30/2009

3/17/2010 CMC

The HORUS categorisation is removed


(this only applies for v8+ widgets - it is to be
retained for v7- widgets)

11/16/2009

11/25/2009 CMC

TBC knock-on effect on TDB. CMC Will Pass


definitely have knock on effect on TDB
will require at the least some TDB
reports being pulled and at worst
changes to TDB data structures and
associated batch and SP processes as
well.

The MSPrPe categorisation is removed


(this only applies for v8+ widgets - it is to be
retained for v7- widgets)

11/16/2009

11/25/2009 CMC

Pass

The Category categorisation is removed


(this only applies for v8+ widgets - it is to be
retained for v7- widgets)

11/16/2009

11/25/2009 CMC

Pass

The header panel is colour coded to indicate


Y
which initiative it belongs to (see PQRT v8 Colour
Palette v1)

11/16/2009

11/25/2009 CMC

Pass

The header panel is colour coded to indicate


whether it is a key widget (see PQRT v8 Colour
Palette v1)

11/16/2009

11/25/2009 CMC

Pass

The widget description for the widget appears


below the header panel (heading: "Widget
Description"). This is the text that previously
appeared with the widget question in the blue
box on the Guidance Document.

11/18/2009

11/25/2009 CMC

Pass

The guidance text is presented (correctly


formatted)

11/18/2009

11/25/2009 CMC

Pass

The guidance text has paragraph numbers (for


easy reference)

11/16/2009

11/25/2009 CMC

Pass

There is a list of all knowledge base resources


relevant to the widget

11/18/2009

11/25/2009 CMC

Pass

The title of section is "Knowledge Base


Resources"

11/18/2009

11/25/2009 CMC

Pass

The resources are grouped into "Key Resources", Y


"Exemplars" and "Useful Websites"

11/18/2009

11/25/2009 CMC

Pass

5
6

The resources are tabulated


Each resource title is a hyperlink through to the
resource (be it a document on our server or an
external URL)

Y
Y

11/18/2009
11/18/2009

11/25/2009 CMC
11/25/2009 CMC

Pass
Pass

When a hyperlink is clicked, the resoruce is


displayed in a new tab or window

CMC

Pass

For each resource there is a description of the


resource to help users determine the content of
the resource and whether it will be useful to
them

11/16/2009

11/25/2009 CMC

Pass

For each resource there is an indicator indicating Y


whether the resource is located internally on the
PQRT website or whether it is on an external web
page (this gives the user a hint that the content
they are looking at is not "owned" by XYZ ABC)..

11/30/2009

11/25/2009 CMC

10

For each internally located resource, the file type Y


and size is displayed

11/30/2009

11/25/2009 CMC

There is a section containing the widget origins


(after the (optional) Training section)

11/16/2009

11/25/2009 CMC

The widget origins section is a bullet list of free


format text items

11/16/2009

11/25/2009 CMC

Request to view a specific (v8+) widget

Precondition: the relevant widget text


has been converted from RATML into
HTML by S065 (Import Widgets Data)

Request to view a specific (v8+) widget

Precondition: the relevant widget text


has been converted from RATML into
HTML by S065 (Import Widgets Data)

S016

S017

View Knowledge Base


Resources (v8+)

General User

View Widget Origins (v8+) General User

View and access the


Main
knowledge base resources
that are relevant to a
(v8+) widget

View the widget origins for Main


a (v8+) widget

View Widget Changes


(v8+)

General User

View a list of material


changes that have been
made in this (major)
version of the (v8+)
widgets

Main

1a

Request to view a specific (v8+) widget

Precondition: the relevant widget text


has been converted from RATML into
HTML by S065 (Import Widgets Data)

View Training Tool Text


(v8+)

General User

View the training tool text Main


for a (v8+) widget

S019

View Training Tool Custom General User


Text (v8+)

View (v8+) widget-specific Main


training tool text

View Attainment Levels


(v8+)

General User

View attainment levels


Main
and attainment criteria for
a (v8+) widget

CMC: (1) Currently alt text reads "Key


Widget Minimum Level Met/Not met".
Think this is a better wording as there is no
guarantee that 2 will remain as the min
level for key widgets.

It's showing the cross icon correctly but Medium


it's showing the key icon instead of the
tick icon

Closed

(2)You can test this as have set page to


display for V7 assessment sets in order to
allow testing. Suggest using V7
assessment for organisation code REM.

1) Paragraph indenting is out. The


Medium
answer here (I think) is to remove the 5
x &nbsp; at the beginning of each para
in the HTML.
2) In IE, the first H3 displays fine but
the second and subsequent ones are
indented and too small. It seems to be
because they are embedded within a
<ul> (but so is the first one!), because
if I close the <ul> before the <h3> and
open it again afterwards it's OK. But
then the paragraph numbering goes to
cock, unless youe explicitly use the
"Start" attribute of <ul>.

Closed

CMC:I copied the HTML as was given in the


prototype at the time of development. The
HTML which will get produced is really part
of the publish story, as such . not sure
there's too much point frigging with the
test HTML to get the result we want.
Propose leaving this till testing of the
publish process.
TH 16/3: I will attempt to "fix" these in the
prototype and then you can take the latest
cut of the prototype HTML
TH 22/3: fixed in prototype (see email from
me the other day) CMC 06/04 Think this is
now fixed looks ok to me with published
data from RATTY anyway
TH 12/04: the publish function may work
OK but the test data itself needs to be
valid, both for manual and automated
testing purposes
CMC 26/04 Guidance text fixed for Acute
Test widget 101

1) Order of tabs should be Key


Resources, Exemplar Materials, Useful
Web Sites

Pass

CMC: Needs investigation as to how


this will integrate with RATI tool

Pass

1/11/2010 N/A

CMC: Possible security access


implications as will need to access file
system to get this information.
TH: the fiel type and size will be in the
DB (calculated by RATty)

Medium

Closed

CMC:Fixed as part of reskin of widgets page

Visited weblinks are the same colour as Medium


not visited links (OK) but with no
underline (not OK)

Closed

CMC: Are now underlined as per re-skin of


widgets page
22/10 TH: Failed retest. Note that some
links are not underlined even before I have
visited them.

Pass

1) Can you put a tooltip on the external Low


web site link saying "External web site
link" (as per prototype)
2) Can you include the external website
link within the <a> tag so it is clickable
along with the link itself.

Closed

CMC: Ok have added tooltip to the a href


as well as the image and added the space,
try again.

Pass

Can you remove the leading dot e.g.


"DOC", not ".DOC"

Low

Closed

CMC:Data issue only, fixed in test data set


up script

Put a colon at the end of "The following Low


is a list..." instead of a full stop

Closed

Pass

Pass

1/12/2010 N/A

There is a section containing a list of material


changes to the current (major) version of the
widget

12/7/2009

3/17/2010 CMC

Pass

The section is a bullet list of free format text items Y

12/7/2009

3/17/2010 CMC

Pass

The "changes" section states that there are no


material changes in this version of the widget

12/7/2009

3/17/2010 CMC

Pass

Rather than saying, "The following is a Medium


list..." followed by a bulleted "There are
no material changes...", just say "There
are no material changes" (not bulleted)

Closed

The training tool text is displayed (after the


knowledge base resources)

11/30/2009

3/17/2010 CMC

Pass

1) Make link to training tool open in


new window
2) Put full stop after training tool link
(as per prototype)

Medium

Closed

The training tool text is *not* displayed (after the N


knowledge base resources)

11/30/2009

3/17/2010

Pass

Looking at the database table


WidgetOrganisationType, I can not see
a data field which indicates whether or
not the training tool text is required (in
RATTY it's called XXX). I'm therefore
guessing that this widget has not been
implemented

High

Closed

The widget-specific training tool text is displayed Y


as a paragraph immediately prior to the training
tool link.

12/7/2009

3/17/2010 CMC

Pass

Request to view a specific (v8+) widget

Precondition: the relevant widget text


has been converted from RATML into
HTML by S065 (Import Widgets Data)

CMC

CMC:This looks pretty odd if the


situation of 0 orgins does arise

Pass

Request to view a specific (v8+) widget


which has no material changes

Request to view a specific (v8+) widget


for which the training tool text is
relevant

Request to view a specific (v8+) widget


for which the training tool text is *not*
relevant

Request to view a specific (v8+) widget


for which the training tool text is
relevant and for which there is widgetspecific training tool text

Precondition: the relevant widget text


has been converted from RATML into
HTML by S065 (Import Widgets Data)

S020

Closed

The widget origins section is empty i.e. this case N


is treated as a bullet list with zero items in it (on
the basis that it is not expected to arise)

1a

Medium

1) Alt text should read "Attainment


Level 2 met/not met for Key Widget".

Request to view a specific (v8+) widget


which has no widget origins

S018

Defect Notes

Request to view a specific (v8+) widget

1a

S068

Defect
Status

Request to view a specific (v8+) widget

S015

Defect
Priority

Request to view the widgets list (any org


type)

Precondition: the relevant widget text


has been converted from RATML into
HTML by S065 (Publish Widgets Data)

Request to view a specific (v8+) widget

The Attainment Levels section is called


"Attainment Levels"

11/18/2009

11/25/2009 CMC

Pass

The Attainment Levels section is the last section Y


(so that the user is encouraged to view all the
guidance materials first)

11/18/2009

11/25/2009 CMC

Pass

The attainment levels 0-3 are displayed along


with the summary description for each.

For each attainment level, its "child" attainment


criteria are dispayed with their individual IDs (1a,
1b, 1c etc.)

The attainment level criteria are based on the


current improvement plan items - expressed as
an outcome instead of an action e.g.
"The Trust should document its current
arrangements..." has become
"The Trust's current arrangements are
documented..."

It is not possible for users to alter the criteria


(edit, add or remove)

2/5/2010 N/A

CMC

2/5/2010 N/A

CMC

Pass

Pass

11/16/2009

11/25/2009 CMC

CMC:Should be able to keep existing


Pass
AttainmentItemPlanTask data structure

11/16/2009

11/25/2009 CMC

Pass

CMC:Was a misinterpretation of the widget.


I thought it was only the custom text
which was conditional and thought that IO
could simply check whether it was null or
not. So to confirm if the Training Text
relevant flag is set you display the traing
text section and if theres some custom text
you also display that. Correct ?

2a

2b

Attainment Level 0 has standard text:


"Insufficient evidence to attain Level 1"

11/18/2009

11/25/2009 CMC

10

The screen layout is such that it is clear that the Y


criteria are cumulative (i.e. To get attainment
level 2 you need to achieve all attainment level 1
and 2 criteria)

11/18/2009

11/25/2009 CMC

Level 3 can include "maintenance" criteria (note: Y


these are criteria which only need to be achieved
if the organisation was at level 3 in the previous
year)

11/30/2009

11/25/2009 CMC

Pass

The maintenance criteria are explicitly identified Y


as being maintenance criteria

11/30/2009

11/25/2009 CMC

Pass

S049

Expand and Collapse


Widget (v8+)

General User

General User

View standard evidence


types against each
attainment criterion

Expand or collapse the


various sections of the
(v8+) widget page

Main

Main

2/8/2010 N/A

CMC

Pass

The maintenance criteria are displayed *after*


the main Level 3 criteria, in any order (the
business rule is that there should only ever be
one maintenance criterion, so irder isn't
important)

2/8/2010 N/A

CMC

Pass

"Not Relevant" is included as a valid Attainment


Level

11/30/2009

11/25/2009 CMC

Pass

There is some widget-specific text to explain


what "not relevant" means.

11/30/2009

11/25/2009 CMC

Pass

"Not Relevant" is *not* included as a valid


Attainment Level

11/30/2009

11/25/2009 CMC

Pass

Each attainment criterion has zero or more


"standard" evidence types associated with it.

11/16/2009

11/25/2009 RJM

Pass

All standard evidence types are mandatory


(optional evidence types were considered but
rejected) - although see story S081 re. evidence
type strengths

11/30/2009

11/25/2009 RJM

Pass

All "top-level" sections are expanded by default

11/18/2009

11/25/2009 CMC

Pass

There are options to individually collapse each


top-level section

11/18/2009

11/25/2009 CMC

Pass

There is an option to collapse all top-level


sections at once

11/30/2009

11/25/2009 CMC

Pass

There is an option to expand all top-level


sections at once

11/30/2009

11/25/2009 CMC

Pass

All "attainment criterion details" sections are


collapsed by default

11/18/2009

11/25/2009 CMC

Pass

There are options to individually expand the each Y


attainment criterion details section

11/18/2009

11/25/2009 CMC

Pass

The collapse button for each attainment criterion Y


details section is to the LHS of the attainment
criterion's "Achieved" tick box

11/30/2009 N/A

The section is collapsed

10

There is an option to expand the section, which


has replaced the option to collapse the section

12

The section is expanded

13

There is an option to collapse the section, which


has replaced the option to expand the section

Request to view a specific (v8+) widget

11/30/2009
11/30/2009

11/25/2009 CMC
11/25/2009 CMC

Pass
Pass

All top-level sections are expanded


There are options to individually collapse each
section, which have replaced the options to
collapse each section

Y
Y

11/30/2009
11/30/2009

11/25/2009 CMC
11/25/2009 CMC

Pass
Pass

The section is expanded

11/18/2009

11/25/2009 CMC

Pass

Works OK at first. Then if I expand one High


of the top level sections and then try to
expand an attainment level, it expands
then collapses again! Each time I
expand or collapse a top level section,
it adds another iteration fo expanding
or collapsing to the attainment level.
Weird, huh?

There is an option to collapse the section, which


has replaced the option to expand the section

11/18/2009

11/25/2009 CMC

Pass

Will test once above defect fixed

The section is collapsed


There is an option to expand the section, which
has replaced the option to collapse the section

Y
Y

11/18/2009
11/18/2009

11/25/2009 CMC
11/25/2009 CMC

Pass
Pass

The top-level section that was collapsed for the


previous widget is collapsed for the new widget

11/18/2009

11/25/2009 CMC

Pass

The attainment criterion details section that was N


expanded for the previous widget is *not*
expanded for the new widget

11/18/2009

11/25/2009 CMC

Pass

The system validates that "not relevant" is a


valid response

11/23/2009

11/25/2009

Pass

There is an option to indicate that the widget is


not relevant to my organisation

11/23/2009

11/25/2009

Pass

The not relevant status is persisted against the


widget

Request to expand an attainment


criterion details section

Request to collapse the expanded


section

Request to collapse a top-level section

Request to expand an attainment


criterion details section

Navigate to a different widget

Indicate that the widget is not relevant


to my organisation.

5
6

Request to save my changes

Add Custom Evidence Type Organisation User Add a custom evidence


type to an assessment
criterion (because the
standard evidence types
are not appropriate for
me)

Main

Why doesn't it remember the panel


states if I go out of the widgets screen
and back in again? Is there a technical
issue?

Medium

Withdrawn CMC:Because you didn't ask it to. You only


asked it to remember when clicking the
Next and Previous buttons. See predevelopment note for step 3 for 8c above.
Is that what you want then ?
TH: No, leave it as it is, it's fine

Low

Closed

11/23/2009

11/25/2009 CMC

Pass

The system does *not* require me to provide


Y
details as to why the widget is not relevant (the
"not relevant" text already makes clear the valid
reasons for a widget not being relevant).

12/21/2009

3/17/2010 CMC

Pass

There is *not* an option to indicate that the


widget is not relevant to my organisation

11/23/2009

11/25/2009

There is a data field for entry/amendment of


comments against each attainment criterion
(free form text)

11/16/2009

11/25/2009

The comments are persisted against the


appropriate attainment criterion (TBC link to
logical Data Model?)

11/16/2009

11/25/2009

Pass

The comments are displayed and are editable

11/16/2009

11/25/2009

Pass

The (updated) comments are persisted against


the appropriate attainment criterion

N/A

11/16/2009

11/25/2009

Pass

There is an option to add a "custom" evidence


type against a specific attainment criterion

11/16/2009

11/25/2009 RJM

Pass

Capital A for "add"

Pass

Can you make the cursor focus in the


Low
pop-up (currently the focus is on the OK
button)

Withdrawn

Pass

Can you make the pop-up appear


Low
relative (near) to the "add other
evidence" link - or alternatively can you
create a new row in the evidence table
and allow the user to type directly into
the table?

Withdrawn CMC:Think this should be withdrawn as is


no longer a pop up for adding custom
evidence

Pass

Can you make the OK button on the


Low
popup the default one which fires if I hit
return, and the Cancel button fire if I hit
"Escape"

Withdrawn CMC:Think this should be withdrawn as is


no longer a pop up for adding custom
evidence

Pass

If I click "add new evidence", then type Medium


in the evidence name, then hit Enter,
the page refreshes but the text I
entered has not been remembered.

Closed

Pass

If I remove the bottom evidence item,


Low
confirm, and then float over the "Add
other evidence" link, the bottom border
of the evidence table disappears.
Floating inside the table sometimes
makes it reappear. Strange!

Closed

"Not relevant" is not a valid response


Pass

Request to view a specific (v8+) widget

Enter comments on an individual


attainment criterion

4
5

Request to save my changes

Request to view a widget which already


has comments for an attainment
criterion

3
4
5

Edit the comments


Request to save my changes

Request to view a specific (v8+) widget

1a

CMC: Only for Next/Prev buttons if go


back via breadcrumb to the widgets list
then panel states are reset to default

Request to view a (v8+) widget

S025

CMC:Fixed as part of re-skin

Y
Y

Request to expand all top-level sections

1a

Closed

All top-level sections are collapsed


There are options to individually expand each
section, which have replaced the options to
collapse each section

Request to collapse all top-level sections

Main

CMC:Has been changd as part of reskin

Pass

Organisation User Enter comments for an


attainment criterion

Closed

Pass

11/25/2009 CMC

Enter Comments for an


Attainment Criterion

Medium

11/25/2009 CMC

11/18/2009

S024

Jerky action - needs to be smoother

11/18/2009

Request to expand the collapsed section

5
6

2a

CMC:Have been changed to Jquery panels


as part of reskin

Main

Closed

Pass

Organisation User Indicate that a (v8+)


widget is not relevant to
my organisation

Medium

Pass

11/25/2009 CMC

Indicate Widget As Not


Relevant (v8+)

Jerky action - needs to be smoother

11/25/2009 CMC

Request to collapse a top-level section

5
6

S023

Closed

View a specific (v8+) widget

2
3

8c

Remove "Type" column (and any


High
associated underlying data structures) we are no longer including "Type"

11/18/2009

CMC:Data issue as this text held in


database. Have changed test data setup
script to include full stop

Request to view a (v8+) widget for


which "not relevant" is *not* a valid
response

11/18/2009

Closed

Request to view a (v8+) widget for


which "not relevant" is a valid response

Pass

11

8b

Low

CMC

8a

Superseded by S108

View Evidence Types

Can you put a full stop at the end of


this sentence please? (sorry, my fault)

N/A

The maintenance criteria do not have criteria Ids

S021

Pass

Request to view a (v8+) widget which


has Level 3 Maintenance criteria

2c

CMC:Will need to be enforced through


validation i.e. can't click a criteria
unless all previous criteria also clicked
TH: this point is really just to do with
the way that the page looks, The
validation is covered off by S036
(Determine Current Attainment Level)

Add a custom evidence type and give it


a name (free form text)

4
5

Request to save my changes

Request to view a widget which already


has a custom evidence type against one
of its attainment criteria

Visible to healthcare commission?

Pass

The custom evidence type is persisted against


the appropriate attainment criterion for the
assessment

11/16/2009

11/25/2009 RJM

Pass

The existing custom evidence type is displayed


(below standard evidence types)

11/16/2009

11/25/2009 RJM

Pass

There is an indicator to show that it is a custom


(not standard) evidence type

There is an option to add a second "custom"


evidence type against a specific attainment
criterion (any number of custom evidence types
can be added)

The second custom evidence type is persisted


against the appropriate attainment criterion

N/A

Add a second custom evidence type and


give it a name (free form text)

6
7

Request to save my changes

2/5/2010 N/A

RJM

Pass

11/16/2009

11/25/2009 RJM

Pass

11/16/2009

11/25/2009 RJM

Pass

7/5 Still occurs in system test (a.test:acute,


reqt 101, criterion 1a)

1b

Request to view a widget which already


has a custom evidence type against one
of its attainment criteria

1c

There is an option to edit the name of the


custom evidence type

Edit the custom evidence type name

4
5

Request to save my changes

Request to view a widget which already


has a custom evidence type against one
of its attainment criteria

S026

Indicate Evidence
Obtained

Organisation User Indicate that I have


obtained a particular
evidence type

Main

Request to remove the custom evidence


type

4
5

Request to save my changes

Request to view a specific (v8+) widget

S027

Enter Evidence Comments Organisation User Enter comments against a Main


specific evidence type

Indicate a specific evidence type as


obtained

4
5

Request to save my changes

Request to view a specific (v8+) widget

1a

3
4
5

Enter comments
Request to save my changes

Request to view a specific (v8+) widget


which already has evidence comments

S028

Specify External Evidence


Location

Organisation User Specify an external


location for my evidence

Main

11/25/2009 RJM

Pass

The custom evidence type and all associated


Y
information is removed from the persistent store.

11/23/2009

11/25/2009 RJM

Pass

There is an option to mark each evidence type as Y


"obtained"

11/16/2009

11/25/2009 RJM

Pass

The fact that the evidence type has been


obtained is persisted

11/16/2009

11/25/2009 RJM

Pass

There is an option to enter comments against


N
each evidence type (free form text) - perhaps via
pop-up
Note: this option is available even if the user has
not yet specified the evidence type as having
been obtained

11/16/2009

11/25/2009 RJM

Pass

The comments are persisted against the


evidence type

11/16/2009

11/25/2009 RJM

Pass

The existing evidence comments are displayed


(perhaps via a pop-up)

11/30/2009

11/25/2009 RJM

complete

Pass

The system no longer highlights the fact that


evidence has been obtained but the evidence
location type has not been specified

11/30/2009

11/25/2009 RJM

complete

Pass

The system presents an option to specify the


Y
evidence location details (free form text, multiple
lines)

11/30/2009

11/25/2009 RJM

complete

Pass

The system highlights the fact that the user has


not yet specified evidence location details

11/18/2009

11/25/2009 RJM

complete

Pass

No red cross next to details

The system no longer highlights the fact that the Y


user has not yet specified evidence location
details

11/18/2009

11/25/2009 RJM

complete

Pass

Can't test until above defect fixed

The evidence location and details are persisted

11/30/2009

11/25/2009 RJM

complete

Pass

Specify the evidence location details


(free form text)

10
11

Request to save my changes

Request to view a specific widget for


which there is an evidence type that has
*not* been indicated as obtained

N/A

Proceed as per main flow but ignore steps 3 and 5 Y

4/20/2010

11/25/2009 RJM

complete

Pass

Red cross still appears

Medium

Closed

Proceed as per main flow (the user specifies the


full path and filename as the evidence details)

3/4/2010

11/25/2009 RJM

complete

Pass

Issues with red crosses as per main flow Medium

Closed

Proceed as per main flow (the user specifies the


relevant URL as the evidence details)

3/4/2010

11/25/2009 RJM

complete

Pass

Issues with red crosses as per main flow Medium

Closed

Proceed as per main flow (the user specifies the


relevant URL as the evidence details)

3/4/2010

11/25/2009 RJM

complete

Pass

Issues with red crosses as per main flow Medium

Closed

For each evidence type, there is an option to


specify the evidence location (icon launching
pop-up)

Pass

Context help appears behind the pop-up Medium

Closed

Pass

Tooltip missing from the icon (see


prototype)

Closed

Specify the evidence location as "local


file"

Specify the evidence location as


"intranet"

Specify the evidence location as


"internet"

Request to view a specific (v8+) widget

N/A

N/A

RJM

The system displays the Evidence Location popup

N/A

N/A

RJM

Pass

There is an option to specify the evidence


location type (drop down as per S028)

N/A

N/A

RJM

Pass

The system displays the evidence location


Y
details appropriate to the evidence location type
(dynamically, within the same pup-up) as
specified in S028

N/A

N/A

RJM

Pass

The evidence location type is updated in the


evidence table

N/A

N/A

RJM

Pass

The evidence location type and details are


persisted

N/A

N/A

RJM

Pass

The system presents an option to upload the


evidence file

3/4/2010

3/17/2010 RJM

Pass

The system makes it clear that the file will be


uploaded to the DH server and provides details
of who will be able to access it.

4/6/2010

RJM

Pass

The system highlights the fact that the user has


not yet uploaded the evidence file

3/4/2010

RJM

7
8

The system validates that the file exists


The system validates that the file is not bigger
than the maximum file size (configurable,
initially 5MB)

N
N

3/4/2010
3/4/2010

3/17/2010 RJM
RJM

Pass
Pass

The system uploads the file to the server (note:


at this point the file is officially an orphan file
until the user saves their changes. If they never
save, the uploaded file will have to be cleared
out somehow)
(tech note:if it's easy to do it might be a good
idea to compress the files for storage)

3/4/2010

3/17/2010 RJM

Pass

10

The system persists the date and time of upload N


and the current user along with the uploaded file

3/4/2010

3/17/2010 RJM

Pass

11

The system displays the uploaded file name

3/4/2010

3/17/2010 RJM

Pass

12

The system displays the date and time of upload Y


and the user name and user ID of the user who
uploaded it.

3/4/2010

3/17/2010 RJM

Pass

13

The system no longer highlights the fact that the N


user has not yet uploaded the evidence file

3/4/2010

RJM

Pass

The system persists my changes including the


reference to the uploaded file

3/4/2010

3/17/2010 RJM

Pass

The system asks me to confirm

3/4/2010

3/17/2010 RJM

N/A

Superseded by S163

The system indicates that the uploaded file has


been removed (but does not actually remove at
this point - only when the user saves their
changes - just in case they cancel or crash out)

3/4/2010

3/17/2010 RJM

N/A

Superseded by S163

The system re-presents the option to upload an


evidence file

6
7

Specify the evidence location

8
9
10

Specify evidence location details


Close the pop-up

11
12

Request to save the widget

At "Specify External Evidence Location"


step 4, specify the evidence location as
"uploaded"

13

2
3
4

On the pop-up, can you put "Cancel" to Low


the right of "Done" as per standard
practice - I keep clicking "Cancel" by
mistake!

Closed

RJM:Cancel is placed here in order to be


consistent with the requesirements page.
Do you want this one changed to be
different from the main page? CMC: Fixed
as per defect description but as Richard
mentioned need to consider order of
buttons on the page as well
TH 28/3: button order also changed on
Widget Details page to match

Closed

Only remembers it if it has been saved but


that's good enough

Closed

Required a new setting in the webconfig file

Select the option to upload

Specify the file to upload (type file name


or via file browser) and request to
upload it

Request to save the widget response


data

14
1

Medium

Request to specify the location for a


particular evidence type

Request to remove the uploaded file


from the server
Confirm

5
6
7

Request to save my changes

Change the evidence location to


something else other that "uploaded"

Change the evidence location back to


"uploaded"

7a

11/23/2009

The system highlights the fact that evidence has Y


been obtained but the evidence location type
has not been specified

3
4

6a

Specify the evidence location type as


"other"

13c

There is an option to remove the custom


evidence type

Pass

13b

Closed

Pass

complete

13a

Medium

11/25/2009 RJM

11/25/2009 RJM

Main

Closed

11/16/2009

11/18/2009

Upload Evidence

Low

There is an option to specify the evidence


Y
location type as one of the following:
0) Unspecified (the default, but not an
acceptable answer!)
1) Uploaded
2) Internet
3) Intranet
4) Local file
5) Other
6) Duplicate (i.e. a reference to evidence already
obtained against another attainment criterion)

Request to view a specific (v8+) widget


for which there is an evidence type that
has been indicated as obtained

S030

As per "add evidence" popup can you


make the text field focussed initially

The updated custom evidence type name is


persisted against the appropriate attainment
criterion

Pass

Organisation User Upload evidence to the


PQRT server

Closed

Pass

Main

Closed

Low

11/25/2009 RJM

Specify Evidence Location Organisation User Specify an external


Improvement
location for my evidence
(improved UI)

Low

7/5 Can the label "Edit Evidence" be in


black, not gray, so it doesn't look like
the pop-up is disabled?

11/25/2009 RJM

S131

7/5 Can the popup get the focus when


it opens

Pass

11/16/2009

4c

Pass

11/16/2009

4b

11/25/2009 RJM

Edit an evidence comment


Request to save my changes

4a

11/16/2009

The updated comments are persisted against the N


evidence type

3
4
5

1a

Change the evidence location to


something else other that "uploaded"

2
3

Request to save my changes

1
2
1
2

File doesn't exist

3/4/2010

3/17/2010 RJM

N/A

Superseded by S163

The system persists my changes including


N
removing the reference to the uploaded file (tech
note: the uploaded file could also be removed at
this point or it could be left to a periodic
housekeeping function)

3/4/2010

3/17/2010 RJM

N/A

Superseded by S163

The system re-displays the same uploaded file as N


before

3/4/2010

RJM

Pass

Doesn't remember the uploaded file

The system persists my changes including


N
removing the reference to the uploaded file (tech
note: the uploaded file could also be removed at
this point or it could be left to a periodic
housekeeping function)

3/4/2010

RJM

Pass

Can;t test until above defect fixed

System displays error message

3/4/2010

RJM

Pass

System displays error message

3/4/2010

RJM

Pass

Low

File too big


When I try to upload a large file it
High
"never" completes. Specifically, if I load
a 2.4MB file it uploads in ~5 seconds
but if I upload a 4MB file (still below
5MB) it hadn't completed after 4
minutes so I aborted.

S031

View Evidence

Organisation User View evidence files that I


have previously specified
in my widget response

Main

Request to view a (v8+) widget for


which the evidence location type has
already been specified as one of
"uploaded", "internet", "intranet" or
"local file" and the evidence details have
also been specified

S029

Specify Duplicate Evidence Organisation User Indicate that an evidence


type is a duplicate of
another one I've already
specified (and cross
reference it)

Main

There is an option to view the evidence file

3/4/2010

11/25/2009 RJM

Pass

The system opens the specified file in a new


browser window (tech note: different file types
have different behaviour re. opening a new
window e.g. for a PDF you have to explicitly
launch a new window whereas for Word/Excel
you don't)

3/4/2010

11/25/2009 RJM

Cant view 'duplicate' type as this story Pass


hasn't been defined & implemented.
Viewing a local file within the browser
will not be possible as it breaches the
browser security.
TH 07/04: de-scoped "view duplicate
evidence" from this story

The system presents an option to specify the


Y
evidence location details. This is a list of all
evidence types across all other widgets (for the
current assessment), including custom evidence.

11/23/2009

For each evidence type in the list, the following


Y
information is provided:
- widget number
- attainment criterion ID or "maint" for a
maintenance criterion
- evidence type name (standard or custom) - first
50 chars plus ellipsis if overflowed
- whether it has been "fully specified"
Proposed format is a simple drop-down with
items in the following format: "R<req
no>/<criteria ID or "maint">:<evidenve type
desc> [(incomplete)]" e.g. "R101/1a:Job
description (incomplete)"

3
4

Request to view the evidence file

At "Specify External Evidence Location"


step 4, specify the evidence location as
"duplicate"

The system highlights the fact that the user has


not yet specified evidence location details

View Duplicate Evidence

Organisation User View duplicate evidence


Main
files that I have previously
specified in my widget
response

7
8

Request to save my changes

Request to view a (v8+) widget for


which the evidence location type has
already been specified as "duplicate"
and the evidence details have also been
specified

2
3
4

4a

11/25/2009

The system no longer highlights the fact that the N


user has not yet specified evidence location
details. This happens even if the referenced
evidence is not fully specified

11/23/2009

11/25/2009

The evidence location and details are persisted

11/23/2009

11/25/2009

There is an option to view the referenced


evidence

The system opens the specified file in a new


browser window (tech note: different file types
have different behaviour re. opening a new
window e.g. for a PDF you have to explicitly
launch a new window whereas for Word/Excel
you don't)
The referenced file is not viewable

Request to view a widget which already


has a custom evidence type against one
of its attainment criteria

S163

Link to Existing Uploaded


Evidence (Mark 2)

Organisation User Specify an existing


Main
uploaded evidence file
against another evidence
item (enhanced/simplified
version)

3/4/2010

Withdrawn

11/25/2009 Withdrawn

3/4/2010

Withdrawn

Withdrawn

11/25/2009 Withdrawn

Withdrawn

Withdrawn

Withdrawn

There is an option to remove the custom


evidence type

Withdrawn

Withdrawn

Withdrawn

The system validates that the evidence type


does have references to it from other evidence
types (i.e. There are evidence types marked as
location "Duplicate" with a reference to this
evidence type)

Withdrawn

Withdrawn

Withdrawn

The system informs me that I cannot remove this N


evidence type because it is referenced.

Withdrawn

Withdrawn

Withdrawn

The system lists all the references to this


evidence type in the format "R<req
no>/<criteria ID or "maint">:<evidenve type
desc>"

Withdrawn

Withdrawn

Withdrawn

The system includes an option to select an


existing uploaded file

Request to remove the custom evidence


type

At "Specify External Evidence Location"


step 4, specify the evidence location as
"uploaded"

4/22/2010

RJM

Pass
Pass

In IE6, when I first specity the evidence Medium


location type as "uploaded", the
"Loading" div appears for a second and
then disappears again. If I change the
evidence location type to something
else and then back again, it doesn't
happen

Withdrawn Not a fault. Access to the server will cause


a loading panel. This happens on first use
of upload facility to get the content for the
drop down list. The loading panel is
displayed for a minimum 0.9s.

Pass

In IE6, if I drag and drop the evidence


Low
pop-up, the buttons remain transparent
after I have dropped it

Closed

ie6 is crap. This is being caused by the big


yellow button widget causing IE6/7 to
render incorrectly. I have changed the
button type for the evidence popup from
submit's to button's.

This will be 3rd time swapped. Are you


sure?

Pass

The Done button should be to the left of Low


the Cancel button

Closed

The list of existing uploaded files includes all files N


uploaded against the current assessment (this
might change in future to include previous
assessments too)

4/22/2010

RJM

Pass

The list included "orphaned" files which Medium


were not currently linked to the
assessment (they were previously
linked but I unlinked them by changing
the evidence location type back to
"[select]". When I selected one of these
files, the system also told me that it
was still linked to the widget that I had
unlinked it from.

Closed

4
5

The list is in alphabetical order


The default value is unselected ("[Select]")

N
N

4/22/2010
4/22/2010

RJM
RJM

Pass
Pass

It's a blank line instead of "[select]"

Closed

The system indicates that I have not yet either


selected an uploaded file or uploaded a new file

RJM

Pass

8
9

Low

If I click "Done" at this point to go back High


to the Widget Details screen, the
evidence is marked as "Uploaded" with
no red corss, even though I have not
uploaded a file.

Closed

Not found
TH 18/5 tester error

Sometimes it says "This file is linked to" Medium


and sometimes it says "this file is *also*
linked to". What's the difference
between the two scenarios? Shouldn't it
always say "this file is *also* linked to"

Closed

RM 18/5: Have changed this but not as


discussed as the technical issues involved
are complex. Have changed the wording.
The 'also' is removed when the only link is
itself. Ie it isn't 'also' linked to itself.
TH 18/5 as discussed, change this to (a)
not display the current criterion as linked
and (b) always say "also"

Select a file from the list


The system displays the audit trail data for the
N
selected file (date and time uploaded, user name
and user ID)

4/22/2010

RJM

Pass

10

The system displays the other widgets that the


file is also linked to

4/22/2010

RJM

Pass

11

The system no longer indicates that I have not


either selected an uploaded file or uploaded a
new file

RJM

Pass

12

The system enables an option to view the


selected file

4/22/2010

RJM

Pass

The system displays the file in a new window

4/22/2010

RJM

Pass

If the currently selected file is linked to any other N


widgets, the system (in a model pop-up) asks me
whether I want to:
a) Replace the file (so that all widgets are linked
to the new file) or
b) Add a new file (leaving other widgets linked to
the existing one)

4/22/2010

RJM

Pass

Can you change the button and


Low
associated text from "New" to "Add" so
that it is a verb (more consistent with
the other buttons)

Closed

Pass

I should only be asked this question if


Medium
the currently selected document is also
linked to other widgets - if it's not
linked elsewhere then there is no
difference between "Add" and
"Replace" and the question is confusing
and intrusive

Closed

Pass

Related to the above, can you add the


following text to the top of the pop-up:
"This evidence is linked to other
widgets. Please select one of the
following options:" or similar.

Medium

Closed

Pass

After having replaced an existing


Medium
uploaded file, I tried to replace it a
second time. I selected the file and
then I got a pop-up appearing very
briefly and then disappearing again,
and the file was not uploaded. If I leave
the Widget Details page and re-enter it,
I am able to replace the file (presume
re-loading the page clears out some
bad state)

Closed

Not found
TH 18/5 still occurring (and demonstrated
to RJM). RM 19/5 Fixed

Pass

The pop-up disappeared after a period. Medium


I'm sure there's a reason it does this,
but it seems wrong for a pop-up to
disappear of its own accord - is there
anything we can do about this?

Closed

Popup timeout is 30s. Can be set to infinity


or other time very simply.

Not really a defect since I didn't ask for Medium


it, but could you display a modal popup once the upload has succeeded
saying "File upload complete" or
similar? That way the user gets a very
positive message that their file has
been uploaded.

Closed

Dont like it but fixed.


TH 18/5 Less obtrusive alternative: make
the upload "hourglass" more obvious and
say "uploading". RM19/5 implemented
loading display

13
14

Request to view the file

15

Select a new local file and request to


upload it

16

17

The system replaces or adds the file accordingly


(details as per S030)

4/22/2010

RJM

Pass

The system uploads the file as per S030

4/22/2010

RJM

Pass

The system adds the new file to the list of


uploaded files and shows it as the selected file

4/22/2010

RJM

Pass

18/5: technically difficult - not done. there


is a difference but have removed the
option and it now does a replace only if
there are not other links.
TH 18/5 as discussed can you try to make
it only ask this question if the widget is
linked to any *other* criteria (i.e. Excluding
the link to the current criterion)

Indicate whether I want to replace or add

18
8a

11/25/2009

11/23/2009

The system validates that the referenced


N
evidence is viewable i.e.
- it is of type "uploaded" and has been uploaded,
or
- it is of type "internet" or "intranet" and the URL
has been specified, or
- it is of type "local file" and the filename has
been specified

CMC:Not sure what the issue is here


haven't been to replicate yet

11/25/2009

The system displays an appropriate error


message
Cannot Delete Referenced Organisation User Be prevented from
Main
Custom Evidence
deleting custom evidence
which is referenced from
elsewhere

Closed

Request to view the evidence file

S139

Medium

Select one of the evidence types from


the list

S140

New browser window needs scroll bars

Instead of selecting a file from the list,


select a new local file and request to
upload it

S032

S033

Configure Evidence
Provision Status

Indicate Attainment
Criterion Achieved

Sys Admin

Configure whether
Main
evidence provision is
"overall mandatory" or
"overall optional" for each
organisation type. This
determines whether an
organisation is mandated
to provide evidence
against each attainment
criterion.

Organisation User Indicate a given


Main
attainment criterion as
achieved either directly or
indirectly

Rejoin main flow at step 9

Specify whether evidence provision is


"overall mandatory" or "overall optional"
for each organisation type (does not
need to be via a GUI)

2
3
4
5

Request to save my changes


Restart the system

Am completing a (v8+) assessment for


an organisation type for which evidence
provision is "overall mandatory"
Pass

11/25/2009

Pass

The system notifies me that I must first complete N


the details for the attainment criterion

11/18/2009

11/25/2009

Pass

The system automatically marks the attainment


criterion as achieved

11/18/2009

11/25/2009

Pass

The system persists the fact that the attainment N


criterion is achieved.

11/18/2009

11/25/2009

Pass

The system automatically marks the attainment


criterion as not achieved

Am completing a (v8+) assessment for


an organisation type for which evidence
provision is "overall mandatory"

Enter evidence details for the


attainment criterion such that all
evidence types are "fully specified"

Definition: a "fully specified" evidence


type is one for which the evidence has
been marked as obtained, the location
type has been specified and the relevant
evidence location details have been
entered.

5
6

Request to save my changes

Change evidence details so that not all


evidence types are fully specified.

Organisation User Have the system


determine my current
attainment level for a
given widget

Main

2a

11/25/2009

Pass

11/25/2009

Pass

The "achieved" flag is not editable and remains


set to "achieved"

11/18/2009

11/25/2009

Pass

There is an option to indicate that each


attainment criterion is achieved (flag name
"Achieved")

11/30/2009

11/25/2009

Pass

The system marks the attainment criterion as


achieved

11/30/2009

11/25/2009

Pass

The system encourages me to add details for the Y


attainment criterion by expanding the
attainment criterion details section

1/12/2010

3/17/2010

Pass

The system makes it clear that adding the details Y


for the attainment criterion is optional but
recommended

1/12/2010

3/17/2010

Pass

The system persists the fact that the attainment Y


criterion is achieved.

11/30/2009

11/25/2009

Pass

There is an option to explicitly indicate


Attainment Level 0 for the widgets (this allows
the system to distinguish this state from a "not
answered" state)

11/30/2009

11/25/2009 CMC

Pass

The system persists the fact that I have explicitly Y


indicated Attainment Level 0

11/30/2009

11/25/2009 CMC

Pass

Note: even when I have explicitly indicated


Y
Attainment Level 0, the system might ignore me
- see "Determine Current Attainment Level 0"

11/30/2009

11/25/2009 CMC

Pass

The "date last modified" for the attainment


criterion is blank

11/23/2009

11/25/2009

The "date last modified" for the attainment


criterion is read only

11/18/2009

11/25/2009

The "date last modified" for the attainment


criterion is displayed as the date and time that
the system saved the changes

11/23/2009

11/25/2009

The "Date last modified" remains unchanged

11/23/2009

11/25/2009

The system displays my current attainment level Y


as "NR"

11/23/2009

11/25/2009 RJM

Pass

The current attainment level (along with past


and tagret attainment levels) is displayed in
large font size below the scoring matrix (it is no
longer shown as a radio button selection within
the scoring matrix)

12/10/2009

RJM

Pass

The system displays my current attainment level Y


as "3"

11/18/2009

11/25/2009 RJM

Pass

Working as a.test:acute 2 on reqt 101


High
(past level=3)...
When I fully specified the evidence for
criterion 3a, 3b and 3c, the system did
not tick the 3a, 3b or 3c achieved box.
When I went out and back in again, the
system ticked the box. Didn't have the
same problem for level 1 or level 2, or
for 3d (a maintennace criterion)

Closed

There appears to be a bug in the system


that is preventing saving of any details
data outside of criterion 1a . I suspect
some test data is missing that wouldn't be
missing if the assessment had been
created by the system. RM 21/5: Issue
created by change criterion from 1a/1b etc
to a/b etc

Pass

Working as a.test:acute 2 on reqt 101


(past level=3)... When I fully specified
the evidence for criteria 3a, 3b, 3c and
3d, the system ticked Level 3 but did
not update Current Level to 3
(remained at 2)

High

Closed

As above

Pass

a.test:acute, req't 101, achieved 3a, no High


previous assessment, but L3 not shown

Closed

Pass

a.test:acute2, req't 101, past level 2,


achieved 3a,3b,3c but L3 not shown had to complete 3d to get L3 even
though past level not 3
Likewise, req't 201 - no past level, but
still required to achieve 3d to get L3

Closed

Attempt to indicate that a given


attainment criterion is not achieved

Am completing a (v8+) assessment for


an organisation type for which evidence
provision is "overall optional"

Indicate that a give attainment criterion


is achieved

6
7

Request to save my changes

Request to view a specific (v8+) widget

Explicitly indicate Attainment Level 0

4
5

Request to save my changes

Request to view a specific (v8+) widget,


which includes an attainment criterion
that has not yet had any details
specified

Specify some details for the attainment


criterion

5
6

Request to save my changes

Make some further changes but then


reverse the changes

8
9

Request to save my changes

Request to view a specific (v8+) widget

The widget is marked as not relevant

All level 1, 2 and 3 criteria have been


achieved (including level 3 maintenance
criteria) and the previous assessment
was at attainment level 3

All level 1, 2 and 3 criteria have been


achieved, excluding level 3 maintenance
criteria, and last year's assessment was
not at attainment level 3

The system displays my current attainment level N


as "3"

S037

Determine Widget Status

Organisation User Have the system


determine the status of
my widget response

Main

1
2

11/18/2009

11/25/2009 RJM

Pass

The system displays my current attainment level Y


as "1"

11/18/2009

11/25/2009 RJM

Pass

The system displays my current attainment level Y


as "0"

11/30/2009

11/25/2009 RJM

Pass

The system displays my current attainment level Y


as "0".
This ties in with S037 - changing the status from
"Not Started" to "In Progress" - once a widget has
any data put against it, it can be considered In
Progress and thus legitimate to assume a score
of 0 if not achieved level 1 or higher.

11/30/2009

11/25/2009 RJM

Pass

The system displays my current attainment level N


as undetermined

11/30/2009

11/25/2009 RJM

If I have achieved all L2 criteria but not Medium


all L1 criteria then it is correctly
showing Current Level=0 but it is
showing L2 as ticked. If not all L1
criteria achieved then L2 should remain
unticked even if all L2 criteria are
achieved

Closed

Currently the FS doesn't specify this way of


indicating level. Will the FS be changed
first? Probably 2-4 days work to change it.

Pass

For org a.test:acute, req't 101 - AL1 and High


AL2 are ticked even though the criteria
are not

Closed

RJM: this is a test data issue.

Pass

Weont into a "fresh" req't, ticked L0,


saved, went out, back in, unticked L0
but Current Level did not go blank
(even though no data has been
entered)

Closed

None of the above is true

View the widgets list for an in-progress


assessment (any version) where one of
the widgets has not yet been started

Make some changes to the widget and


save my changes

4
5

View the widget list again

The system displays my current attainment level Y


as "2"

The user has entered *any* data against


the widget

2g

High

Level 0 is explicitly marked as achieved

2
2f

11/25/2009 RJM

All level 1 criteria have been achieved

2e

11/30/2009

All level 1 and 2 criteria have been


achieved

2
2d

Closed

11/18/2009

2c

High

11/18/2009

2b

I added new custom evidence and


marked it obtained but didn't specify
the evidence location. Nevertheless,
the system marked the criterion as
achieved

Not found

Request to save my changes

Determine Current
Attainment Level (v8+)

Closed

The system persists the fact that the attainment N


criterion is not achieved.

9
10

S036

Pass
Pass

11/25/2009

Main

11/25/2009 nili
11/25/2009 nili

11/18/2009

Capture Date Last Modified Organisation User Have the system capture
and display the "date last
modified" for each
individual attainment
criterion

11/23/2009
11/18/2009

11/18/2009

S035

The system has persisted my changes


N/A
Note: the initial configuration for PQRT v8 is that N/A
evidence provision is mandatory for large XYZ
trusts i.e. Acute, AMT, MHT, GHJ and EFG

Organisation User Explicitly indicate that my Main


organisation is at
Attainment Level 0

I attempted to upload a file > 5MB. I


Medium
got the failure pop-up as expected but
when I clicked "Done" on the Evidence
Location pop-up I got a pop-up saying
"You haven't uploaded the selected file.
Are you sure you want to cancel the
operation?" The same thing happens if I
try to upload a file with an ".accdb"
suffix. This message is wrong in this
scenario but also it's probably obsolete
because we no longer have a 2-stage
upload so there's no way you can select
a file without uploading it.

Pass

Indicate Attainment Level


0 (v8+)

nili: addition of flag for each


organisation type specifying whether
evidence is 'overall mandatory'.

The system does not mark the attainment


criterion as achieved

S034

nili

Pass

Attempt to indicate that a given


attainment criterion is achieved

1b

RJM

There is an option to indicate that each


attainment criterion is achieved

1a.5a

4/22/2010

1a

The system displayes the widget status as "Not


Started" (previously "Not Answered")

11/30/2009

11/25/2009

Pass

The system displayes the widget status as "In


Progress" (previously "Answered")

11/30/2009

11/25/2009

Pass

Note: other statuses remain as-is (no change)

11/30/2009

11/25/2009

Pass

Low

S038

Grant Widget Exemption

XYZ ABC User

Grant an exemption from


a (v8) widget to an
organisation

Main

View an in-progress (v8+) assessment


for a specific organisation

View a specific widget within the


assessment for which "not relevant" is
*not* an option
There is an option for me to mark the
organisation as being exempt from the widget

11/23/2009

11/25/2009

Pass

The exemption description is


"Exemption Description for Req 102".
This is not supposed to be a widgetspecific description, it is just static text
(wording as per prototype)

Closed

Note: the exemption only applies to the current


assessment and not to future assessments

N/A

11/18/2009

3/17/2010

Pass

Fixing the above defect by adding the


static text from the prototype will fix
this

Closed

The current attainment level changes to EX


There is an option for me to add free-form notes
to explain the exemption [not mandatory]

Y
Y

11/23/2009
11/23/2009

11/25/2009
11/25/2009

Pass
Pass

There is a superfluous context help icon


to the RHS of "Reason"

Closed

The system persists my changes (including the


current attainment level)

11/23/2009

11/25/2009

Pass

The system also persists who granted the


exemption and when

11/23/2009

11/25/2009

Pass

The system displays the fact that the widget is


exempt, who exempted it, when and comments

N/A

N/A

Pass

3
4
5
6
7

There is an option to unexempt the widget


There is an option to amend the notes

Y
Y

N/A
N/A

N/A
N/A

Pass
Pass

The system persists the changed notes but does N


not change the person or date of exemption

N/A

N/A

Pass

The system persists the unexemption and clears N


out the person, date and comments

N/A

N/A

Pass

As org user I marked a req't as L0. Then


as ABC I marked it exempt, and then
marked it as not exempt. Instead of
changing the Current Level back to L0,
it blanked it out. To get it back to L0
again I have to log back in as org user,
untick L0 and then tick it again (and
save)

Closed

The system persists the exemption along with


the person, date and comments

N/A

N/A

Pass

There is *not* an option for me to mark the


organisation as being exempt from the widget

11/30/2009

11/25/2009

Pass

The system indicates that my organisation has


been granted an exemption for this widget

11/30/2009

11/25/2009 RJM

Pass

3
4

I cannot override the exemption


The system shows the exemption details: notes,
date and who granted it

Y
Y

11/30/2009
11/30/2009

11/25/2009 RJM
11/25/2009 RJM

Pass
Pass

There is a superfluous context help icon


to the RHS of "Reason"

Closed

It is clear that the exemption applies to the


current assessment only and not to any future
assessments

11/30/2009

3/17/2010 RJM

Pass

Fixing the above defect in S038 by


adding the static text from the
prototype will fix this

Closed

My attainment level is shown as "EX"

11/30/2009

3/17/2010 RJM

Pass

There is an option for me to mark the


organisation as being exempt from each
individual attainment criterion

11/23/2009

11/25/2009

Note: the exemption only applies to the current


assessment and not to future assessments

N/A

11/18/2009

3/17/2010

There is an option for me to add free-form notes


to explain the exemption

11/23/2009

11/25/2009

The system persists my changes


The system also persists who granted the
exemption and when

Y
Y

11/23/2009
11/23/2009

11/25/2009
11/25/2009

There is an option for me to mark the


organisation *type* as being exempt from each
individual attainment criterion.

11/23/2009

11/25/2009

Note: the exemption only applies to the current N/A


version of the widgets and not to future versions

11/18/2009

3/17/2010

There is an option for me to add free-form notes


to explain the exemption (these notes are
distinct from the notes provided against my
specific organisation)

11/23/2009

11/25/2009

The system persists my changes


The system also persists who granted the
exemption and when (this data is distinct from
data for any exemption provided against my
specific organisation)

Y
Y

11/23/2009
11/23/2009

11/25/2009
11/25/2009

There is *not* an option for me to mark the


organisation *type* as being exempt from each
individual attainment criterion.

12/21/2009 N/A

The system indicates that my organisation has


been granted an exemption for the specific
attainment criterion

11/23/2009

11/25/2009

3
4

I cannot override the exemption


The system shows the exemption details: notes,
date and who granted it

Y
Y

11/23/2009
11/30/2009

11/25/2009
11/25/2009

It is clear that the exemption applies to the


current assessment only and not to any future
assessments

11/30/2009

3/17/2010

The system indicates that my organisation has


been granted an exemption for the specific
attainment criterion

11/23/2009

11/25/2009

3
4

I cannot override the exemption


The system shows the exemption details: notes,
date and who granted it

Y
Y

11/23/2009
11/30/2009

11/25/2009
11/25/2009

It is clear that the exemption applies to the


current assessment only and not to any future
assessments

11/30/2009

3/17/2010

The system shows the exemption details for my


organisation: notes, date and who granted it

1/12/2010

The system does *not* show the exemption


details for my organisation *type*

1/12/2010 N/A

Mark the organisation as exempt from


the widget

6
7

8
9
10

Add free form notes


Request to save my changes

11
2a

2a

View a specific widget which has already


been marked as exempt

Amend the notes


Request to save my changes

8
9
10

Unexempt the widget


Request to save my changes

11

Re-exempt the widget [no connets this


time]

12
13

Request to save my changes

View a specific widget within the


assessment for which "not relevant" *is*
an option

S039

S040

View Widget Exemption

Grant Criterion Exemption

Organisation User View a widget exemption


granted to my
organisation

XYZ ABC User

Grant an exemption from


an attainment criterion to
an organisation

Main

Main

View a specific widget for my in-progress


(v8+) assessment for which my
organisation has been granted an
exemption

View an in-progress (v8+) assessment


for a specific organisation

View a specific widget within the


assessment

Mark the organisation as exempt from a


specific attainment criterion

S041

Grant Criterion Exemption XYZ ABC User


to Org Type

Grant an exemption from


an attainment criterion to
all organisations of a
specific type

Main

7
8
9
10

Add free form notes


Request to save my changes

View an in-progress (v8+) assessment


for a specific organisation

View a specific widget within the


assessment

Mark the organisation type as exempt


from a specific attainment criterion

1a

7
8
9
10

Add free form notes


Request to save my changes

View a specific widget for a specific


organisation type, but not within the
context of a specific organisation's
assessment

S042

View Criterion Exemption

Organisation User View a criterion exemption Main


granted to my
organisation

1a

1b

S043

Determine Current
Attainment Level Given
Criterion Exemption

Organisation User Have the system


Main
determine my current
attainment level for a
given widget, given that I
have a criterion exemption

View a specific widget for my in-progress


(v8+) assessment for which my
organisation has been granted an
exemption against a specific attainment
criterion

View a specific widget for my in-progress


assessment for which my organisation
*type* has been granted an exemption
against a specific attainment criterion

View a specific widget for my in-progress


assessment for which both my
organisation *and* my organisation type
have been granted an exemption
against a specific attainment criterion

Request to view a specific (v8+) widget

The widget is marked as exempt (ref.


S038 - Grant Widget Exemption)
The system displays my current attainment level Y
as "EX"

11/30/2009

11/25/2009

S044

Grant Evidence Exemption XYZ ABC User

Grant an exemption from


a mandatory evidence
type to an organisation

XYZ ABC is able to mark a specific standard


evidence item as exempt for a specific
organisation. The system captures who marked
the exemption, when, and their comments.

TBC

Withdrawn

11/25/2009

S045

Grant Evidence Exemption XYZ ABC User


to Org Type

Grant an exemption from


a mandatory evidence
type to all organisations of
a specific type

TBC do we need this?

TBC

Withdrawn

11/25/2009

S046

View Evidence Exemption

Organisation User View an evidence


exemption granted to my
organisation

TBC

TBC

Withdrawn

11/25/2009

S047

Save Widget

Organisation User Save changes I have made Main


to my widget response
when I request it or when I
perform various
navigation tasks

The system saves my changes

11/23/2009

11/25/2009 RJM

Pass

The system saves my changes

11/30/2009

11/25/2009 RJM

Pass

The system saves my changes

11/30/2009

11/25/2009 RJM

Pass

The system saves my changes


The system returns me to the widgets list

Y
Y

11/30/2009
11/30/2009

11/25/2009 RJM
11/25/2009 RJM

Pass
Pass

The system does not save my changes


The system returns me to the widgets list

Y
Y

12/21/2009
12/21/2009

3/17/2010 RJM
3/17/2010 RJM

Pass
Pass

There is an option to request to jump to another


widget

TBC

11/25/2009

The system saves my changes


The system displays the specified widget

TBC
TBC

11/25/2009
11/25/2009

There is a (single) option to print or download


the widget

11/18/2009

11/25/2009 nili

Pass

The system opens up the printable/downloadable Y


version of the widget in a new browser window

11/18/2009

11/25/2009 nili

Pass

View a specific widget for an in-progress


(v8+) assessment

2
3
4
1

Make some changes


Request to save the widget

3a

3b

2
1

3c

2
1

3d

S048

Jump To Widget

Organisation User Navigate quickly from one Main


widget to another

2
3
1
2
3
1

Request to move to the next widget

Request to move to the previous widget

Indicate that I am done with the current


widget

Request to cancel my changes

View a specific widget for an in-progress


(v8+) assessment

2
3
4

Make some changes


Request to jump to another widget (and
specify which one)

5
6
S022

View
Printable/Downloadable
Version of Widget

General User

View a
printable/downloadable
version of a widget

Main

Request to view a specific (v8+) widget

2
3
4

CMC:Note there was also an issue whereby


if the organisation had scored the widget
and then CfH marked it as exempt when
you actually saved it it wasn't persisitng
the exempt setting, this is now also fixed

nili

Request to print or download the widget


File not found - is this a problem with
the system test environment?

High

Closed

nili: folder holding widget documents is


now specified by test web.config

The printable version is in PDF format - it is


designed for viewing offline or printing out, and
not for filling in.

11/18/2009

11/25/2009 nili

Pass

Options to save or print the widget are available


(standard Acrobat Reader functions so no need
to actually test them)

12/21/2009

nili

Pass

The PDF document is a static placeholder


document - this will change once S065 and/or
S082 are delivered

nili

Pass

There is an option to download widgets in bulk

S050

Download Widgets In Bulk Logged In User

Download printable
Main
versions of widgets in
bulk, for viewing off-line or
for printing out

11/18/2009

11/25/2009 nili

Pass

4
5

The widget downloads page is displayed


Y
Downloads are only available for my own org type Y

11/18/2009
11/18/2009

11/25/2009 nili
11/25/2009 nili

Pass
Pass

Widget documents are available for download in


three formats:
1) Full widget format (guidance plus attainment
levels/checklist)
2) Guidance only format
3) Attainment levels/checklist only format

11/18/2009

11/25/2009 nili

Pass

Widgets documents are available for download in Y


the following groupings:
1) Booklet: all widgets as a single doc
2) Individual widgets: widgets as individual docs,
zipped together

11/18/2009

11/25/2009 nili

Pass

The "booklets" list item is incorrectly in Low


bold (lloking at the HTML it looks like it
is tagged up as <h3>)

Closed

There is a warning that the booklet is a large file Y


(because it is > 250MB)

11/18/2009

11/25/2009 nili

Pass

There are warnings for all files - it


should just be for the "All widgets"
booklet

Closed

nili: The warning depends upon the file size


setting in web.config. I suspect the
web.config for the test site does not
include this setting.
TH 15/3 not sure why you have done it
based on file size - the spec doesn't say
anything about this, only that the "all
widgets" booklet should be marked as a
large file

Pass

Can you put the large file warning in


Low
bold red (in the prototype I have done it
using <span class="warning"> - the
warning style would also need adding
to the stylesheet

Closed

nili: I've used the existing 'errorMessage'


class which displays the message in red

10
11

The system tells advises me how to view and


download the files (right click/Save Target As...)

Request to view a specific widget

Request to download widgets in bulk

1
2

Navigate to the Resources page

Request to download widgets in bulk

4
5
1c

1
2

1
2
3

Log out
Navigate to the Resources page

Navigate to the widgets list for any org


type

5
6

Download Widgets In Bulk Logged In User


(Per-Initiative Booklets)

Download printable
Main
versions of widgets in
bulk, for viewing off-line or
for printing out
(specifically, per-initiative
booklets)

Download Widgets
Spreadsheet

General User

Download the widget set


as a spreadsheet for
offline working

Main

Download and open the file

Request to download widgets in bulk

S056

Review Submitted
Assessment

Create Bulk Email

XYZ ABC User

XYZ ABC User

Review a submitted (v8+)


assessment prior to
approval

Create bulk emails to be


sent to users

The PDF document is a static placeholder


document - this will change once S065 and/or
S082 are delivered

The download is a ZIP file

The ZIP file is a static placeholder file

There is an option to download widgets in bulk

See prototype for appropriate wording

Medium

Closed

Pass

File not found

High

Closed

nili: Test web.config now specifies the


directory for these documents.

N/A

nili

Pass

1/12/2010 N/A

nili

Pass

File not found

High

Closed

nili: Test web.config now specifies the


directory for these documents.

N/A

nili

Pass

11/18/2009 N/A

The link doesn't work - because the


High
<a> tag doesn't have an href attribute
in it. This was previously working so
maybe it's a config issue that has been
re-created when the test server DB was
rebuilt?

Closed

N/A

N/A

nili

Pass

The widget downloads page is displayed


Y
Downloads are only available for my own org type Y

11/18/2009 N/A
nili
11/18/2009
11/25/2009 nili

Pass
Pass

There is an option to download widgets in bulk

11/18/2009 N/A

nili

Pass

The widget downloads page is displayed


N
Downloads are only available for my own org type N

11/18/2009 N/A
nili
11/18/2009
11/25/2009 nili

Pass
Pass

The widget downloads page is displayed


There is an option to select the org type (all
"assessable" org types in the list, alphabetical,
default Acute Trust)

11/18/2009 N/A
2/22/2010 N/A

Pass
Pass

Y
Y

nili
nili

Default is blank

Medium

Closed

Pass

Formatting of label - should be bold check the styling used elsewhere (e.g.
Register page) and copy that.

Low

Closed

Medium

Closed

No downloads displayed until I click "View


Downloads" - the downloads for Acute
should be displayed without me having to
click "View Downloads"

2/22/2010 N/A

nili

Pass

Default is blank

The downloads for the newly selected org type


are displayed

2/22/2010 N/A

nili

Pass

1) I can't test this because there are no High


downloads set up for any org type other
than Acute Test. Can you add some test
data

Closed

CMC: Have added test entries for Test


Acute and XYZ org types. NOTE: Think we
may need to consider how this screen
works for XYZs and other "simplified
interface" types e.g. is it appropriate to
have initiative booklets for such a small
number of widgets etc
TH 23/3: no test data for acute - has it got
wiped out by the test server rebuild?
Suggest adding test data for
"a.test:General Practice" since this is a test
org type

Pass

2) The message telling me that there


Low
are no documents available for a given
org type: can you format it as an error
instead of an instruction. Check with
Tom re. what CSS class to use for an
error

Closed

nili: 2 - amended mark-up format to


errormessage for the 'no documents
available'message.
TH 15/3: Error message shown in black, not
red - you have used class "errormessage" are you sure this is the right one?

There is *not* an option to download widgets in


bulk

1/12/2010 N/A

nili

Pass

There is *not* an option to download widgets in


bulk

1/12/2010 N/A

nili

Pass

Link is there

High

Closed

There is *not* an option to download widgets in


bulk

1/12/2010 N/A

nili

Pass

Option is there

High

Closed

Pass

If I open a fresh browser window, don't High


log in and type
"http://igttest1dr/igt/DocumentDownloa
d.aspx" into the URL, I can get to the
downloads page. Shouldn't there be
some sort of role-based security which
blocks the page if I don't have the
relevant permissions?

Withdrawn This is a general issue across the whole


site, not just specific to this page separate story required to fix it.
CMC:People need to get a bit smarter
about how pages are called not just case of
getting to the page but also need to make
sure query string parameters aren't
spoofed etc. These are the kind of issues
which will cause us to fail Pen Test if not
careful

All the booklets seem to point to the


same (non existent) PDF file - is this
just because of how you've set up the
test data? If so, can you set up test
data with different file names so I can
see that you're displaying the correct
link?

Medium

Closed

The booklet is in PDF format


The content of the PDF document is "Widget
Document Placeholder" - this will change once
S065 and/or S082 are delivered

Y
N

There is an option to download the widgets as a


spreadsheet for my org type

1/12/2010
1/12/2010

1/12/2010
N/A

N/A

2/25/2010

3/17/2010 nili
3/17/2010 nili

Pass
Pass

3/17/2010 nili
nili

Pass
Pass

File not found


Medium
Can you make the pop-up window a bit
taller - currently it's not so tall and you
can only see the (blank) top third of the
booklet. Can you make it tall enough so
that some of the booklet header page
text is visible?

Closed
Closed

3/17/2010 nili

Pass

Even though it's only a test file for now, Medium


the text should read "All widgets"

Closed

CMC: This is fixed by using the spreadsheet


PQRT_Widgets_workbook_AcUTE_v8 (draft
A).xls as mentioned below

Pass

For some reason this link is underlined Low


but all the others are not. Can you get
them consisten please (check with Tom
re. link styling)

Closed

nili: all the links should now be underlined

The file is an MS Excel workbook (XLS format i.e. Y


compatible with Excel 97-2003)

The spreadsheet is a static placeholder


document - this will change once S106 is
delivered.

2/25/2010

N/A

N/A

nili

Pass

File not found - there is an example file Medium


you can use in the prototype folder

Closed

Nili: test web.config amended to specify


folder holding widget documents
TH 23/3: the link works now but

nili

Pass

Could you use the example


spreadsheet in the prototype
("PQRT_widgets_workbook_ACUTE_v8
(draft A).xls") as the placeholder file?

Low

Closed

CMC:Am using suggested file for Test Acute


org type

Page title - change to "Bulk Email


Details" - no hyphen and capital "D"

Low

Closed

"Not yet created" should be "(not yet


created)"

Low

Closed

TBC

Ability to add review comments (at what level?)

TBC

Also for use by auditor


Remove general comments from widgets list

TBC
TBC

The system displays the "Bulk Email List" screen

12/21/2009 N/A

Des

Pass

There is an option to create a new bulk email

12/21/2009 N/A

Des

Pass

The system displays the "Bulk Email Details"


screen

12/21/2009 N/A

Des

Pass

The system tells me that the email will be sent


overnight

12/21/2009 N/A

Des

Pass

The system requests me to specify details for the Y


email, as follows:

12/21/2009 N/A

Des

Pass

Organisation type(s) to send the email to


(multiple selection, default none selected)

12/21/2009 N/A

Des

Pass

Role(s) to send the email to (multiple selection,


default none selected)

12/21/2009 N/A

Des

Pass

10

Assessment status of organisations to send the


email to (multiple selection, default none
selected)

12/21/2009 N/A

Des

11
12

Subject line of the email (default blank)


Body text of the email (rich text, default blank)

Y
Y

12/21/2009 N/A
12/21/2009 N/A

Des
Des

Date to send the email (default today)

12/21/2009 N/A

Des

Pass

The system validates that:


I have selected at least one organisation type

N/A

12/21/2009 N/A

Des

Pass

Error text - "atleast" should be "at least" Low

Closed

I have selected at least one role

N/A

12/21/2009 N/A

Des

Pass

Error text - "atleast" should be "at least" Low

Closed

I have selected at least one assessment status

N/A

12/21/2009 N/A

Des

Pass

Error text - "atleast" should be "at least" Low

Closed

I have specified a subject line


I have specified some body text
I have specified a date to send the email it is
either today (but only if the current time is
before 6pm) or a date in the future

N/A
N/A
N/A

12/21/2009 N/A
12/21/2009 N/A
12/21/2009 N/A

Des
Des
Des

Pass
Pass
Pass

I put a blank date and no error message Medium


came up

Closed

I typed "efkverk" in the date field and


got a server error

Closed

Request to view a list of bulk emails

2
3
4
5

13
14
15
16

nili: fixed, but defaults to first orgtype (in


ascending alphabetical order) ... Which is
usually Acute.

The downloads for the (default) selected org type Y


are displayed

TBC previously done via widgets list but Show all widgets and all details (readonly)
now there's extra detail to worry about Include links for evidence
Doesn't need to be printable

Main

Pass

nili

CMC: Have set up different dummy


"placeholder" files for test acute and XYZ
types

CMC:The link is just a standard a href tag


with target of blank. Therefore size is not
being explicity set and will just take the
default browser behaviour
TH 22/05: can you change it so that it
*does* open the window at a specific size
then please? CMC: Made to be maxiumum
size think we can get away with whilst still
supporting 800x600 resolution

Download and open the file

S055

nili

The widget downloads page is displayed


N
Widgets documents are available for download in N
the following groupings (additional to S050):
1) Per-Initiative booklets: all widgets from a given
initiative in a single booklet

6
7
8

3
4

N/A

1/12/2010 N/A

Request to download widgets in bulk

2
3

S069

Navigate to a specific widget

S076

The booklet is in PDF format

Select another org type and request to


view the downloads for it

1d

Medium

Log in as an XYZ ABC user


Request to download widgets in bulk

3
4

Closed

Download and open the file

3
1
2

4
5
1b

High

Download and open the file

12

1
2

No link on widgets list page

Request to download widgets in bulk

1a

N/A

Request to view the (v8+) widgets list

8a

N/A

Can't test until above test passes

Request to create a bulk email

Pass

CMC: Need for rich text/HTML editor

Pass
Pass

Enter details for the email


Request to create the email

Pass

High

16a

S057

Add Bulk Email


Attachments

XYZ ABC User

Attach files to pending


bulk emails

17

The system creates (persists) a "pending" email


with all the details I have specified

12/21/2009 N/A

Des

Pass

18

The system returns to the "Bulk email List" screen Y

12/21/2009 N/A

Des

Pass

The breadcrumb trail shows "Org Admin Low


-> Bulk E-mails List -> Bulk E-mails
List"!

Closed

19

The system informs me that it has created a new Y


bulk email which is "pending"

12/21/2009 N/A

Des

Pass

Change "is created" to "created"


(present tense inappropriate)
Remove underline from message
subject
Remove hyphen before message
subject or add another one after
message subject
Change "e-mail" to "email"

Low

Closed

20

The system reminds me the date that the email


will be sent

12/21/2009 N/A

Des

Pass

Change "e-mail" to "email"

Low

Closed

21

The system reminds me that I can amend or


Y
delete the email up to 6pm on the date it will be
sent

12/21/2009 N/A

Des

Pass

Change "e-mail" to "email"

Low

Closed

The system highlights the failed validation


criteria

12/21/2009 N/A

Des

Pass

The system returns to the "Bulk email List" screen N

12/21/2009 N/A

Des

Pass

The breadcrumb trail shows "Org Admin Low


-> Bulk E-mails List -> Bulk E-mails
List"!

Closed

The screen displays the "Bulk Email Details"


screen

12/21/2009 N/A

Des

Pass

The system provides an option to specify


attachments

12/21/2009 N/A

Des

Pass

1) Can you add a label "Filename:" to


the left of the field in the attachment
popup
2) Can you make the filename field
maybe twice as wide (so you can see
more of the filename at one time)

Closed

3/4/2010 N/A

Des

12/21/2009 N/A

Des

Pass

Selected file, clicked "Add Attachment"


and got a server error

Closed

Pass

Tried adding the same file twice and got Low


a server error:
"An item with the same key has already
been added."
Only fix this if it is relatively easy to do

Closed

User will be informed, if they try to add the


same filename. Is this okay or do we need
to allow the user to attach the same file
more than once.
TH 23/3: rete4sted this - I still get a server
error; needs to be a user-friendly error.
CMC 26/4 Cannot get this error to occur on
local mahcine or test server, suspect may
have been some config changes, Suggest
re-testing

I get the following error message in the Medium


pop-up:

Closed

CMC: Cannot get to occur, have made


confiog changes, suggest re-test.

Shown as from "PQR App Administrator" Medium


- remove this name so the email
address only is showing

Closed

Des 24/05 - Fixed

Still marked as pending

Closed

Des 24/05 - Fixed

Pass

As discussed, email sender should write Medium


some output to a log file stating what
time it ran and a summary of the
results of the run (number of emails
sent, Ids of emails sent, number of
recipients for each one)

Closed

Des 24/05 - Fixed

Email content needs to be exactly as


users would see it

Closed

Des 24/05 - Fixed

1
2

Validation criteria not met

15a

3
1
2

Rejoin main flow at step 14


Request to cancel

Main

Request to create a bulk email

4
5

6a

Enter (valid) details for the email


Specify one or more files to attach to the
email

The system validates that the file is not too large N


(configurable but default 1MB)

The system displays the name(s) of the file(s)


specified

8
9

Request to create the email

File too large

The system persists the files along with the


pending email

N/A

The system displays an appropriate error


message

Pass
CMC: Presumably this process uploads
said file to the server. Do we need to
ensure files are unique across emails
i.e. can't get overwritten by another
upload. Store as BLOBs or on
FileSystem ? BLOBS gets round issue
of multiple web servers

12/21/2009 N/A

Des

Pass

3/4/2010 N/A

Des

Pass

Server Error in '/PQRT' Application.


------------------------------------------------------------------------------Maximum request length exceeded.

8a

Request to remove one of the


attachments

8b

The system no longer displays the name of the


removed attachment

12/21/2009 N/A

Des

Pass

The system opens the specified file in a new


browser window (tech note: different file types
have different behaviour re. opening a new
window e.g. for a PDF you have to explicitly
launch a new window whereas for Word/Excel
you don't)

12/21/2009 N/A

Des

Pass

Validate that the system was *not* in bulk email


test mode (configurable)

N/A

The system has sent the bulk email to all


specified recipients

N/A

12/21/2009 N/A

CMC

CMC: Individual recipients or en-masse Pass


recipients ?
TH: can be either so long as users
don't see other users' e-mail addresses

The system has *not* sent the email to users


with locked accounts

N/A

12/21/2009 N/A

CMC

Pass

The email "from" address is a "do not reply"


address

N/A

12/21/2009 N/A

CMC

Pass

The e-mail (when received) does not contain the N/A


e-mail addresses of any other recipients.

4/26/2010 N/A

CMC

Pass

7
8

The subject line is as specified


The body text is as specified (with rich text
formatting)

N/A
N/A

12/21/2009 N/A
12/21/2009 N/A

CMC
CMC

Pass
CMC: Needs to be sent HTML mail then Pass

9
10

The attachments are as specified


The email is marked as "sent"

N/A
N/A

12/21/2009 N/A
12/21/2009 N/A

CMC
CMC

Pass
CMC: What happens if not sent
Pass
TH: the only reason it would not be
sent is due to a technical failure - not
something I would document in the FS
- but obviously you need to code for
data integrity i.e. Don't mark it as sent
unless it was actually sent

3
1

Rejoin main flow at step 7


Request to view an attachment (click on
its file name)

S058

Send Bulk Email

XYZ ABC User

Have the system send all


due bulk emails

Main

2a

1
2

Wait until the morning after a bulk email


was due to be sent

The system has sent the bulk email to a single


(configurable) test account (default value
tony.heap@nhs.net)

View Bulk Emails

XYZ ABC User

View bulk emails (both


sent and pending)

Main

2a

S060

Amend Bulk Email

XYZ ABC User

Amend a pending bulk


email

Main

Delete Bulk Email

XYZ ABC User

Delete a pending bulk


email

Main

View a sent email

Main

XYZ ABC User

Have a nice look & feel for Main


the bulk email function

N/A

Pass

Des
Des

Pass

12/21/2009 N/A
12/21/2009 N/A

Des
Des

Pass
Pass

For each email the system tells me the "send


date" (the date it was sent or is due to be sent)

12/21/2009 N/A

Des

Pass

For each email the system tells me the status


(Sent or Pending)

12/21/2009 N/A

Des

Pass

The system displays a message to indicate that


there are no bulk emails

Des
Des

Pass

There are currently no bulk emails


N/A

N/A

Request to view a list of bulk emails


12/21/2009 N/A

Des

Pass

The system displays the "Bulk Email Details"


screen

12/21/2009 N/A

Des
Des

Pass

All details of the email are populated


All details of the email are editable

N
Y

12/21/2009 N/A
12/21/2009 N/A

The system performs the same validations as per N


S056 (Create Bulk Email)

10

The system updates (persists) the "pending"


email with all the details I have specified

11

Request to edit a pending email

Validation criteria not met

3
1
2

Rejoin main flow at step 7


Request to cancel

Request to view a list of bulk emails

1
2

Pass

The system returns to the "Bulk Email List" screen N

12/21/2009 N/A

Des

Pass

The system highlights the failed validation


criteria

12/21/2009 N/A

Des
Des

Pass

The system returns to the "Bulk Email List" screen N

12/21/2009 N/A

Des
Des
Des

Pass

Closed

TH 10/3 - breadcrumb needs to change


from "Bulk Email List" to "Bulk Emails" to
match main page title

Message says "No Bulk Email sent yet"


- change it to "No Bulk Emails created
yet" (notice plural!)

Low

Closed

TH 10/3 - the message is in blue on a blue


background so I can't see it!
Can you change it to a simple paragraph of
text instead of putting it in a table?

Pass

For each pending email there is an option to


delete the email

12/21/2009 N/A

Des

Pass

The system asks me to confirm

12/21/2009 N/A

Des
Des

Pass

The popup box styling is all wrong (e.g. High


Transparent background) - it used to be
OK so presume it got broke by the restyling activity

Closed

Pass

The popup box is not modal

High

Closed

N
N

12/21/2009 N/A
12/21/2009 N/A

Des
Des
Des
Des

The deleted email has been removed from the list N

12/21/2009 N/A

Des

Pass

The system displays the "Bulk Email Details"


screen

12/21/2009 N/A

Des
Des

Pass

There is an option to delete the email

12/21/2009 N/A

Rejoin main flow at step 4

12/21/2009 N/A

Email was deleted without asking for


confirmation

High

Closed

Is it possible (easy) to make the Body


section non-editable? If not, don't
worry, there is no "Save" button so it's
not a big deal

Des
Des
Des

Pass
Pass

Pass
Pass

TH 23/3: failed retest

Des
For each sent email there is an option to view the Y
email

12/21/2009 N/A

Des

Pass

The system displays the "Bulk Email Details"


screen

12/21/2009 N/A

Des
Des

Pass

All details of the email are populated


All details of the email are *not* editable

N
N

12/21/2009 N/A
12/21/2009 N/A

Des
Des

Pass
Pass

Low

Closed

There is *not* an option to save the email

12/21/2009 N/A

Des

Pass

Can you change the Cancel button to a Low


Done button

Closed

Pass

"Create Bulk Email" should be "Create


new bulk email"

Low

Closed

Des 24/05 - Fixed

Pass

Context help icons should be below the Low


table headings (use <br>)

Closed

Des 24/05 - Fixed

Pass

The "New bulk email created"


messages should be within a <div
class="infoMessage">

Low

Closed

Des 24/05 - Fixed

Pass

Can you make the tab section a bit


taller so that all the User Roles fit in
without needing a scroll bar

Low

Closed

Des 24/05 - Fixed

Pass

The "required field" marker for Subject


has wrapped on to the next line (IE6,
IE7). Perhaps make the subject box a
little narrower?

Low

Closed

Des 24/05 - Fixed

Pass

"Add Attachments" should be "Add


attachment" (lower case A and
singular)

Low

Closed

Des 24/05 - Fixed

Request to view a sent email

Go to the Bulk Email List screen

Des

Look & feel is as per prototype page


"bulk_email_list.html"

Low

Des

Request to edit a pending email

Request to view a list of bulk emails

3
4

Des

The system deletes the email


The system re-displayes the "Bulk Email List"
screen

12/21/2009 N/A

Confirm

Request to delete the email

Request to delete a pending email

3
4
5

5
6

Pass
Pass

12/21/2009 N/A

Des
Des
Des
Des
Des

Edit the email details


Request to save my changes

1
2

Page title - change "E-mail" to "Email"


(also in breadcrumb)

Des
For each pending email there is an option to edit Y
the email

3
4

Bulk Email Look & Feel

N/A

12/21/2009 N/A

S102

Rejoin main flow at step 3 (but use the


N/A
attachment/appendix to determine the intended
recipients)

Y
Y

XYZ ABC User

Pass

5
6
7

View Bulk Email

Pass

N/A

The list is in reverse chronological order


For each email the system tells me the subject
line

3
4

S080

N/A

N/A

The system displays a list of all bulk emails,


pending and sent

3a

N/A

3
4

5
6
7
8
9

S061

N/A

3
4

8a

Pass

The email includes an attachment or appendix


N/A
which is a list of the recipients that it would have
sent it to if not in test mode

Request to view a list of bulk emails

9a

N/A

System is in bulk email test mode

S059

CMC: SQL Agent job? If so need files


as BLOBS in database. SQL CLR code
to convert BLOB to file
N/A

N/A

Request to create a bulk email


Look & feel is as per prototype page
"bulk_email_details.html"

N/A

Des

Des
Des

S062

View Undelivered Bulk


emails

XYZ ABC User

View a list of undelivered


bulk emails so that I can
consider whether to
amend user details

S063

View Glossary Term


Definition

General User

View the definition of a


Main
term that is defined in the
glossary

TBC

S064

View Glossary

General User

View the entire glossary

Main

Main

The mouse cursor changes to a "hand" shape as


it would for a hyperlink

1/12/2010

3/17/2010

CMC

Pass

The "explanation" of the phrase appears in a


float-over window (like a "tooltip")

1/12/2010

3/17/2010

CMC

Pass

The explanation appears immediately (no delay)

1/12/2010

3/17/2010

CMC

Pass

The explanation remains indefinitely whilst the


N
mouse cursor is positioned over the term (tech
note: standard tooltip using "title" attribute of
<a> tag disappears after a few seconds. Suggest
using jquery tooltip plugin or similar)

1/12/2010

3/17/2010

CMC

Pass

The explanation consists of data from the


matching glossary entry. A glossary entry
matches if either the term or acronym is a (case
insensitive) match for the marked up phrase. If
more than one glossary entry matches the
marked up phrase then the selection of which
entry to display is arbitrary.

1/12/2010

3/17/2010

RJM

Pass

Don't have enough test data to test this Medium


- can you add some more glossarised
terms to the guidance text so I can try
out the various options. Whilst you're at
it, can you remove the glossary tags
from Caldicott Guardian and IM&T (I
think they have been copied across
from the prototype HTML)

Closed

See guidance for Acute Test 101 widget for


examples of glossary items

The format of the explanation is "term


(acronym): definition" (but see below for
qualifiers and exceptions)

1/12/2010

3/17/2010

CMC

Pass

Can you change the formatting so that


(a) all the text is a bit bigger -standard
Windows tooltip size and (b) the
acronym is in bold but not italics

Low

Closed

CMC: previously text size was set to xsmall have now set it to small which is the
next size up. If this is too large then we
would have to explicity set the font-size to
a paticular point which is not good
accessibility practice.

10

The term is capitalised as per a title e.g. "Code of Y


Conduct"

4/26/2010

3/17/2010

CMC

Pass

Not really a fail but can you confirm


Low
that you haven't actually coded
anything for this - it's supposed to be
an authoring note to the Policy Team, as
opposed to anything the system needs
to do.

Closed

See guidance for Acute Test 101 widget for


an example

11

If the acronym is not specified then it is omitted


along with its surrounding parentheses and
leading space.

1/12/2010

3/17/2010

RJM

Pass

Can't test - need test data

Medium

Closed

See guidance for Acute Test 101 widget for


examples of glossary items

12

If the definition is not specified then it is omitted Y


along with the leading colon.

1/12/2010

3/17/2010

RJM

Pass

Can't test - need test data

Medium

Closed

See guidance for Acute Test 101 widget for


examples of glossary items

The explanation appears again.

General User

View a
printable/downloadable
version of the glossary

Main

There is no indicator as to which letter Medium


of the alphabet you are looking at - this
is a problem for e.g. "E" where there
are no glossary terms. How about
making the current letter a different
colour, or not a link?

Closed

Highlights selected letter in red with no


underline

No test data so can't test - can you add Medium


a glossary term which is an
abbreviation only. Also, how will this be
displayed in terms of alphabetical
order?

Closed

CMC:test data now there try N for No


defintion glossary term. Note glossary
entry always has a term and it is this which
is used to order the glossary as per step 6
above

Float the mouse cursor over the term

1/12/2010

3/17/2010

CMC

Pass

1/12/2010

3/17/2010

CMC

Pass

Rejoin main flow at step 2

1/21/2010

3/17/2010

RJM

Pass

The term is highlighted in some way so as to


indicate that it is a glossary term (e.g. Italics).

1/12/2010

CMC

Pass

The term is *not* hyperlinked through to


anywhere

1/12/2010

CMC

Pass

There is an option to view the glossary (on the


nav bar)

1/12/2010

3/17/2010

N/A

The system displays the glossary in a separate


(non-modal) tab/window

12/21/2009

3/17/2010

Pass

5
6

The glossary lists all glossary terms


Y
The terms are in alphabetical order (case
Y
insensitive) - using the full term, not the acronym

12/21/2009
12/21/2009

3/17/2010
3/17/2010

Pass
Pass

For each term, the acronym is displayed if


applicable

12/21/2009

3/17/2010

Pass

For each term, the definition is displayed if


Y
applicable (might not be applicable if the term is
in the glossary purely to expand an abbreviation)

12/21/2009

3/17/2010

Pass

Click the term

View a widget within the widget list that


has a term marked up as a glossary
term within the widget question text

View the printable version of a (v8+)


widget that has a term marked up as a
glossary term within any of its RATML
fields

View any page

View the glossary

There is a (single) option to print or download


the glossary

1/12/2010

3/17/2010

RJM

Pass

The system opens up the printable/downloadable Y


version of the glossary in a new browser window

1/12/2010

3/17/2010

RJM

Pass

5
6

The printable version is in PDF format.


Options to save or print the glossary are
availavle (standard Acrobat Reader functions so
no need to actually test them).

Y
Y

1/12/2010
1/12/2010

3/17/2010
3/17/2010

RJM
RJM

Pass
Pass

The content of the glossary is as per the online


version

1/12/2010

3/17/2010

RJM

Pass

Will test when new XSL is in place (also


need to run Glossary PDF publish
process)

Page footer includes page number (central)

1/12/2010

RJM

Pass

No page footer. I have updated the


glossary XSL to include a page footer
(available on request) but note that it
will also require a change to the
glossary XML file because I have refactored it a bit

The glossary is *not* version controlled

N/A

1/12/2010

CMC

Pass

Request to print or download the


glossary

9
Sys Admin

Publish a new version of


the Knowledge Base
based on the data held in
RAT

Main

Manually copy all (new or amended) KB


"internal" files to the correct location on
the PQRT web server(s)

Request to import KB data from RAT into


PQRT staging tables
N/A

Des

Pass

N/A

N/A

Des

Pass

The system updates its KB tables to match the


data in the staging tables

N/A

N/A

N/A

Des

Pass

Using real KB data...System bombed


High
out with no error message. I think it
was part way through processing as it
has copied 202 out of 244 KB docs from
Source to KnowledgeBaseNew. The first
defect is that there should be an error
message

Closed

Pass

Once you have got it to display the


error message, fix the underlying
defect too!

High

Closed

Note that the "weblink" field is in MS Access


weblink format - to get the "raw" URL, take the
string between the first and second "#" symbol

N/A

N/A

N/A

Pass

Any records in the staging table for which Title,


Type or Location is not specified are *not*
published, and the user is presented with a
warning message to this effect.

N/A

N/A

N/A

Pending

Any records for which Location is "External" and


"Weblink" is not specified are *not* published,
and the user is presented with a warning

N/A

N/A

N/A

Pending

10

Any records for which Location is "Internal" and


"FileName" is not specified are *not* published,
and the user is presented with a warning

N/A

N/A

N/A

11

The system determines the file type (extension)


and size for each "internal" resource file and
records this in the DB

N/A

N/A

N/A

Pass

File size slightly out - you need to


divide the number of bytes by 1024,
not 1000, to get KB

Low

Closed

Desi 08/06: Fixed

Pass

Can you put the file type in caps and


remove the leading dot?

Low

Closed

Desi 08/06: Fixed

Pass

No KB docs being displayed (but are


appearing in req'ts pages)

High

Closed

System says "files have been exported


successfully" - should say "imported"

Low

Closed

14

View the KB via the PQRT web interface


(ref. S075)

N/A

N/A

N/A

Resource is correctly displayed (as per existing


KB functionality)

N/A

N/A

N/A

Des
Des

One or more KB resources are missing


from the PQRT web server(s)

Des

Pass

Des

System displays error including list of missing


resources

N/A

N/A

N/A

Des

Pass

Abandon the function

N/A

N/A

N/A

Des

Pass

The system populates PQRT staging tables with


widget data form RAT (identical format)

N/A

N/A

N/A

thma1

Pass

3.1

PQRT looks at the version info in its own


N/A
database to determine the major version number
for the "current" widget set

N/A

N/A

thma1

Pass

PQRT determines and displays the widgets that


would be added by the re-publish process (i.e.
Widget variants in the staging tables but not in
the live PQRT database for the "current" major
version)

N/A

N/A

N/A

thma1

Pass

When displying the org type, display


the org type name, not the org type
short name

Low

Closed

PQRT determines and displays the widgets that


N/A
would be uplifted to a new minor version by the
re-publish process (i.e. Widget variants already in
the PQRT live database but at a lower minor
version for the "current" major version)

N/A

N/A

thma1

Pass

Version numbers are reversed (e.g. It


says "will be uplifted from v8.1 to
v8.0")

Low

Closed

PQRT determines and displays the widgets that


N/A
(in theory) would be deleted by the re-publish
process (i.e. Widget variants in the PQRT live
database but not in the staging tables for the
"current" major version), and makes it clear that
deletion is a manual process.

N/A

N/A

thma1

Pass

If there are any widgets to be added, uplifted or N/A


deleted for a given org type, PQRT validates that
there are no existing assessments from an
affected organisation where the assessment
status is anything other that "started".

N/A

N/A

thma1

Pass

PQRT runs the "knowledge base publish" function N/A


first (ref. S066) in order to make sure the PQRT
database has the latest knowledge base data in
it

N/A

N/A

thma1

Pass

I deliberately caused the KB publish to Low


fail by removing some of the KB files.
The system did fail and tell me why but
it also gave me the following error:
"Publication failed with: Unable to cast
object of type 'System.Int32' to type
'System.String'." which sounds like a
coding error to me

Closed

PQRT updates its widget records to match the


data in the staging tables, as follows:

N/A

N/A

thma1

Pass

Got error: "Publication failed with:


High
Unable to cast object of type
'System.Int32' to type 'System.String'."

Closed

3
Main

Pending

Des

Des
Correct (new) version of the KB is displayed (as
per existing KB functionality)

Request to view a specific (internal) KB


resource (ref. S075)

15

Publish or re-publish a
version of the widgets
based on the data held in
RAT (online widgets only)

Des
N/A

Run KB "publish" process

13

Sys Admin

Des

N/A

12

Publish Widgets - Online


Version

Closed

The system validates that all "internal" KB


resources exist on the PQRT web server(s)

4
5

S065

Medium

PQRT staging tables populated with KB data from N/A


RAT (identical format)

5a

Superseded by S078 - link is on


Resources page instead

Request to view the glossary

Publish Knowledge Base

CMC:Will always have term but


acronym and defintion are optional

Move the mouse cursor away and float it


over the term again

S066

CMC:Could use dotted underline if


possible

The system displays the entire glossary in a


Y
separate (non-modal) tab/window (ref. S064 View
Glossary), scrolled down to the selected term.

3
4

View
Printable/Downloadable
Version of Glossary

Close4d

CMC

S071

Dotted underline good.


Low
Can your remove the italics (apparently
it's not so good for disabled users)
Can you change the colour (I'm thinking
green - I'll put something in the
prototype

CMC: Note glossary terms marked by


<g></g>. Within these tags will
either have the term or acronym.
3/17/2010

2
Identify glossary terms in
the printable version of a
widget

Pass

Des 24/05 - Fixed

1/12/2010

14
15
16

General User

Closed

13

View Glossary Term


(Printable)

Created a new bulk email with no


High
attachments. Tried to edit it and got a
system error (see email from TH to Des
on 20/05/2010)

The phrase is highlighted so that it looks similar


to but distinct from a normal hyperlink (e.g.
Underlined but in a different colour)

S070

Pass

Needs technical investigation into how


it can be achieved

12/21/2009 N/A

View a (v8+) widget that has a phrase


marked up as a glossary term within any
of its RATML fields

1b

TBC

Request to import widget and


knowledge base data from RAT into
PQRT staging tables

8
9

11

Request to run widget "publish" process


(in PQRT).

Confirm that I wish to proceed

N/A

RJM

12

Widgets that don't already exist (according to


widget number, major version number and org
type) are added.

N/A

N/A

N/A

thma1

Pass

13

Widgets that require a minor version uplift are


N/A
replaced with the new minor version.
Note: it can be assumed that attainment levels,
attainment criteria and evidence items are not
added or removed from one minor version to the
next (this would cause problems with existing
assessments), but that widget origins and widget
changes may be added or removed.

N/A

N/A

thma1

Pass

14

References to KB resources are correctly mapped N/A


across from staging tables.

N/A

N/A

thma1

N/A

Superseded by S201

15

Where a KB resource does not exist in the PQRT


database (because it failed the KB publish
process as per S066), the widget is not linked to
it, and no warning message is displayed.

N/A

N/A

N/A

thma1

N/A

Superseded by S201

16

Links to existing assessments are maintained

N/A

N/A

N/A

thma1

Pass

17

RATML fields are converted into HTML "snippets" N/A


as appropriate for display (see stories S013S021)

N/A

N/A

thma1

Pass

Correct (new) version of widget is displayed.


Note: format/content of page is specified in
S013-S021.

N/A

N/A

thma1

Pass

Evidence items have speech marks


around them

Medium

Closed

Pass

In the KB table, can the file type be in


caps and with no leading dot? This
probably needs fixing within the
knowledge base publish function

Low

Closed

18

View online version of widget (ref.


stories S013-S021)

19

7a

7b

S082

Publish Widgets - Printable Sys Admin


Version

Publish or re-publish the


printable versions of the
widgets

Main

PQRT displays a list of affected organisations


N/A
(including Name, organisation Code, assessment
status)

N/A

N/A

thma1

Pass

The system tells me that it cannot proceed with N/A


the re-publish because some organisations would
be affected.

N/A

N/A

thma1

Pass

PQRT displays a list of affected organisations


N/A
(including Name, organisation Code, assessment
status)

N/A

N/A

thma1

Pass

The system warns me that I should only proceed N/A


with the re-publish if it is to reflect a simple
change (e.g. Typo fix) because some
organisations would be affected.

N/A

N/A

thma1

Rejoin main flow at step 8 (confirmation)

Sys Admin

Publish or re-publish the


ZIP file downloads for the
widgets

Main

2a

2b

S100

Publish Widgets - Booklet


Downloads

Sys Admin

Publish or re-publish the


Main
booklet downloads for the
widgets

Would not let me proceed when adding Medium


a req't for an XYZBP even though the
only affected assessment was for a CTP
(which was only affected by deletions)

Closed

Pass

The system told me I *cannot* publish,


even though I only have req'ts to be
uplifted, not added

Medium

Closed

Pass

The system warning was displayed


*before* the summary of affected orgs
instead of after

Low

Closed

There are existing assessments that


would be affected by an uplifted or
deleted widget

This story extends S065 by also


generating the printable versions of the
widgets (continue on from the end of
S065).

Request to view the printable version of


a widget
Correct (new) version of widget document is
displayed.

The document does not have a specific title - it


begins with the Header Panel.

Publish Widgets - ZIP File


Downloads

RJM

There are existing assessments that


would be affected by an *added* widget

S099

N/A

thma1

N/A

N/A

N/A

1/12/2010

thma1

Pass

Pass

The publish tool crashed out before


High
copying the widget documents up to
the web server - suspicion is it's to do
with file permissions - not being able to
overwrite existing files

Withdrawn TH 16/6 for now it's a manual process to


copy the files into the web server folder,
but needs addressing longer term
TH 6/7 raised a separate defect in Misc
Defects 2

Pass

The system didn't provide any sort of


error message when it crashed out

Medium

Closed

Pass

The system didn't roll back the


database changes when it crashed out
trying to copy the files

High

Closed

Pass

Your XSL files are out of date. I will send High


you a new set. When you get these, do
not reformat them or pretty-print them
because it causes FOP to insert
whitespace where it's not wanted.

Closed

Pass

I notice in the App/Resources folder you Low


have widgetPreview.xsl, widgetCore.xsl
and widgetBookletFullWidget2fo.xsl.
You do not need these files. Suggest
removing to avoid confusion/clutter.

Closed

Pass

On the test server, I notice the XML


Low
files generated in "Output" are suffixed
".PDF.XML" whereas they should
probably just be ".XML". Not a
functional fail, obviously, but confusing
for support usersf

Withdrawn This helps grouping them together in the


file space - I can delete these after
publish...??
TH 9/6 fair enough - leave as-is

Page footer includes page number and page


count (central) and key info (RHS): req't no., org
type, req't version (major/minor) e.g. "R101 |
Acute Trust | v8.0"

11/30/2009

11/25/2009 thma1

Pass

All sections are the same as the on-line widgets


page except where stated below.

11/30/2009

11/25/2009 thma1

Pass

Key reqt icon not appearing in header


box - is this due to a missing GIF?

Medium

Closed

Pass

Knowledge base items are not in the


correct order - should be ordered by
sequence ID

Medium

Closed

Pass

Knowledge base "exemplar" section


missing in some cases e.g. Acute reqt
3. They appear to be missing from the
XML file.

Medium

Closed

thma1

Pass

Guidance section heading is present needs removing from XSL (Tony to do)

Low

Closed

The Guidance Section excludes the section


heading "Guidance"

The Attainment Levels section is titled


Y
"Attainment Levels (including Checklist)" in order
to make it clear that the previously separate
checklists documents have been incorporated

11/30/2009

11/25/2009 thma1

Pass

Just Attainment Levels (Tony to fix in


XSL)

Low

Closed

10

The Attainment Levels section mirrors the


Y
content on the on-line widgets page but in a
format suitable for printing and filling in by hand
(including evidence types and space to make
notes).

11/18/2009

11/25/2009 thma1

Pass

Attainment c riterion ID section can be


narrower now we don't have Maint

Low

Closed

Pass

Maintenance criteria are not showing


the preliminary phrase "[Only required
if Attainment Level 3 was achieved in
the previous assessment]". This is
present and correct in the XSL but
needs to be triggered by the presence
of a <maintenanceCriterion/> tag in
the XML file

Medium

Closed

High

Closed

7/5/10 You have used org name instead of


org code e.g. It should be "AMT" not
"Ambulance Trust"
TH 27/5: now the org type is blank
meaning that the files for the different org
types have overwritten one another
TH 27/5: you have used the Org Type ID
instead of the Org Type "Code" field

1/12/2010 N/A

11

The Past Level box has a footnote indicating that Y


this information can be found online via the PQRT

1/12/2010

thma1

Pass

12

For a logged on user, the printable version is


Y
*not* populated with any of the data they have
entered so far (a separate report will be provided
to address this need)

11/30/2009

11/25/2009 thma1

Pass

The ZIP file contains a file for each widget for the N
org type

1/12/2010

3/17/2010 thma1

Pass

The filename should be


"PQRT_Widgets_<org code>.zip"

The widget file names are such that the widgets N


appear in ascending numerical order, even if the
widgets have different numbers of digits

1/12/2010

3/17/2010 thma1

Pass

The reqt numbers need to be padded to Low


3 digits with zeros to make sure they
will appear in numerical order

Closed

CMC:With new numbering convention have


0 padded to 4 characters rather than 3.

5
7

Each widget file is a PDF file


Each widget is in the same format as the
individual printable version (ref. S022)

Y
Y

1/12/2010
1/12/2010

3/17/2010 thma1
3/17/2010 thma1

Pass
Pass

The ZIP file is as per the full widget format


except for the differences stated below:

1/12/2010

3/17/2010 thma1

Pass

The Attainment Levels section is omitted from


each widget

1/12/2010

3/17/2010 thma1

Pass

The footer indicates that the booklet is "guidance N


only" format

1/12/2010

3/17/2010 thma1

Pass

No footer - can you check it's the latest Medium


version of widgetGuidanceOnly2fo.xsl,
containing:
<xsl:call-template
name="widgetFooter">
<xsl:with-param
name="variant">guidanceOnly</xsl:wi
th-param>
</xsl:call-template>

Closed

TH 7/6 Failed retest (need to rebuild test?)

The ZIP file is as per the full widget format


except for the differences stated below:

1/12/2010

3/17/2010 thma1

Pass

For each widget, the header information is in a


more compact format

1/12/2010

3/17/2010 thma1

Pass

For each widget, all sections other that the


Attainment Levels section are omitted

1/12/2010

3/17/2010 thma1

Pass

The footer indicates that the booklet is


"attainment levels/checklists only" format

1/12/2010

3/17/2010 thma1

Pass

The booklet has a title page which includes the


org type, widgets version and issue date

1/12/2010

thma1

Pass

On the Downloads page, the "all


High
widgets booklet" label is
"Confidentiality and Data Protection
Assurance (All Widgets, 107 KB),
whereas it should be "All widgets (PDF,
107 KB)"

Closed

Pass

The booklet filename should be


"PQRT_Widgets_Booklet_<org
code>_v<major version>.pdf

Closed

Pass

The booklet header page includes


High
"Confidentiality and Data Protection
Assurance" which it shouldn't. Looking
at the source XML file, you have
incorrectly inserted an
"<initiativeName>" tag at the top level
- this should only be inserted for an
initiative-specific booklet

Closed

Pass

On the downloads page, the "All


Widgets" booklet should be after the
individual initiative booklets

Low

Closed

On the TOC page the first initiative


heading is not being displayed. This is
an XSL fix by Tony

Medium

Closed

This story extends S065 by also


generating the ZIP file downloads for the
widgets (continue on from the end of
S065).

Download and open the full widget


format individual widgets (ref. S050)

Download and open the guidance only


format individual widgets

Download and open the attainment


levels/checklist only format individual
widgets

This story extends S065 by also


generating the PDF booklet downloads
for the widgets (continue on from the
end of S065).

Download and open the full widget


format booklet (ref. story S050)

Page footer includes page number and page


Y
count (central) and key info (RHS): org type, req't
version (major) e.g. "Acute Trust | v8"

1/12/2010

thma1

Pass

The booklet has a table of contents which mirrors Y


the format of the "Widget List" page

1/12/2010

thma1

Pass

The TOC includes a page number for each widget Y

1/12/2010

thma1

Pass
Pass

Medium

You have put version before org code

CMC:Will now dipslay below Initoative


booklets and Initiative booklets will be in
the correct "Initiative" order (previously
they weren't ordered at all)

2a

The booklet includes all widgets for the org type

1/12/2010

thma1

Pass

The widgets are in ascending numerical order

1/12/2010

thma1

Pass

The content of each widget is as per the


individual prinatble version of the widget

1/12/2010

thma1

Pass

The booklet is as per the full widget format


except for the differences stated below:

1/12/2010

thma1

Pass

The title page and footer indicate that the


booklet is "guidance only" format

1/12/2010

thma1

Pass

Download and open the guidance only


format booklet

4
9b

S101

S151

S106

Publish Widgets - PerInitiative Booklets

Publish Widgets Spreadsheet (Technology


Spike)

Publish Widgets Spreadsheet (List Sheet)

Sys Admin

Sys Admin

Sys Admin

Publish or re-publish the


Main
per-initiative booklet
downloads for the widgets

Publish or re-publish the


XL spreadsheet download
for the widgets (simple
version to prove
technology)

Publish or re-publish the


XL spreadsheet download
for the widgets (widgets
list sheet)

Main

Main

S148

Publish Widgets Spreadsheet (Details


Sheet)

Publish Widgets Spreadsheet (Report


sheet)

Sys Admin

Sys Admin

Publish or re-publish the


XL spreadsheet download
for the widgets (widgets
list sheet)

Publish or re-publish the


XL spreadsheet download
for the widgets (report
sheet)

Main

Main

Medium

Closed

The booklet filename should be


Medium
"PQRT_Widgets_Booklet_<org
code>_v<major
version>_Attainment_Levels_Only_Only.
pdf

Closed

You have put a suffix of


"Guidance_Only_Attainment_Levels_Only"!
CMC: And you've put a suffix of
Only_Only.pdf to the left ;-) However pretty
sure I know what you want and have fixed
it

The booklet filename should be


"PQRT_Widgets_Booklet_<org
code>_v<major version>_<initiative
name with underscores instead of
spaces>.pdf"
For the "guidance only" and
"attainment levels only" add the
relevant suffix "_Guidance_Only" or
"_Attainment_Levels_Only"

Medium

Closed

RJM: No fault found. Require more


information. Can not identify any truncated
files. Can not find any files with incorrect
filename. TH:You have put a suffix of
"Guidance_Only_Attainment_Levels_Only"!
Also it looks like the filename may have
been truncated at some point (difficult to
tell where)

Pass

Sorry I have sneaked this in as an extra Medium


widget. I have updated the XSL but you
will also need to add a new tag into the
XML - <initiativeName> - immediately
following
<organisationTypeLongName> in the
general header section (not within each
individual widget)

Closed

RJM: No fault found. InitiativeName tag is


being added to the WidgetSet node as
required.
TH 16/6:Initiative name not showing - I
checked the XML and you don't have an
<initiativeName> tag within the
<widgetSet>.

Pass

Can you change it so that the filename Medium


uses OrganisationType.Code instead of
OrganisationType.Description? This also
applies to all PDFs, booklets and ZIP
files.

Closed

Pass

The label for the spreadsheet link


should read "All widgets"

Closed

Pass

The filename should have "_v8" not just Low


"_8" in it

Closed

Closed

The Attainment Levels section is omitted from


each widget

1/12/2010

thma1

Pass

The booklet is as per the full widget format


except for the differences stated below:

1/12/2010

thma1

Pass

The title page and footer indicate that the


booklet is "attainment levels/checklists only"
format

1/12/2010

thma1

Pass

For each widget, the header information is in a


more compact format

1/12/2010

thma1

Pass

For each widget, all sections other that the


Attainment Levels section are omitted

1/12/2010

thma1

Pass

The booklet is as per the full widget format "all


widgets" booklet except for the differences
stated below:

1/12/2010

thma1

Pass

It only includes the widgets for the specified


initiative

1/12/2010

thma1

Pass

The TOC only shows the initiatives for the


specified initiative

1/12/2010

thma1

Pass

The header indicates which initiative is covered

1/12/2010

The spreadsheet file is an MS Excel workbook


(XLS file i.e. compatible with Excel 97-2003)

2/25/2010

TM

The spreadsheet has a sheet called "Widget List" Y


(first sheet)

2/28/2010

3/17/2010 TM

Pass

The sheet has the org type shown in the title (as Y
per prototype)

4/26/2010

TM

Pass

The general layout/formatting of the sheet is as


per "PQRT_widgets_workbook_ACUTE_v8.xls"
within the prototype

2/26/2010

3/17/2010 TM

Pass

The various column headings have comments as Y


per the prototype

2/27/2010

TM

Pass

The Widget List sheet contains a summary list of Y


all widgets, one per row

3/1/2010

3/17/2010 TM

Pass

The widgets are in sequential order

3/2/2010

3/17/2010 TM

Pass

Each widget has the following fields (columns):


- Widget number
- Key widget status
- Widget question text
- Past level
- Current level
- Target level

3/3/2010

3/17/2010 TM

Pass

Formatting of description field first row


is incorrect

Pass

Remove hyperlink from description field High

Closed

Fail

Rows are not quite high enough to fit


Low
the descriptions in - if I double-click the
row header to auto-adjust the height it
makes each one a bit bigger and then
it's OK. Can you simulate this via
ASPOSE to get them all the right
height?

Failed

Pass

Past and Target levels are showing as


'0' instead of blank

Medium

Closed

Pass

PQRM initiative header wrong colour

Low

Closed

Download and open the attainment


levels/checklist only format booklet

This story extends S065 by also


generating the PDF per-initiative booklet
downloads for the widgets (continue on
from the end of S065).

Download and open full widget format


per-initiative booklet (ref. story S050)

This story extends S065 by also


generating the XL spreadsheet for the
widgets (continue on from the end of
S065).

Download and open widget spreadsheet


(ref. story S069)

This story extends S151 by also


generating the details in the "List"
sheet.

Download and open widget spreadsheet


(ref. story S069)

The widgets are grouped by initiative, with


coloured initiative headers

S107

The booklet filename should be


"PQRT_Widgets_Booklet_<org
code>_v<major
version>_Guidance_Only.pdf

High

Medium

TM 20/7 Cannot replicate

This story extends S151 by also


generating the "Details" sheet.

The spreadsheet has a sheet called "Details"


(second sheet)

The sheet has the org type shown in the title (as Y
per prototype)

The general layout/formatting of the sheet is as


per "PQRT_widgets_workbook_ACUTE_v8.xls"
within the prototype

The various column headings have comments as Y


per the prototype

The Details sheet has one row per widget


attainment criterion

3/5/2010

3/17/2010 TM

Pass

TM

Pass

2/26/2010

3/17/2010 TM

Pass

Req No field still too wide - bear in mind Low


the req numbers are in the format "8101", not "8-8101"

Closed

Fail

The rows are not high enough to


display all the descriptions

Low

Failed

Pass

The description for Attainment Level 0


(column E) should ne "Insufficient
evidence to attain Level 1."

Low

Closed

Pass

The criteria should be just "a, b, c"


instead of "1a, 1b, 1c" etc. (sorry, my
fault, the prototype was wrong

Low

Closed

2/27/2010

TM

Pass

3/6/2010

3/17/2010 TM

Pass

Set up some test data with 'NR allowed' Medium


set for reqt 101 but an NR row was not
included on the spreadsheet

Closed

Pass

For the NR row, I think that columns F


thru K should be greyed out the same
as attainment level 0

Closed

Low

The criteria are ordered by widget number first,


attainment level second (0,1,2,3,NR), criteria ID
third (1a, 1b rtc. Or 2a, 2b etc or 3a, 3b, Maint)

3/7/2010

3/17/2010 TM

Pass

Each criterion has the following fields (columns): Y


- Widget number
- Key widget status
- Widget question text
- Attainment level
- Attainment level description
- Attainment criterion ID
- Attainment criterion description (for level 0 this
is defaulted to "There is insufficient evidence to
attain Level 1")
- Evidence required (single cell with one line per
"standard" evidence item
- Evidence obtained (blank for user to complete)
- Owner (blank for user to complete)
- Actions (blank for user to complete)
- Achieved (blank for user to complete)
- Past level
- Current level
- Target level

3/8/2010

3/17/2010 TM

Pass

The Attainment level and attainment level


Y
description fields are merged into a single cell for
each attainment level

3/9/2010

3/17/2010 TM

Pass

10

The req no, key req status, req question text,


past level, current level and target level fields
are merged into a single cell for each widget

3/10/2010

3/17/2010

Pass

11

The current level field is calculated automatically Y


based on which criteria the user has marked as
achieved, as follows (see prototype for an
example formula):
- (NR explicitly marked as achieved) = level NR
- (past level = 3) and (all level 1,2 and 3 criteria
achieved) = level 3
- (past level = 2 or less) and (all level 1,2 and 3
criteria except level 3 maintenance achieved) =
level 3
- (all level 1 and 2 criteria achieved) = level 2
- (all level 1 criteria achieved) = level 1
- (level 0 explicitly marked as achieved) = level 0
- otherwise blank (i.e. not yet answered)

3/11/2010

3/17/2010

Pass

If I mark NR achieved, the Current Level Medium


field is still blank

Closed

Pass

If I mark level 0 achieved, the field is


still blank

Medium

Closed

12

The past, current and target level fields on the


"List" sheet are are read-only and automatically
copied from the corresponding fields on the
Details sheet

3/4/2010

3/17/2010 TM

Pass

The spreadsheet has a sheet called "Report"


(third sheet)

3/12/2010

3/17/2010 TM

Pass

The sheet has (auto populated) summary data as Y


follows:
- no. of reqts not yet answered
- no. of reqts answered at level 0
- no. of reqts answered at level 1
- no. of reqts answered at level 2
- no. of reqts answered at level 3
- no. of reqts answered "not relevant"
- current score
- target score

3/13/2010

3/17/2010 TM

Pass

The current score is calculated as follows:


(sum of all scores) divided by (3 x total no. of
widgets excl. Those marked as N/R)
Expressed as a percentage to the nearest whole
number

3/14/2010

3/17/2010 TM

Pass

Sorry, my fault: all the current and


Medium
target scores need to be rounded down
to the nearest whole percentage. You
can achieve this by wrapping your
formula within "=FLOOR(<formula>,
0.01)"

Closed

Taget score is calculated as per current score but Y


based on target attainment levels

3/15/2010

3/17/2010 TM

Pass

As above

Closed

The summary data is shown per initiative and


also as an overall total

3/16/2010

3/17/2010 TM

Pass

There is a pie chart based on the summary data


as demonstrated in the prototype

3/17/2010

3/17/2010 TM

Pass

The sheet has the org type shown in the title (as Y
per prototype)

TM

Pass

TH 16/6 re-tested this and now it is


showing the template row as well as the
real data rows (need to delete it?)

This story follows on from S106

Medium

TM 20/7 Cannot replicate

There is an 'X' in the "achieved" column for


the NR row

S072

Publish Widgets - Booklets Sys Admin


with Glossaries

Publish or re-publish the


Main
booklet downloads for the
widgets, including a
glossary section

This story extends S065 by also


including the glossary in the PDF
booklets and ZIP files (continue on from
the end of S065).

Request to download a widgets booklet


(any format)

3
2a

S067

Publish Glossary

Sys Admin

Publish a new version of


Main
the glossary based on the
data held in RAT

Manually copy glossary PDF (as created


by RATty) to the correct location on the
PQRT web server(s)

View printable version of glossary in


PQRT (see story S071)

Publish Glossary
(Advanced)

Sys Admin

Publish a new version of


Main
the glossary based on the
data held in RAT
(advanced version
including PDF generation
within PQRT)

S077

Look and Feel

Organisation User View my target score


Main
along with my assessment
summary

General User

Use the application easily


and without aesthetic
insult to my eye

Main

PQRT staging tables populated with glossary data N/A


form RAT (identical format)

N/A

N/A

N/A

Superseded by S081

PQRT updates its Glossary records to match the


data in the staging tables

N/A

N/A

N/A

N/A

Superseded by S081

Correct (new) version of glossary is displayed.


N/A
Note: format/content of document is specified in
S064.

N/A

N/A

N/A

Superseded by S081

N/A

N/A

Pass

N/A

N/A

N/A

Pass

PQRT creates the Glossary PDF file and publishes N/A


it to the correct location on PQRT web server(s).

N/A

N/A

Pass

On system test env't, the PDF file is not Medium


being created. We suspect this is due to
folder access permissions (read-only
folder) - it works OK in UAT - but I can't
test this until it works

Closed

Pass

Copying the file to the web server is


currently a manual process and needs
automating

Withdrawn TH 6/7 raised as separate defect in Misc


Defects 2

PQRT re-creates the various widgets booklets and N/A


ZIP files that contain the glossary as specified in
S082

N/A

N/A

N/A

Superseded - glossary no longer


included in booklets

PQRT displays the correct (new) version of


N/A
glossary.
Note: format/content of document is specified in
S064.

N/A

N/A

Fail

Glossary includes terms that have been Low


deleted and are presumably being
cached somewhere in memory. Can the
publish process clear out the cache?

Failed

TM 20/7 - Have added credentials as part


of request to see if it is a proxy problem pls retest and let me know if fixed.
TH 21/7 still not clearing the cache - TM
says the web service is being called OK
(checked Meerkat logs) so problem must
be within the cache clearing code
(originally written by RJM)

Fail

I added a new term via RATty and ran


the publish process. The new term
appeared in the PQRT database table
GlossaryTerm but does not appear
when I view the online glossary. A
caching issue perhaps?

Medium

Failed

TM 20/7 - As above.

Pass

View the glossary for the letter "B"


which has enough terms to produce a
scroll bar. Scroll down and notive that
the table content scrolls behind the
(static) table headings

Medium

Closed

RJM
TH 16/6 Retested - there is no scroll bar
now so I can't scroll the pop-up (IE7). RJM
tested in all browsers, cant find a problem
with scroll bar. Appears when more data is
present than page length permits. Problem
was in Resources/glossary terms link not in
the general glossary pop-up.

High

Closed

View printable version of glossary in


PQRT (see story S071)

11
12

View widgets booklets and ZIP files

Request to view a summary of my


current and previous assessments

PQRT displays the correct (new) version of the


N/A
printable glossary.
Note: format/content of document is specified in
S071.

N/A

N/A

Pending

Awaiting defect fix above

PQRT displays correct (new) version of the


widget booklets and ZIP files

N/A

N/A

N/A

Superseded - glossary no longer


included in booklets

N/A

nili

N/A

Superseded by S173

N/A

The system validates that I am *not* in a position Y


to start a new assessment - specifically that I
have an in-progress assessment or I have
completed my most recent assessment but there
is *not* a new version of the widgets available
yet [no change]

N/A

The system displays all of my assessments, in


reverse order (most recent first) [no change]

N/A

nili

N/A

Superseded by S173

The top-most (most recent assessment), even if


it is "not yet started", is titled as "Your Current
Assessment" and the remaining assessments (if
any) are titled as "Your Previous Assessments"

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

For each assessment (whatever version), the


system displays the following information:

6
7

- Widgets version (in the header)


- Widget set start year (as determined by start
date) and end year (as determined by
submission date)

3/18/2010
3/18/2010

3/17/2010 nili
3/17/2010 nili

Pass
Pass

8
9
10

- Assessment ref
Y
- Current status
Y
- Status history (pop-up), in reverse chronological Y
order

3/18/2010
3/18/2010
3/18/2010

3/17/2010 nili
3/17/2010 nili
3/17/2010 nili

Pass
Pass
N/A

Superseded by S173

11
12

- Next deadline as per S091


- Baseline score (if assessment is 3-stage and
has been baselined)

Y
Y

3/18/2010
3/18/2010

3/17/2010 nili
3/17/2010 nili

Pass
N/A

Superseded by S173

13

- Performance Update score (if assessment is 3stage and has been Performance Updated)

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

14

- Current score - this includes widgets that are


still at status "in progress" where they have a
score

3/18/2010

3/17/2010 nili

Pass

15

[If the assessment has already been submitted, N


the label for the current score is "Overall Score"]

4/6/2010

nili

Pass

16

- The number of widgets that fall into each of the Y


following categories:
- Not Yet Answered (i.e. no attainment level
calculated - not based on widget status)
- Level 0
- Level 1
- Level 2
- Level 3
- Not Relevant
- Exempt (only display category if count >0)
- Total (a sum of all the other counts)
For each category except Exempt, if the value is
zero, display the category but leave the count
blank

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

17

[The attainment levels are colour coded: red for


0-1, green for 2-3]

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

18

- As above for the baseline (if assessment is 3stage and has been baselined)

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

19

- As above for the performance update (if


Y
assessment is 3-stage and has been Performance
Updated)

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

20

The system does *not* show the assessment


description (removal of existing feature)

3/18/2010

3/17/2010 nili

Pass

21

The system presents a list of actions that can be Y


performed (as per existing actions but presented
as a list of links instead of a mixture of links and
buttons)

3/18/2010

3/17/2010 nili

N/A

22

If the assessment is against v8+ widgets, the


system additionally displays the following:

23

- Grade, as follows:
- "Not Satisfactory" (background red) if not
achieved level 2 in *all* widgets
- "Satisfactory" (background green) if achieved
level 2 or above in *all* widgets

3/18/2010

3/17/2010 nili

Pass

24

- The percentage scores are *not* colour-coded


(we do not want to RAG overall percentages)
(removal of existing feature)

3/18/2010

3/17/2010 nili

Pass

25

If the assessment is against v7+ widgets, the


system additionally displays the following:

26

- All scores (current, target, baseline, perf


update) are RAG coloured as per existing rules

3/17/2010 nili

Pass

27
28

- *not* Grade
All buttons and links for each assessment are
shown as per current [no change]

N
N

3/17/2010 nili
nili

Pass
Pass

N/A

3/18/2010

3/18/2010
N/A

N/A

Superseded by S173

I am in a position to start a new


assessment

The system displays a "shell" assessment


summary for the new version widgets at the top
of the page, above my other assessments.

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

This is labelled as "Your Current Assessment"

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

4
5
6

The following information is included:


- Widgets version (in the header)
- Widget set start year (as determined by start
date) and end year (as determined by
submission date)

3/18/2010
3/18/2010

3/17/2010 nili
3/17/2010 nili

N/A
N/A

Superseded by S173
Superseded by S173

7
8
9

- Current status of "not yet started"


- Next deadline as per S091
The system provides an option to create a new
assessment (existing function)

Y
Y
Y

3/18/2010
3/18/2010
3/18/2010

3/17/2010 nili
3/17/2010 nili
3/17/2010 nili

N/A
N/A
N/A

Superseded by S173
Superseded by S173
Superseded by S173

10

The system does *not* prompt me for an


assessment description in order to create a new
assessment

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

11

My existing assessments are displayed below


this "shell" assessment as per Main Flow

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

12

My existing assessments are labelled as "Your


Previous Assessments"

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

For each assessment which has one or more


target scores set, the system displays the
following information:

4/12/2010

nili

N/A

Superseded by S173

- target score - calculated as (total of target


attainment levels) / (3 x total number of req'ts
excluding thise with a taregt of NR or EX)

4/12/2010

nili

N/A

Superseded by S173

- target grade (satisfactory/not satisfactory)


Y
based on target scores. Any target scores not set
count as not having attained level 2, whereas NR
and EX are OK

4/12/2010

nili

N/A

Superseded by S173

The width of the main panel is a fixed width of


760px (i.e. Just the right width to be fully visible
when viewed in a maximised browser on an
800px wide screen.

2/22/2010

Pass

content panel too wide

The header and footer are variable width,


expanding or contracting as the browser is resized.

2/22/2010 N/A

Low

View online version of glossary (S064)

10

View Assessment
Summary Target Score

Superseded by S081

PQRT updates its Glossary records to match the


data in the staging tables

S136

N/A

Run glossary "publish" process (in PQRT)

2a

N/A

Meerkat populates PQRT staging tables with data N/A


form RAT (identical format)

Organisation User View summary data about Main


my assessment

N/A

View Assessment
Summary

Correct (new) version of glossary is displayed.


N/A
Note: format/content of document is specified in
S071.

Request to import glossary data from


RAT into PQRT staging tables (using
Meerkat)

S073

12/21/2009

View online version of glossary (ref.


story S064)

S081

12/21/2009

Run glossary "publish" process (in PQRT)

7
8

The ZIP file includes the glossary as a separate


PDF file

Request to import glossary data from


RAT into PQRT staging tables

5
6

The widgets booklet includes a complete


glossary at the end
Request to download individual widgets

Request to view a summary of my


current and previous assessments

View any page (using IE7 "Gold" on Win


XP SP2)

3/17/2010 thma1

thma1

Superseded by S104

N/A

1a

The header and footer re-size gracefully (i.e.


Graphics don't crash into text or links)

2/22/2010 N/A

thma1

If the browser window is too narrow for the nav


N
bar and main panel to be completely visible, the
main panel is *not* displayed below the nav bar;
it remains to the right of it

2/22/2010 N/A

thma1

Pass

If the browser window is narrower than the main Y


panel, a horizontal scroll bar is displayed

2/22/2010

3/17/2010 thma1

Pass

Header bar is XYZ blue (as per ABC branding),


with dark blue bottom border

2/8/2010 N/A

Application title ("Information Governance App")


appears in header bar (white, large, bold, LHS)

2/8/2010

3/17/2010 thma1

Pass

Application title also appears in windows header


bar (i.e. Via html <title> tag)

2/11/2010

3/17/2010 thma1

10

XYZ logo (not XYZ ABC logo) appears in header


bar (LHS), but doesn't link through to any other
website

2/22/2010

11

DH logo appears in header bar (RHS) - clicking


on it opens DH website in new window

12

Header bar includes link to DH home page


(opens in new window)

13

Header bar includes link to XYZ ABC home page


(opens in new window)

14
15

Closed

Pass

Title in windows header bar is "PQR App Medium


Home" and I'm guessing it changes as
the page changes. It needs to be
"Information Governance App" on every
page

Closed

3/17/2010 thma1

Pass

XYZ Logo looks fuzzy because it's anti- Low


aliased around the outside edge. Can
you make it have a nice crisp outside
edge? Even the XYZ letters look to have
fuzzy edges - can you reduce (not
completely remove) the anti-aliasing
effect to sharpen it up a bit?

Withdrawn TM - I took this from the nhs logo website.


Do you still want me to se if I can find a
better one?
TH 15/3 - The logo I downloaded from
nhsidentity.nhs.uk is nice and crisp - I
suspect that it has got fuzzified by your
painting software when you have resized it.
TH 9/6 superseded by S172

2/11/2010

3/17/2010 thma1

Pass

Likewise the DH logo is fuzzy - can you


sharpen it up a bit?

Withdrawn Again took it fro their site, the scaling


seems to have that effect.
Superseded by S172
TH 15/3 See comment above

2/9/2010

3/17/2010 thma1

Pass

Link works but links in this section need Medium


to be separated by a vertical bar "|" or
similar

Closed

TH 15/3 still no separators in the header


links

2/9/2010

3/17/2010 thma1

Pass

Header bar includes link to Accessibility page

2/11/2010

3/17/2010 thma1

Pass

Header bar includes link to Contact Us page

2/11/2010

3/17/2010 thma1

Pass

I clicked "Widgets" then "Contact Us"


and noticed that (a) The breadcrumb
says "You are Here: Widgets > Contact
Us" instead of "Home > Contact Us"
and (b) the Widgets nav bar item is
highlighted as being the current one,
instead of "Home".

Closed

Fixed by CC (15/3)
TH 22/3: Failed retest.CMC: Contact Us no
longer directly avaialbel from main
navigation menu so think this can be
withdrawn, have marked as Fixed for now
TH 20/5 - Contact Us available as a link
from the header links on every page CMC:
Also same issue fixed for Accessibility and
About header links

16
17

Header bar includes link to About page


Header bar includes a "Skip to Content" link
which takes the user to an anchor/div at the top
of the main panel. This is for accessibility
purposes

Y
Y

2/11/2010
2/11/2010

3/17/2010 thma1
3/17/2010 thma1

Pass
Pass

18
19
20

Nav bar appears on LHS


Nav bar items are single level
Nav bar items are white text on dark blue
background, with white separating line

Y
Y
Y

2/8/2010
3/17/2010 thma1
2/8/2010
3/17/2010 thma1
2/8/2010 N/A
thma1

Superseded by S104

Pass
Pass
N/A

21

Selected nav bar item has XYZ blue background


and arrow indicator at RHS

Superseded by S104

N/A

22

Nav bar has bottom "finisher" with curvy corners Y

2/8/2010

3/17/2010 thma1

23

Breadcrumb trail (2nd level nav) appears at top


of main panel

2/8/2010

3/17/2010 thma1

24

Fonts and sizes are as per the XYZ ABC website

2/11/2010 N/A

thma1

Superseded by S104

N/A

25

All font sizes are relative, to allow users the


option to change the font size via their browser

2/11/2010

thma1

Superseded by S171

N/A

26

Footer separated from main page by horizontal


line in XYZ blue

2/8/2010 N/A

thma1

Superseded by S104

N/A

27

Footer contains "(c) Crown Copyright 2000-2010" Y

2/11/2010 N/A

thma1

Pass

28

Footer contains link to XYZ ABC Privacy


Statement (opens in new window)

2/11/2010 N/A

thma1

29

Footer contains link to XYZ ABC Copyright


Statement (opens in new window)

2/11/2010 N/A

thma1

30

Footer contains link to PQRT Terms & Conditions


(opens in same window, ref. story S086) - no
change

2/11/2010 N/A

thma1

Pass

31
32

No logos in footer
Footer does not contain helpdesk info (instead
users use the "contact us" link in the header bar

Y
Y

2/11/2010 N/A
2/11/2010 N/A

thma1
thma1

Pass
Pass

All "Look and Feel" acceptance criteria fulfilled


(rejoin Main flow at step 2)

Date
Unknown

N/A

Superseded by S087

All "Look and Feel" acceptance criteria fulfilled


(rejoin Main flow at step 2)

Date
Unknown

N/A

Superseded by S087

All "Look and Feel" acceptance criteria fulfilled


(rejoin Main flow at step 2)

Date
Unknown

N/A

Superseded by S087

All "Look and Feel" acceptance criteria fulfilled


(rejoin Main flow at step 2)

Date
Unknown

N/A

Superseded by S087

Look & feel is as per S077 except where listed


below:

S078

Look and Feel v2

Improved Navigation

General User

General User

Have an enhanced
Main
aesthetic experience, with
lovely soft curves
caressing my visual
senses

Navigate the site more


easily

Main

1a

1b

1c

1d

1f

Low

Closed

Changing the font size via the browser


had no effect on the page
TH 11/05 - the latest cut of the
prototype includes relative font sizes talk to me about how best to
incorporate these

Medium

Withdrawn

Pass

Didn't open in a new window

Medium

Closed

Pass

Also, can you put a bar separator


between the links in the footer

Low

Closed

Pass

Didn't open in a new window

Medium

Closed

Low

Withdrawn TM Without the aiasing they would be


jaggy. I cant control the level of antialiasing.
Superseded by S172

Pass

TBC

2/25/2010

Pass

The header and footer are fixed width


TBC
Header bar is XYZ blue as per the XYZ logo colour TBC

2/25/2010
2/25/2010

Pass
Pass

Lovely curves here and there as per Tom's


prototype

TBC

2/25/2010

Pass

Application title is centred, not LHS


Nav bar items are white text on XYZ blue
background, with no separating line

TBC
TBC

2/25/2010
2/25/2010

Pass
Pass

Selected nav bar item has DH sea green


background and arrow indicator at RHS

TBC

2/25/2010

Pass

Breadcrumb has XYZ blue background


Breadcrumb expands on to multiple lines if
content is too long

TBC
TBC

2/25/2010
2/25/2010

Pass
Pass

The main content of the page "looks nice" and is TBC


consistent with the overall theme. This item is
time-boxed: it is to be applied to as many of the
pages as possible in the time available for the
story. The reaminder will be picked up in a
separate story if necessary.

2/25/2010

N/A

View any page (not logged in)

2/11/2010
2/11/2010
2/11/2010

3/17/2010
3/17/2010
3/17/2010

6
7
8
1

Reports (goes to Reports page)


Resources (goes to Resources page [new])
Help (goes to Help page [new])

Y
Y
Y

2/11/2010
2/11/2010
2/11/2010

3/17/2010
3/17/2010
3/17/2010

2
3

The nav bar has the following options:


Home (goes to Home [logged in] page [new])

2/11/2010

3/17/2010

Des
Des

Pass

4
5

What's New (goes to What's New page)


Widgets (goes to Widgets Categories page)

N
N

2/11/2010
2/11/2010

3/17/2010
3/17/2010

Des
Des

Pass
Pass

7
8
9
10
1

Reports (goes to Reports page)


Resources (goes to Resources page [new])
Admin (goes to Admin page [new])
Help (goes to Help page [new])

N
N
N
N

2/11/2010
2/11/2010
2/11/2010
2/11/2010

3/17/2010
3/17/2010
3/17/2010
3/17/2010

Des
Des
Des
Des
Des

Pass
Pass
Pass
Pass

2
3

The nav bar has the following options:


Home (goes to Home [logged in] page [new])

2/11/2010

3/17/2010

Des
Des

Pass

4
5

What's New (goes to What's New page)


Widgets (goes to Widgets Categories page)

Y
Y

2/11/2010
2/11/2010

3/17/2010
3/17/2010

Des
Des

Pass
Pass

Assessments (goes to Assessments Summary


and History page)

2/11/2010

3/17/2010

Des

Pass

7
8
9
10
1

Reports (goes to Reports page)


Resources (goes to Resources page [new])
Admin (goes to Admin page [new])
Help (goes to Help page [new])

Y
Y
Y
Y

2/11/2010
2/11/2010
2/11/2010
2/11/2010

3/17/2010
3/17/2010
3/17/2010
3/17/2010

Des
Des
Des
Des
Des

Pass
Pass
Pass
Pass

2
3

The nav bar has the following options:


Home (goes to Home [logged in] page [new])

2/11/2010

3/17/2010

Des
Des

Pass

4
5

What's New (goes to What's New page)


Widgets (goes to Widgets (Org Types) page)

N
N

2/11/2010
2/11/2010

3/17/2010
3/17/2010

Des
Des

Pass
Pass

Assessments (goes to Assessments Org Chooser N


page)

2/11/2010

3/17/2010

Des

Pass

7
8
9
10
1

Reports (goes to Reports page)


Resources (goes to Resources page [new])
Admin (goes to Admin page [new])
Help (goes to Help page [new])

N
N
N
N

2/11/2010
2/11/2010
2/11/2010
2/11/2010

3/17/2010
3/17/2010
3/17/2010
3/17/2010

Des
Des
Des
Des
Des

Pass
Pass
Pass
Pass

Help page displayed - blank for now


Y
Note: the contents of the help page are specified
in other stories

2/11/2010

3/17/2010

Des

Pass

View any page (logged in as org user)

View any page (logged in as org admin)

View any page (logged in as XYZ ABC


user)

Request to view help (not logged in or


logged in as any type of user)

Request to view resources (not logged in)

Des
Des
Des
Des
Des
Des
Des
Des

Pass

If I select Req'ts/A.TEST:Acute/All/101
then the words crash into the graphics
on the RHS

Withdrawn Not found


TH 14/06 no longer an issue

Medium

TM Without rewriting the whole nav bar not


to use links, not sure on this one. RJM:
Fixed
TH 14/06 - an improvement but we could
also do with (a) the pointer changing to a
hand shape and (b) the tooltip appearing
wherever you are in the blue rectangle.
This probably means changing the styling
for the <a> tag to cover the whole of the
rectangle area. Shout me if you want me to
see if I can do it in the prototype

Testing of this will be picked up as a


separate exercise and new stories
raised as appropriate

Help page should just be blank for now Low


(eventually it will contain a number of
help options) - it seems to be populated
with a load of help content

Closed

Didn't open as a pop-up

Closed

Des
Resources page displayed
The following options are available:
Knowledge Base (goes to Knowledge Base Org
Type Chooser page)

2/11/2010

3/17/2010

2/11/2010

3/17/2010

Des
Des
Des

Pass

Knowledge Base Archive (goes to Knowledge


Base Archive page)

2/11/2010

3/17/2010

Des

Pass

Glossary (displays Glossary page as non-modal


pop-up)

2/11/2010

3/17/2010

Des

Pass

Request to view resources (logged in a


"simplified interface" user)

Pass

Medium

Des
Resources page displayed
The following options are available:
Downloads (goes to Widgets Downloads page)

2/11/2010

3/17/2010

2/11/2010

3/17/2010

Des
Des
Des

Pass

Pass

Link OK but too much whitespace


Low
between menu options - due to using a
separate <ul> tag for the optional list
items. Any way you can incorporate
them all into a single <ul> so that we
can re-style things more easily in the
future?
Same goes for the Admin page

Closed

All options for not logged in users (join flow 1e at Y


step 3)

2/11/2010

3/17/2010

Des

Pass

ISO/IEC link shown but should not be


shown for simplified interface users

Closed

Request to view resources (logged in as


an organisation user, admin or XYZ ABC
user)

Des

2
3
4

Resources page displayed


Y
The following options are available:
ISO/IEC 27002:2005 (goes to ISO/IEC 27002:2005 Y
page)

2/11/2010

3/17/2010
3/17/2010

Des
Des
Des

Pass

2/11/2010

All options for "simplified interface" users (join


flow 1f at step 3)

2/11/2010

3/17/2010

Des

Pass

Request to view admin (logged in)

When I hover over a nav bar <li> item, Low


it goes light blue (nice) but I can only
click on it if am hovering the actual
<a> - if I click within the <li> but
outside the <a> then nothing happens,
which is a bit confusing because it is
highlighted blue, suggesting I should be
able to click it

Pass
Pass
Pass

Some of the straight lines (e.g. Top


edge of header) look a bit fuzzy
because of the anti-aliasing - can you
sharpen them up a bit please?

Pass
Pass
Pass

2
3
4

TH 15/3 Failed retest


TH 22/3 can you remove the space
between "here" and the colon

Des

Y
Y
Y

1h

It's in the right place but I don't like


"You are here >>" - can you change it
to "You are Here:" or convince me
otherwise :)

Pass

View any page

2
3
4

1g

Withdrawn

The nav bar has the following options:


Home (goes to Home [not logged in] page)
What's New (goes to What's New page)
Widgets (goes to Widgets (Org Types) page)

Low

Took me to the start of the main section Medium


*after* the breadcrumb

2
3
4
5

Low

View any page (using Google Chrome 4


on Win XP SP2)

1e

thma1

N/A

View any page (using IE8 on Win XP SP2)

S104

2/12/2010 N/A

Superseded by S104

View any page (using Firefox 3.5 on Win


XP SP2)

2
1d

thma1

View any page (using IE6 SP2 on Win XP


SP2)

2
1c

N/A

Scroll bar appears even if browser


Low
window is wider than the page - there
seems to be about 300px of whitespace
to the right of the page

2
1b

Superseded by S104

Des

Pass

High

TH 15/3 Check with Richard - there is a


particular size that the glossary pop-up
should be

2
3
4
5
1i

1j

S096

Improved Navigation Information Mapping

Information
Mapping User

Be able to navigate to the 1k


information mapping
functions

The system displays the Admin page


The following options are available:
My Details (goes to the My Details page)
My Password (goes to the My Password page)

Navigate to Views
Maintenance

XYZ ABC User,


Organisation
Administrator

Be able to access the


Views Maintenance
function

1h

Home Page

General User

View information on the


home page

Main

1a

1b

3/17/2010

Des
Des
Des
Des

Pass

3/17/2010
3/17/2010

All options for logged in users (join flow 1h at


step 3)

2/11/2010

3/17/2010

Des

Pass

2
3
4

The system displays the Admin page


Y
The following options are available:
Organisation Admin (goes to Organisation Admin Y
Org Chooser page)

2/11/2010

3/17/2010

2/11/2010

5
6

Bulk Emails (goes to Bulk Email List page)


All options for logged in users (join flow 1h at
step 3)

Y
Y

2/11/2010
2/11/2010

The nav bar has the following options (in addition Y


to any other options applicable to the user):

Information Mapping (goes to Information


Mapping page) - appears between "Resources"
and "Admin"

Request to view admin (logged in as XYZ


ABC admin)

Des
Pass

3/17/2010

Des
Des
Des

3/17/2010
3/17/2010

Des
Des

Pass
Pass

2/22/2010

3/17/2010

nili

Pass

When I go to user admin to check if the


user has info mapping permissions, for
some reason, the info mapping roles
are not displayed (even if I go to the
"New User" screen they are not there)

Closed

View any page (logged in as user with


"Information Mapping Admin"
permission)

2/22/2010

3/17/2010

nili

Pass

Logged in as user without info mapping High


user permissions and Information
Mapping is still visible on the nav bar

Withdrawn nili: Org. Admin users also have access to


Inf Mapping. If user only has Org
User/Reviewer permisions the navbar
option does not appear.

2
3

Request to view admin page


Logged in as user without info mapping High
admin permissions and Information
Mapping options are still visible on the
nav bar

Withdrawn nili: Org. Admin users also have access to


Inf Mapping. If user only has Org
User/Reviewer permisions the navbar
option does not appear.

Breadcrumb should say "Information


Mapping Area Admin"

Low

Closed

Admin page displayed with the following options


(in additon to any other options applicable to the
user):

nili

Pass

Information Mapping/Area Administration (goes


to Area Administration page)
[note this option is not available to org types
which use the "information Mapping Simplified
Interface"]

2/22/2010

3/17/2010

nili

nili: not displayed if using Inf. Mapping Pass


simplified interface as they don't use
Areas.

Pass

Area Admin page should have a page


title of "Information Mapping Area
Admin"

Low

Closed

Change page title as per email to NL

Information Mapping/Data Item Administration


(goes to Data Item Administration page)

2/22/2010

3/17/2010

nili

Pass

Breadcrumb and page title as above

Low

Closed

Change page title as per email to NL

Information Mapping/Location Administration


(goes to Location Administration page)

2/22/2010

3/17/2010

nili

Pass

Breadcrumb and page title as above

Low

Closed

Change page title as per email to NL

System displays Widgets Categories page


There is an option to maintain widget views

Y
Y

N/A
N/A

N/A
N/A

System displays Views page

N/A

N/A

There is a short introduction to PQRT with an


option to see more (links to "About" page ref.
Story S083)

2/8/2010

3/17/2010 thma1

Pass

There is a section for registered users allowing


them to log in or deal with a forgotten password

2/8/2010

3/17/2010 thma1

Pass

Wording in "Registered Users..." section Low


needs to match prototype wording,
including "Forgotten user details?" link
(which admittedly might have changed
after you copied it!)

Closed

There is a section for new users allowing them to Y


register or view the "quick start" guide.

2/8/2010

3/17/2010 thma1

Pass

Need single quotes around 'quick start'

Low

Closed

There is a section for casual visitors with links to Y


"reports" and "widgets"

2/8/2010

3/17/2010 thma1

Pass

1) Reports link doesn't link through to


the reports page.
2) Widgets link doesn't link through to
the widgets page

Medium

Closed

TH 22/3: Links work now but nav bar shows


"Home" not "Reports" or "Widgets"
respectively

The various sections are in "magazine boxes"


with curvy corners and a pale blue background

2/8/2010

3/17/2010 thma1

Pass

Smaller organisations - context sensitive help


N
saying which org types - changed text instead to
simple "register" link

2/11/2010

3/17/2010 thma1

Pass

There is an optional "alert" box at the top of the


content pane. The content of the pane is
configurable by a sys admin. The default
message is "welcome to PQRT version 8", with a
link through to the relevant "what's new" article
for the v8 release

2/11/2010

3/17/2010 thma1

Pass

Needs to be configurable (CMC says it


currently isn't)

Medium

Closed

Des 08/06: Not going to be impletemented


now as we need to finalise various
scenarios of the user input content.
TH 9/6 chatted with CC and he proposes
storing the HTML in the DB (ask him for
details)
Des 15/06: FIXED
TH 16/6: if the text in the config DB table is
blank, don't display the yellow box at all
Des 16/06: Fixed

The system tells me when I last logged in (date if Y


before today or time if earlier today)

2/8/2010

3/17/2010 thma1

Pass

Given that I have just logged in, this


High
actually needs to tell me the last but
one time I logged in (i.e. Not the time
just now!)
Also, if last login was today, it should
say "last logged in at", not "last logged
in on"
Also, can you get rid of the indentation
(padding left) of "You last logged in..."

Closed

CMC: Fixed

Withdrawn TH 23/3: failed retest


TH 19/04: failed retest
Superseded by new story

Request to view widgets (logged in as


org admin (not "simplified interface") or
XYZ ABC user)

4
5

Request to maintain widget views

View the home page (not logged in)

1
2

Log in (any user type)

1
2

Log in (assessed user type)

View Submission Deadline Organisation


on Performance Update
Admin

Be told the (correct)


Main
submission deadline when
I do a Performance Update

N/A

4/26/2010

CMC

Pass

The system says my most recent assessment is


the new version and that my status is "not yet
started" - consistent with Assessment Summary
(S073)

4/26/2010

CMC

Pass

The system validates that I have at least one


assessment on record

2/8/2010

3/17/2010 CMC

Pass

The system tells me the version and status of my Y


most recent assessment.

2/8/2010

3/17/2010 CMC

Pass

Formatting should be
"<strong>Version 7</strong> (Status:
<strong>Started</strong>)"

Pass

This section seems to have disappeared Medium


completely! (logged in as a.test:acute)

Closed

Pass

You need to dynamically populate the


latest version

Medium

Closed

Pass

Bold red is OK but the underline is too


much - suggest removing it.

Low

Closed

Pass

Remove "More details" i.e. link to FAQ


page for now - I'd rather it was not
there than look incomplete.

Medium

Closed

TM Need to clarify

Low

Closed

TH 22/3 failed retest


Des 24/05 - Fixed

1
2

I am not in a position to start a new


assessment

If my most recent assessment is not the latest


Y
version (and I have not yet submitted it), it warns
me of this.

The "At A Glance" information is nicely lined up


for clarity

2/8/2010

3/17/2010 CMC

2/12/2010

3/17/2010 thma1

Low

TM Need to clarify

Pass

I do not have any assessments on record


3/17/2010 CMC

CMC:Note it is unlikely that we now


N/A
have condition flow 1b above that this
situation would occur i.e. have no
assessments and are not able to create
an assessment

Didn't bother testing this since unlikely


to occur

Log in (any user type)


There is a section for new users inviting them to
view the "quick start" guide (ref. story S085)

2/11/2010

3/17/2010 thma1

Pass

There is an option to remove the "New Users..."


section

2/22/2010

3/17/2010 thma1

Pass

There is a summary of what's new with an option Y


to subscribe to the RSS feed and a link to the
"what's new" page (no change)

What's new items - formatting not as per


prototype

The various sections are in "magazine boxes"


with curvy corners and a pale blue background

System removes "New Users..." section

Single quotes on 'quick start'

2/8/2010

3/17/2010 thma1

Pass

1) What's New link doesn't go to What's High


New page
2) RSS feed link doesn't go to RSS feed

Closed

2/11/2010

3/17/2010 thma1

Pass

See prototype for how it should be

Low

Closed

TM - Chris and I thought we iked the way IE


formatted the rss feeds and mimicked that.
??
Des 26/05: Fixed

2/8/2010

3/17/2010 thma1

Pass

White background not blue

Low

Closed

Des 26/05: Fixed

2/22/2010

3/17/2010 thma1

Pass

Section not removed

Medium

Closed

Des 0806: Fixed

New Users section is not there (and there is no


way of getting it back!)

2/22/2010

3/17/2010 thma1

Pass

The system validates that I either have an


assessment in progress or I have not yet started
the current year's assessment (if I have
completed this year's assessment, no deadline
information is displayed)

3/22/2010

3/17/2010 nili

Pass

The system validates that , if I am an "in-year


N/A
assessee", this is *not* my first assessment. Inyear assessees are those org types that tend to
submit their first assessment throughout the
year and as such should not be presented with a
deadline for this. The org type list is the same as
for the "Send Submission Notification Email to
Exeter Helpdesk"

nili

Pass

The system tells me when my next deadline is,


according to the following rules:

- If my current assessment is subject to 3 stage


reporting, and I have not yet baselined it, the
deadline is the Baseline Date

3/22/2010

3/17/2010 nili

Pass

Org type a.test:acute should be 3 stage Medium


reporting but next deadline is showing
as submission

Closed

CMC: Changed test data so Acute tests


now do 3 stage assessments

6
7

- Ditto performance update


N
- If neither of the above is true, the deadline is
N
the submission date. Note that the Submission
Date is separate from the Version End Date (the
date after which it is not possible to create a new
assessment)

3/22/2010
3/22/2010

3/17/2010 nili
3/17/2010 nili

Pass
Pass

Can't test until above defect fixed

- If I do not have an assessment in progress (i.e. I N


have not yet started this year's assessment), this
is treated the same as having started this year's
assessment.

3/22/2010

3/17/2010 nili

Pass

The system tells me what deadline it is, in the


Y
format "Version <version> <type> Deadline",
where <type> is one of "Baseline", "Performance
Update" or "Submission"

3/22/2010

3/17/2010 nili

Pass

10

The system tells me how many days there are


left to go until the deadline.

3/22/2010

3/17/2010 nili

Pass

11

If it is overdue, the system tells me how many


N
days overdue it is instead, and this information is
highlighted (e.g. Bold red).

3/22/2010

3/17/2010 nili

12

The deadlines for v8 assessments are as follows: N


- Baseline: 30/09/2010
- Performance Update: 31/12/2010
- Submission: 31/03/2011
- Version End Date: leave blank for now as per
usual

3/22/2010

13

The Submission Date for previous assessments is N


31st March in the appropriate year (not
necessarily the same as the Version End Date)

S125

N/A
N/A

The system validates that I am in a position to


start a new assessment (same criteria as for the
"Create new assessment" dialog on the
Assessment Summary page, ref. S073)

Main

Pass

The system tells me that I have not yet created


an assessment

Organisation User Find out when my next


assessment deadline is

Pass
Pass

View any page (logged in as user with


"Information Mapping User" permission)

Next Deadline Info

Pass
Pass

2/11/2010
2/11/2010

1b.2a.2 1
a

S091

Pass

Des
2/11/2010

1c

Des
Des
Des
Des

Y
Y

1b.2a

3/17/2010
3/17/2010

2
3

S079

3/17/2010

2/11/2010
2/11/2010

The system displays the Admin page


The following options are available:
User Admin (goes to User List page)
My Organisation (goes to View/Amend
Organisation Details page)

S074

2/11/2010

Y
Y

2
3
4
5

1l

Request to view admin (logged in as


non-XYZ ABC admin)

Request to remove the "New Users..."


section

10
11
12

Log out and back in again

Log in (assessed user type)

Request to do a Performance Update

2/25/2010 N/A

N/A

N/A

I changed my mind on the format: can


you remove the word "Deadline" so it
just says e.g. "Version 99 Submission"

Low

Closed

Pass

If the deadline is today it says "0 days


overdue"" instead of "0 days to go!".
Perhaps in this case it should be in red
to highlight it

Low

Closed

nili

Pass

Looking at the DB, the EndDate has


been set to 31/03/2011 rather than
having been left blank

Medium

Closed

nili

Pass

nili:V8 end dates now shd be null

The system provides information (in a pop-up) to


tell me when I need to submit my assessment.
The date displayed is the Submission Date
(currently the Version End Date)

S092

Log In

General User

Log in to the system

Main

5a

1
2

6a

6b

S093

Log Out

Logged In User

Log out from the system

Main

S090

Register For an Account

General User

Register for an PQRT


account

Main

There is an option to enter my Organisation


Code, User ID and Password

Enter my Organisation Code, User ID


and Password

4
5

Request to log in

Closed

TM. 1 - Are you not worried that this will


leave a lot of 'blue space'? Have limited
the boxes to 10 characters and 15
character entry.
TH 15/3 - Update - DIP team has asked for
all 3 fields to be the same width, so can we
make the password field 15 chars wide and
the others to match its width?
TH 14/6 still too wide but losing the will to
live on this one so closing anyway

Pass

2) The password field is too wide - I can Low


enter a max of 15 characters so I guess
this field should be 15 chars wide

Closed

Pass

3) I think the data field labels should be Low


in bold so they stand out more (applies
generally across the application i.e. a
stylesheet change).

Closed

Update details link should take user to


Admin/My Details page

Withdrawn TH 08/04 retested and I get a system error


when I click this link
TH 9/6 Superseded

3/17/2010 thma1

Pass

2/11/2010

3/17/2010 thma1

Pass

2/11/2010
2/11/2010

3/17/2010 thma1
3/17/2010 thma1

Pass
Pass

User info to include e-mail address and phone


number, plus option to amend

2/11/2010

3/17/2010 thma1

Pass

System re-displays Home [not logged in] page

2/11/2010 N/A

thma1

Pass

System displays error message to say the


Organisation Code was invalid

2/11/2010 N/A

thma1

Pass

System re-displays Home [not logged in] page

N/A

N/A

Pass

System displays error message saying


"Organisation Code not entered" (wording
change only)

N/A

N/A

Pass

System re-displays Home [not logged in] page

2/11/2010 N/A

thma1

Pass

System displays error message to say that my


log-in details were invalid

2/11/2010 N/A

thma1

Pass

System re-displays Home [not logged in] page

N/A

N/A

Pass

System displays error message(s) saying "User


ID not entered" and/or "Password not entered"
(wording change only)

N/A

N/A

Pass

System displays Home [not logged in] page

1
2

High

3. Labels are bold.

Organisation Code doesn't exist

1) Can you change the error message


Low
to "Organisation Code not recognised"
(Not "Error," at the beginning)
2) Can you get rid of the underline for
the error message?

Closed

RJM

System displayed red star to right of


Medium
Org Code field instead of specified error
message

Closed

RJM

Can you change the error message to:


"Incorrect User ID/Password
combination"

Low

Closed

RJM
TH 14/6 Message is incorrect in case where
I have a valid user ID/password combo but
have typed an existing but incorrect org
code - it sayd "Invalid Username/Password
combination"

System displayed red star to right of


fields instead of specified error
messages

Medium

Closed

RJM

User left org code field blank

Invalid user ID/password combination

User left user ID and/or password field


blank

Pass

Request to log out


2/11/2010

3/17/2010 thma1

Request to register for an PQRT Account

Pass

Des

The system displays "Registration Step 1 Organisation Search"

2/11/2010

3/17/2010

Des

Pass

1) The "Register Now" button works but High


the "register for a user account" link
doesn't work
2) Too much whitespace bewteen the
buttons on all register pages - can you
make them closer together please as
per prototype?

Closed

TH 10/3 the "register for a user account"


link still doesn't work
TH 15/3 still doesn't work

There is an option to enter my organisation Code Y


and/or Organisation Name Keywords

2/11/2010

3/17/2010

Des

Pass

Move both data fields to the right a bit Low


so that "Organisation Name Keywords:"
fits onto a single line

Closed

Dev environment looks fine


TH 10/3 retested OK

There is a link to the ODS Organisation Code


Y
lookup service (opens the
name/address/postcode search in a new window)

2/12/2010

3/17/2010

Des

Pass

The system displays "Registration Step 2 Confirm Organisation"

2/11/2010

3/17/2010

Des

Pass

The system validates that I entered an


Organisation Code

2/11/2010

3/17/2010

Des

Pass

The system validates that there is an


organisation in the database with a matching
Organisation Code

2/11/2010

3/17/2010

Des

Pass

The system displays details for my organisation


(Name, Organisation Code, Organisation Type)

2/11/2010

3/17/2010

Des

Pass

The system displays "Registration Step 3 Registration Method"

2/11/2010

3/17/2010

Des
Des

Pass

The system validates that there is not already an Y


(unlocked) user with admin rights for the
organisation

2/11/2010

3/17/2010

Des

Pass

The system tells me I can register online

2/11/2010

3/17/2010

Des
Des

Pass

15

The system displays "Registration Step 4 - User


Details"

2/11/2010

3/17/2010

Des

Pass

16

There is an option to enter my user details


(Name, Email, Confirm Email, Telephone)

2/11/2010

3/17/2010

Des

Pass

Move fields to right so that "Name


Low
(Forename and Surname):" fits on a
single line. Also, "Email:" needs to drop
to the left!

Closed

Dev environment looks fine


TH 10/3 retested OK

Enter my Organisation Code and/or


Organisation Name Keywords and
request to proceed

Des

Request to proceed

Request to register online (click "Next")

Enter my user details (and request to


proceed)

Des

18

The system validates my user details (as per


current)

2/11/2010

3/17/2010

Des

Pass

1) Can you change error message from Low


"User must have both forename and
surname entered" to "Name must
include both forename and surname"
2) Can you change error message "Full
first name..." to "Full forename..."

Closed

19

The system validates that Email and Confirm


Email are the same (new)

2/11/2010

3/17/2010

Des

Pass

Formatting of error message - can you Low


liaise with Tom to agree how this should
look - he has used bold red text on
other pages and also he suggested a
"cross" icon.

Withdrawn Des 18/03:Is this just for this instance or on


all error messages
TH 23/3: I will write a separate story to fix
this across the site

The system validates that I have entered a


telephone number (don't care whether numeric,
just has to exist)

2/11/2010

3/17/2010

Des

Pass

20

The system displays "Registration Step 5 - Terms Y


and Conditions"

2/11/2010

3/17/2010

Des

Pass

21

The system displays the Ts & Cs of registration

2/11/2010

3/17/2010

Des

Pass

22

There is an option to accept the Terms and


Conditions

2/11/2010

3/17/2010

Des

Pass

Accept the Terms and Conditions (and


request to proceed)

Des

24

The system displays "Registration Step 6 Confirm Details"

2/11/2010

3/17/2010

Des

Pass

25

The system displays my organisation details


Y
(Organisation code, org name, org type) and user
details (name, email and telephone) and asks me
to confirm that I wish to register the account

2/11/2010

3/17/2010

Des

Pass

The system displays "Registration Step 7 Account Created"

2/11/2010

3/17/2010

Des
Des

Pass

Got a Server Error - presume some


config issue in the system test
environment with sending the email

High

Closed

Des

Pass

Data integrity issue - suggest trying to


send email before creating user in
database - that way, if the email fails,
the user is not created - and the user
will be able to try again.

Medium

Closed

Des

Pass

The two alert boxes should be pink, not Medium


blue - looking at the source you do
have the alertBox in the class, so I
guess it's the stylesheet that needs
tweaking

Closed

The email received has no formatting

Closed

Request to create account


Y

28

The system confirms that my account has been


set up

2/11/2010

3/17/2010

Des

Pass

29

The system displays my account details


(Organisation code, user ID)

2/11/2010

3/17/2010

Des

Pass

30

The system tells me the email address that my


password will be sent to.

3/17/2010

Des

Pass

31

I receive an email containing my password (no


change)

Des

Pass

2/11/2010
N/A

N/A

I did not enter an Organisation Code


The system validates that I entered Organisation Y
Name Keywords

2/11/2010

Des

Pass

The system validates that there is a *unique*


Y
organisation in the database with matching
keywords in the organisation name (in any order,
case insensitive)

2/11/2010

Des

Pass

4
1

Rejoin Main Flow at Step 7

2/11/2010

Des
Des

Pass

The system displays "Registration Step 2 Confirm Organisation"

2/11/2010

Des

Pass

The system tells me it can't find a matching


organisation

2/11/2010

Des

Pass

The system displays "Registration Step 3 Registration Method"

2/11/2010

Des
Des

Pass

The system tells me I can register via the


helpdesk.

2/25/2010

Des

Pass

There is a hyperlink through to the "Contact us"


page

2/11/2010

Des

There was no matching organisation


code

Request to proceed

I did not enter Organisation Name


Keywords

Doesn't link through to the contact us


page

Closed

Link works OK but styling is an issue


because the link is blue within blue text
and no underline. Maybe chat to Tom re.
putting the underline back?

Pass

Got a validation error - but should have High


gone to Registration Step 2 (as per flow
8a)

Closed

CMC:Have changed, have also added an


extra bullet point to display for step 8a as
otherwise reads rather confusingly in this
instance
TH 23/3: if you enter neither the org code
nor any org name keywords it should take
you directly to step 2 instead of displaying
a validation error

1) Can you change the label from


"Name:" to "PQR App Administrator
Name:" and make sure it all fits on a
single line

Closed

2/11/2010

Des
Des

Pass

The system tells me who my admin is (name


only, not email or telephone) - if there are
multiple admins, it shows the one that logged in
most recently

2/22/2010

3/17/2010

Des

Pass

The system tells me I should register via them


or, if I can't contact them, contact the helpdesk

2/11/2010

3/17/2010

Des

Pass

There is a hyperlink through to the "Contact us"


page

2/11/2010

3/17/2010

Des

Pass

Email not pasted

2/25/2010

Des

There is no organisation that matches on


Organisation Name Keywords (or I left
them blank)

Attempt to cut & paste Email into


Confirm Email field

Request to contact XYZ ABC (via link in


header bar) (not logged in user)

Medium

Des

There is already an admin for my org

Des 11/03: Handling this scenario is


possible (ie. Searching with Prefix).
However searching with Suffix (ie. *tree
park) is not possible.
TH 23/3: well go ahead and do it then!
Des 09/06: Fixed

Pass

Proceed as per Flow 8a

10a

Closed

Des
2/11/2010

2
1

Medium

Closed

Is it possible to match on *partial*


keywords? For example, if I type
"aintree park" it matches (org code
N82053) but if I enter "aintr park" it
won't match.

Formatting - missing bullet points Low


probably needs the stylesheet tweaking
- check with Tom

Proceed as per Flow 8a

7a.3a

Des 18/03: Need to discuss about the


sequence of the process.
TH 23/3: Chris, when you get round to
fixing this give me a shout to discuss if it's
not clear
Des 08/06: Fixed
TH 14/6 not re-tested; assumed OK, low
priority

Des

4
5

Main

1) The org code and User ID fields are


Low
too wide - suggest making them 8
characters wide as per existing system,
or 10 at the most if 8 looks too narrow
on the screen

2/11/2010

26
27

Contact XYZ ABC about


the PQRT

Pass

23

General User

3/17/2010

17

Contact Us

2/11/2010

System displays Home [logged in] page


Y
System displays my user information (name and Y
organisation) in box above nav bar

13
14

S089

System validates my user ID and password


(against my Organisation Code)

12

16a

CMC: Changed test data so Acute tests


now do 3 stage assessments

System validates that my Organisation Code


exists

10
11

7a.2a

Closed

7
8

8a

Completed all req'ts for a.test:acute but High


Baseline button didn't appear

7a

Pass

View the home page

5b

4/26/2010

Des
Des
Des
Des

Pass

Low

The system displays the "Contact us" page

2/22/2010

Des

Pass

Page H1 header "Contact Us" not


displayed (this seems to be common
across quite a lot of pages - is there a
stylesheet problem?)

Medium

Closed

The system displays the Exeter Helpdesk phone


number (01392 251289)

2/22/2010

Des

Pass

Ordering (Exeter Helpdesk first) and


wording as per latest version of
prototype please

Medium

Closed

The system displays the Thingy helpdesk


number (0113 394 6540)

2/22/2010

Des

Pass

Ordering (Exeter Helpdesk first) and


wording as per latest version of
prototype please

Medium

Closed

There is an option to submit an online enquiry,


with the following data entry fields:
- Name (text)
- Email (text)
- Telephone (text)
- Organisation Type (drop down)
- Subject (drop down)
- Details (text area)
- Email me a Copy of my Enquiry (checkbox,
default not selected)

2/22/2010

Des

Pass

1) Can you put a highlight box around


the data fields as per prototype

Low

Closed

Des

Pass

2) Can you put mandatory field markers


against the fields as per the prototype

Closed

Des

Pass

3) Can you make the sentence above


the data fields into an "instruction"
class as per the prototype (<p
class="instruction">)

Closed

Des

Pass

4) Can you size the details field as per


the prototype

Closed

Des

Pass

5) In "Email me a copy of my Enquiry",


can you put a lowercase "e"on
"Enquiry"? (sorry, my fault, the
prototype was wrong)

Closed

Can you put Pharma/Dentist before


Other as per prototype

Medium

Closed

Can you order as per prototype please

Medium

Closed

The options for Organisation Type are:


- Thingy/Dentist
- Other

2/22/2010

Des

Pass

The default for Organisation Type is "<Select>"

2/22/2010

Des

Pass

The options for Subject are:


- PQR App - Account Registration
- PQR App - Policy
- PQR App - Assessments
- PQR App - Reports
- PQR App - PQR Statement if Compliance
(PQRSoC)
- PQR App - Technical Issue
- PQR App - Feedback
- PQR App - Other

2/22/2010

Des

Pass

9
10

The default for Subject is "<Select>"

2/22/2010

Des
Des

Pass

11

The system validates that:


- Name is not blank
- Email is a well-formatted email address
- Telephone is not blank
- Organisation Type has been selected
- Subject has been selected
- Details is not blank

2/22/2010

Des

Pass

12

The system validates that I selected an org type


of "Other"

2/22/2010

Des

Pass

13

The system sends an email to Exeter Helpdesk


(exeter.helpdesk@nhs.net)

2/22/2010

Des

Pass

14

The email subject is based on the subject I


selected, as follows:
- PQR App - Account Registration -> PQRT Registration
- PQR App - Policy -> PQRT - Policy
- PQR App - Assessments -> PQRT Assessment
- PQR App - Reports -> PQRT - Reports
- PQR App - PQR Statement if Compliance
(PQRSoC) -> PQRT - PQRSoC"
- PQR App - Technical Issue -> PQRT Technical
- PQR App - Feedback -> PQRT - General
(Feedback)
- PQR App - Other -> PQRT - General

2/22/2010

Des

Pass

15

The email body includes Name, Email, Telephone N


and Details

2/22/2010

Des

Pass

16

The system validates that I didn't select "Email


me a Copy"

2/22/2010

Des

Pass

17

The system re-displays the "Contact Us" page


with all the fields reset to their default values

2/22/2010

Des

Pass

18

The system tells me that it has submitted my


enquiry

2/22/2010

Des

Pass

The system displays all validation failures


Rejoin Main flow at step 10 (re-enter details)

N
N

2/22/2010
2/22/2010

Des
Des
Des

Pass
Pass

Enter details of my enquiry and click


"Submit"

11a

1
2
3

Validation fails

12a

I selected an org type of


"Thingy/Dentist"

16a

1a

1a.1a

1b

View "About" Info

General User

Read general information


about PQRT

Main

View "Accessibility" Info

General User

Read information about


PQRT accessibility

Main

Pass

Des
Des

Pass

The system sends a copy of the enquiry email to N


the email address I specified

2/22/2010

Des

Pass

Rejoin Main flow at step 17 (confirmation of


submission)

2/22/2010

Des

Pass

2
3

As per Main flow except:


My name, email and telephone details are prepopulated

N
N

2/22/2010
2/22/2010

Des
Des

Pass
Pass

My organisation type is defaulted to "Other"

2/22/2010

Des

Pass

The system doesn't display the Thingy Assurance N


phone number

2/22/2010

Des

Pass

1) Can you change the wording to a


Low
single paragraph (no bullet point): "You
can contact us by phone on 01392
251289 (Mon-Fri, 8am-5pm)". Note that
the word "us" is currently missing (my
fault as I missed it off in the prototype)
2) Can you add the word "us" into the
text shown to not logged-on users

Closed

The email body includes my User ID, Org Code


and Org Type

2/22/2010

Des

Pass

I expected to see Org Code on one line Medium


and Org Type on a separate line but I
actually got a single line which said
"Organisation Code: A.TEST:ACUTE A.TEST: Acute Trust Organisation Type:
Acute ". It looks like you have also
included org name, which is OK, but
can you put 3 separate lines - org code,
org name and org type?

Closed

2
3

As per flow 1a except:


My organisation type is defaulted to
"Thingy/Dentist"

N
N

2/22/2010
2/22/2010

Des
Des

Pass

The system doesn't display the Exeter Helpdesk


phone number

2/22/2010

Des

Pass

1) Can you change the wording to a


Low
single paragraph (no bullet point): "You
can contact us by phone on 0113 394
6540 (Mon-Fri, 9am-5pm)". Note that
the word "us" is currently missing (my
fault as I missed it off in the prototype)

Closed

There is an option to contact us

2/22/2010

Des
Des

Pass

Help page is all wrong!

Closed

The system displays the "Contact us" page

2/22/2010

Pass

Can't test until fixed step 2 above

There is an option to view the "About" page in


the header bar

2/11/2010

nili

Pass

System displays the About page

2/11/2010

nili

Pass

About page content is as per prototype page


"about.html"

4/29/2010

nili

Pass

There is an option to view the "About" page in


the main panel

2/8/2010

nili

Pass

Rejoin main flow at step 4

2/11/2010

nili

Pass

There is an option to view the "About" page in


the main panel

2/11/2010

nili

Pass

Rejoin main flow at step 4

2/11/2010

nili

Pass

The system displays the Accessibility page with


text as per prototype

6/24/2010

Pass

There is an option to view the Accessibility page


(wording and ordering as per prototype)

6/24/2010

Pass

The system displays the Accessibility page with


text as per prototype

6/24/2010

Pass

The system displays the Terms and Conditions


page with text as per prototype

6/15/2010

Pass

System displays updated Terms and Conditions


as per prototype

6/15/2010

Pass

Logged in as a non-Thingy/Dentist user

1
2

Request to view the Help page

Request to contact XYZ ABC (via Help


page)

View the home page

3
4
1
2

Request to view the "About" page

3
4

Request to view the "About" page

Click the Accessibility link in the footer


bar on any page

View the help page

Click the Accessibility link in the footer


bar on any page

View Updated Registration General User


Terms & Conditions

View updated Terms &


Conditions when
registering for an PQRT
account

Main

Request to register for an account, and


progress through the process to the
Terms and Conditions page

Show Environment Name


and Build Number

See which (non live)


environment I am
connected to and also
which software build I am
using

Main

Browse to the home page on a non-live


environment

S094

S095

Improved Navigation Widgets

General User

Navigate more sensibly to Main


the widgets list page

Closed

Wording and ordering as per prototype, Low


and whilst you're at it, can you put a
capital "U" on "Contact Us"

Closed

Closed

Content not changed!

Medium

Closed

If I select an org type which has no


widgets set up, I get a server error. In
the current live system it just displays
an empty list (e.g. For Dentists)

High

Closed

The system displays the software build number


(e.g. Somewhere in the header bar)

View any page (not logged in)

2
3
4

Request to view widgets

5
6

Select an org type

If I click "return to home page" link at


Low
bottom, the home page is idsplayed by
the nav bar says "Help" and the
breadcrumb says "Help > About >
Home"

The system displays the environment name (e.g.


Somewhere in the header bar)

S097

Des

Click the Terms and Conditions link in


the footer bar on any page

General User

Des

View the help page

1
2

High

Request to view the "About" page

1
2

TH 15/3 failed retest


TH 22/3: failed retest
Des 18/5: Fixed

Des

View any page

General User

Des

Logged in as a Thingy or Dentist user

Main

View Terms & Conditions

Closed

Des

2/22/2010

View PQRT terms &


conditions

S086

All fields are OK but can you make the Low


Name, Email and Telephone fields wider
- currently the email box is too narrow
to show an average email address (e.g.
Adam.tester@madeup.com)

2/22/2010

2
1a

Closed

S084

15/3 Sorry, I didn't spot this first time


Low
round...can you put the submission (a)
in red and (b) in the "Contact us Online"
section - as per the validation errors

Rejoin Main flow at step 14 (email subject)

3
4

1b

System error displayed - presume this


is to do with connfig of system test
environment re. sending emails

Des

I requested a copy of the enquiry by


email

1a

Closed

The system sends an email to Thingy Assurance


(thingy.assurance@nhs.net)

3
1

4
S083

1) Can you move the validation errors


Low
so they appear just above the data
fields highlight box
2) Can you change the wording so it
says "Name must be entered", "Email
must be entered", "Organisation Type"
must be entered etc. so that the words
in the error message exactly match the
field names on the screen (for
consistency)

15/3 Failed retest

There is an option to view widgets ("Widgets"


nav bar item) (no change)

2/22/2010

3/17/2010 nili

Pass

The system displays the Widgets (Org Chooser)


page

2/22/2010

3/17/2010 nili

Pass

2/22/2010

3/17/2010 nili

Pass

The Widgets List page includes *all* widgets that Y


are applicable to my organisation type

2/22/2010

3/17/2010 nili

Pass

The system displays the Widgets List page (i.e.


Skips over the current widgets "wheel" page)

TH 15/3 No option to contact us - see


prototype for how it should be (just include
the contact us link for new, we will add the
others in as we develop the relevant
pages)
TH 22/3: page title should be "Help", not
"Contact Us"

1a

1b

2
1

View any page (logged in as a nonassessable org type e.g. XYZ ABC)

1c

S098

Home Page - What Next

Logged In User

Once I have logged in,


Main
view instructions on what I
can do next

1a

Search Knowledge Base

General User

Search for knowledge


Main
base documents based on
various criteria

S109

Context Sensitive Help

Developer

General User

Implement context
sensitive help in a
straightforward and
flexible manner

Receive context sensitive


help as necessary across
the whole site

Main

Main

Pass

3/17/2010 nili
3/17/2010 nili

nili: this functionality already exists

Pass

There *is* an option to view the PQR Assurance


Statement

3/25/2010

nili

nili: this functionality already exists

Pass

There *is* an option to view the implementation


plan

3/25/2010

nili

nili: this functionality already exists

Pass

Pass

Log in

The system displays the Home (logged in) page

2/22/2010

3/17/2010 nili

Pass

There is an instruction (in the "At a Glance" box) Y


to select an option from the nav bar

2/22/2010

3/17/2010 nili

Pass

There is an option (in the "At a Glance" box) to


start working on your current assessment (by
clicking on the "Assessments" nav bar item)

3/18/2010

3/17/2010 nili

Pass

System behaves as if I had clicked the


"Assessments" nav bar option i.e. takes me to
the Assessments page (note, currently nonadmin users cannot see the "Assessments" tab
but it's OK, we're going to change this in a later
story

3/18/2010

3/17/2010 nili

nili: page uses the navbar permissions Pass


to determine whether to show the
'assessments' instruction. If the navbar
permissions change, the page should
reflect that change automatically.

The system asks me to select an organisation


type to view the knowledge base for

3/18/2010

Des

Pass

There is also an option to view the entire


knowledge base (i.e. All org types)

3/18/2010

Des

Pass

The system displays the Knowledge Base page

3/18/2010

Des

Pass

The page includes a list of all KB resources (DB


table KnowledgeBaseDocument) that are
relevant to the selected org type - specifically
this is a list of all KB resources which are
referenced from any Widget Variant (DB table
WidgetOrganisationType) which is (a) applicable
to the selected org type and (b) part of the
current widget set

3/18/2010

Des

Pass

7
8

The list is in alphabetical order by title


For each KB resource, the following info is
displayed:

3/18/2010

Des

Pass

9
10

Title
Y
External resource indicator to the RHS of the title Y
- if its Location is "External"

3/18/2010
3/18/2010

Des
Des

Pass
Pass

11

Description (via float-over pop-up, in order to


make better use of space)

3/18/2010

Des

Pass

12
13
14
15

Type
Creation Date
Last Reviewed Date
Related Widget(s) - a comma-separated list of
Widget Numbers for all related widgets as
identified in step 5 above (in ascending
numerical order, with duplicates removed)

Y
Y
Y
Y

3/18/2010
3/18/2010
3/18/2010
3/18/2010

Des
Des
Des
Des

Pass
Pass
Pass
Pass

16

There is an option to view each KB resource (the Y


Title of each resource (including the external
resource indicator if displayed) is a hyperlink to
the KB resource itself - based on its Filename if
internal or Weblink if external)

3/18/2010

Des

Pass

The system opens the KB resource in a new


window

3/18/2010

Des

Pass

The system opens the KB resource in a new


window

3/18/2010

Des

Pass

Skip the org type chooser (go to Main flow step


5), displaying information for my own org type

3/18/2010

Des

Pass

Proceed as per main flow but include KB


resources related to widgets which are in the
current widget set for any org type.

3/18/2010

The Knowledge Base page also includes search


filters for the KB resources, as follows:

2
3

Keyword(s) - free form text, default blank


Y
Widget - drop down menu containing a list of all Y
widgets which are relevant to the selected org
type (or all org types if no org type was selected)
The format of each widget is "<Widget Number>
(<Initiative Name>)"

3/18/2010
3/18/2010

Des
Des

Pass
Pass

The system changes the list of KB resources to


include only those that match ALL of the
following criteria (change from current which
matches ANY):

3/18/2010

Des

Pass

The KB resource is related to the specified widget N


number (if specified)

3/18/2010

Des

Pass

The KB resource title or description contains any N


of the specified keywords
in any order (no change from current)

3/18/2010

Des

Pass

Log in as a user of an "assessable" org

3
4

Select this option

Request to view the knowledge base


(not logged in or logged in as a nonassessable org type)

1
2

Context Sensitive Help


Mechanism

3/17/2010 nili

3/18/2010

Select to view the KB for a specific org


type

Look & Feel - Widget


Details

General User

Have a nice look & feel for Main


the widget details page

Closed

Des 24/05 - Fixed

Closed

Des 15/06: Need to check if the file


physically exists.
TH 16/6 CMC says this is now sorted out - it
was an env't problem

If I type in a keyword and then click


Medium
"Search" it's OK, but if I type in a
keyword and hit "Enter" then the page
is re-displayed as-is without taking into
account the keyword I entered

Closed

Des 15/06: Fixed

Need to test with real data

Tested in UAT - some docs loaded OK


(e.g. "Audit Programme - Mobile and
Remote Working") but others gave me
"file not found" e.g. "Bite-sized Good
Practice Guide: Application Security"

High

Request to view an external KB resource

Request to view the knowledge base


(logged in as an assessable org type)

Select to view the entire KB


Pass

Enter search criteria and request a


search

Insert a "context sensitive help" marker


into a web page with a specific ID

Deploy a (test) context sensitive help


configuration file with the application
(including some simple HTML formatting
e.g. <strong> and <p>).

Run the application and float the mouse


over the context sensitive help marker

The system displays the relevant text from the


context sensitive help configuration file

N/A

N/A

RJM

Pass

The text is displayed in a popup

Date unknown N/A

RJM

Pass

Popup appears off-screen if near RHS of Medium


screen

Closed

The text is formatted as per the HTML markup

N/A

N/A

RJM

Pass

HTML formatting needs styling up


properly (e.g. See Org Code help on
Home Page)

Low

Closed

The popup remains displayed indefinitely (i.e.


not not a standard tooltip)

Date unknown N/A

RJM

Pass

The system displays a context sensitive help icon Y


at the specified location within the page

Date unknown N/A

RJM

Pass

6/24/2010

RJM

Pass

On Widgets List page hover over


Low
'Status'. My widget states 'Answered' in
this column but this is not one of the
stated statuses in the context sensitive
help popup

Closed

TH - I have updated the relevant text in


contextHelp v3 WIP.xml - just needs
copying across

Pass

Evidence location dialog box. Choose


'Internet' or 'Intranet'. The ? Next to
URL line states 'context help is not
available'

Low

Closed

Needs update to context help

Pass

The ? Next to the 'Upload New File'


button in the evidence location dialog
box is missing the word 'to'.
Needs to say:
Click this button to upload a file from
your local PC or network to our server.

Low

Closed

Checkbox icons don't match prototype - Low


can you change back as per e-mail
conversation with RJM and TM on 18/3

Withdrawn TH 20/5 leave as-is

This story builds on S105 by


implementing all context sensitive help
items as specified in ContextHelp v2.xml

For each context sensitive help item


specified in ContextHelp v2.xml (in
\\data1brind\data\Information
governance\PQRT Version 8\Functional
Specification):

3
4

Navigate to the specified page

5
6

Float over the icon


The system displays the relevant description

EP - Intranet help updated, internet ?


Has been removed.

S108

Float over isn't working (it used to work High


so must be broken!)

Request to view an internal KB resource

S105

3/18/2010

3/18/2010

17b

There is an option to view Assessments


(currently only available to Org Admin users needs to be extended to Org User and Org
Reviewer roles)
Request to view assessments

18

4a

Pass

There are *not* options to delete, baseline, perf


update or submit the assessment - these actions
can only be performed by Org Admin users

17

1a

Pass

3/17/2010 nili

The system displays the Assessments Summary


and History page

17a

3/17/2010 nili

3/18/2010

S075

2/22/2010

There is *not* an option to view widgets (i.e. No


"Widgets" nav bar item)
View any page (logged in as an Org User
or Org Reviewer from an assessable org
type)

3
4

Proceed as per main flow (from step 2)


View any page (logged in as a user from
an assessable org type - any role)

View the widget details page (as a


logged in user from an "assessable"
organisation)
The formatting of each attainment level is as per Y
the prototype

The "achieved" boxes only appear if the screen is N


being viewed in the context of completing an
application

3/4/2010

N/A

3/17/2010 RJM

complete

Pass

3/17/2010 RJM

complete

Pass

The formatting of the attainment levels summary Y


is as per the prototype

3/4/2010

3/17/2010 RJM

complete

Pass

The formatting of each attainment criterion is as Y


per the prototype

3/4/2010

3/17/2010 RJM

complete

Pass

Not a fail, since not in prototype, but


Low
Level 3 Maint label is too big. See latest
cut of prototype for markup and CSS to
make it smaller

Closed

Each attainment level can be expanded to show


the attainment criteria within, and collapsed
again

3/4/2010

3/17/2010 RJM

complete

Pass

By default all sections should be


collapsed, whereas Attainment Level 1
and Criterion 1a are expanded

Closed

When an attainment level is expanded, if


another attainment level is already expanded, it
is collapsed (i.e. Accordion style)

3/4/2010

3/17/2010 RJM

complete

Pass

Is there any way of making the collapse Low


of the other section a smooth "roll-up"?
I would think roll up the other one first
then roll down the selected one.

Closed

Each attainment criterion can be expanded to


show the details within, and collapsed again

3/4/2010

3/17/2010 RJM

complete

Pass

When an attainment criterion is expanded, if


Y
another attainment criterion is already expanded
(within the same attainment level), it is collapsed
(i.e. Accordion style)

3/4/2010

3/17/2010 RJM

complete

Pass

As above, can it be smoother?

Low

Closed

Pass

Not a fail (in fact it's very nice) but is


there any way to make the pop-up
position relative (close) to the icon the
user clicks?

Low

Closed

Pass

Tooltip missing from icon (see prototype) Medium

The evidence comments pop-up is accessed via


an icon in the RHS of the Comments column

3/4/2010

3/17/2010 RJM

complete

Medium

Closed

If an evidence comment has been entered, the


first 30 characters of the comment is displayed,
with CRs replaced by spaces, and with "..." on
the end if the comment is more than 30
characters long

3/15/2010

3/17/2010 RJM

complete

Pass

If I enter a CR then it displays as a


Low
"wide" space. If I leave the screen and
come back it's a normal space. Only fix
this if trivial

Withdrawn TH 20/5 not a big deal so withdrawn

Header panel layout is as per prototype

3/15/2010

3/17/2010 RJM

These items will probably take an extra Pass


1 days

Padding between border and content is Low


larger than on prototype

Withdrawn TH 20/5 Changed prototype to match site!

Right padding/margin is too big in the


RH column of the inner table

Closed

Pass

S110

Can't Enter Widget Level


Comments

Organisation User Not enter widget-level


comments for a (v8+)
widget

Main

S111

Smaller PQR Assurance


Statement Pop-up

Organisation User Be able to view the PQR


Main
Assurance Statement Popup on an 800x600 screen

1a

View a widget for an in-progress (v8+)


assessment

Pre

My assessment is ready to be submitted

Pre

My organisation is not exempt from the


PQR Assurancer Statement

Submit the assessment, from the


assessment summary page (including
confirmation)

S117

Submission Email Log

Specify A Widget Owner

Organisation User View a record of the


sending of an submission
e-mail

Organisation
Administrator

Main

Specify a user from my


Main
organisation as the owner
for a given widget

Specify a user from my


Main
organisation as the second
owner for a given widget

S113

Add Improvement Action

Organisation User Add an improvement


action against a specific
attainment criterion

Main

3/15/2010

3/17/2010 RJM

complete

Pass

Done button saves changes and takes you back


to widgets list screen

3/15/2010

3/17/2010 RJM

complete

Pass

The unordered lists in the Widget Origins and


Changes sections have circular bullet points
(currently no bullet points)

N/A

N/A

RJM

complete

Pass

The top level section headings (Widget


Description, Guidance etc.) are <h2> level
headings (or have equivalent formatting)

N/A

N/A

RJM

complete

Pass

The style of the knowledge base tabs is as per


the prototype

3/17/2010 RJM

complete

3/15/2010

The Cancel button should only appear if Medium


the screen is being viewed in the
context of completing an application

Closed

Pass

The selected tab has a black line


between the tab and content

Withdrawn TH 20/5 too difficult to fix

Pass

The unselected tabs need to be a


Low
darker grey colour as per prototype (the
shade you have used looks OK on some
monitors but is too pale on others)

Closed

TH 08/04 Retested - Dark gray as per


prototype, not blue please

Low

Closed

CMC:Looks ok on my monitor at 800x600


on both IE7 and IE6. Can you re-test
please to see if this is still an issue. RJM
has fixed this
TH 14/06 Just tried it in IE7 and

Proceed as per Main Flow

3/18/2010 N/A

CMC

Pass

The footer appears in front of the PQR


Assurance Statement

Closed

RJM

The system marks the assessment as submitted


(no change)

3/18/2010 N/A

CMC

Pass

The system sends a submission e-mail to the


relevant users at the organsiation (no change)

3/18/2010 N/A

CMC

Pass

The system creates a new entry in the


assessment status history (no change)

3/18/2010 N/A

CMC

Pass

The system records the fact that the e-mail was N


sent and to whom in the "notes" field of the new
assessment status history record

3/18/2010 N/A

CMC

Pass

The system does not persist the Owner, High


Date or Complete status for a newlycreated action (only for a pre-existing
action)

Closed

RJM: caused by change of criterion from


1a, 1b etc to a, b, etc

Closed

Des 25/05 - Fixed

Submit the assessment, from the


widgets list page (including
confirmation)

Pre

My assessment is ready to be submitted

Submit the assessment (including


confirmation and PQR Assurance
Statement)

Request to view the widget list for an inprogress (v8+) assessment

4/6/2010

The system displays the "Widget Owners" page

4/6/2010

Des

Pass

For each widget, there is an option to specify the Y


widget owner - this is a drop-down list of all users
from my organisation (excluding those with
locked accounts).

4/6/2010

Des

Pass

By default there is no owner (and this is an


allowed state)

4/6/2010

Des

Des

Pass

Request to specify requierment owners

Pass

Des

Select the widget owner for one or more


widgets

Des

8
9

Request to save my changes

Pass

Pass
Pass

The system persists the widget owner for each


N
widget (it is an attribute of the Widget Response)

4/6/2010

Des
Des

The system displays the Widget List page


The system displays the widget owners (read
only)

4/6/2010
4/6/2010

Des

Logged on as any user type, request to


view the widget list for an assessment
from my *own* organisation which has
had one or more owners specified.

Des

The system displays the widget owners (read


only)

4/6/2010

Des

Logged on as an XYZ ABC user, request


to view the widget list for an assessment
which has had one or more owners
specified.
The system displays the widget owners (read
only)

4/6/2010

Des

Request to view a widget for an inprogress assessment

Pass

Des

The system doesn *not* display the widget


owners (read only)

4/6/2010

The system doesn *not* display the widget


owners (read only)

4/6/2010

For each attainment criterion there is an option


to add an improvement action

3/18/2010

3/18/2010

Des

Pass

Need to be able to get an assessment


to status approved first
Also need Assessment Report to be
working

Des

Pass

Need to be able to get an assessment


to status approved first
Also need Assessment Report to be
working

3/17/2010

Des

Pass

3/17/2010

Des

Pass

Not logged on, request to view the


widget list for an assessment which has
had one or more owners specified.

TBC this is as per S117 but allows the


admin to specify a second owner - this is
primarily for GHJs who generally have
two owners - one "commissioner" owner
and one "provider" owner

Pass

Des

Logged on as any user type, request to


view the widget list for an assessment
from another organisation which has had
one or more owners specified.

Des

Request to add an improvement action


to an attainment criterion

The system adds an improvement action, with


the following fields:

Description (free format text, default blank)

3/18/2010

3/17/2010

Des

Pass

Owner (free format text, default widget owner)

3/18/2010

3/17/2010

Des

Pass

Due date (calendar selection, can be any date


past or future)

3/18/2010

3/17/2010

Des

Pass

Completed flag (default not completed)

3/18/2010

3/17/2010

Des

Pass

Des

Pass

Enter details for the action


Request to save the widget response

11

The system validates the data fields (description N


is mandatory, the others are optional)

12

The system persists the improvement action

3/18/2010

3/17/2010

Des

Pass

The system adds another improvement action


(rejoin main flow at step 4)

3/18/2010

3/17/2010

Des

Pass

There is an option to edit the improvement action N

3/18/2010

3/17/2010

Des

Pass

The system persists the changes

3/18/2010

3/17/2010

Des

Pass

There is an option to delete the improvement


action

3/18/2010

3/17/2010

Des

Pass

The system asks me to confirm

3/18/2010

3/17/2010

Des

Pass

The improvement action disappears from the


screen

3/18/2010

3/17/2010

Des

Pass

3/18/2010

3/17/2010

Des

Pass

Des

Pass

On the "Reports" page, can you move


the Improvement Plan and Evidence
Report link to the bottom of the list

Des

Pass

Edge case not tested

Des

Pass

Des

Pass

4/26/2010

Request to add another improvement


action

Request to view a widget for an inprogress assessment which has an


existing improvement action

Edit the improvement action (this


includes the option to mark it as
completed)

Request to save the widget response

5
1

Request to view a widget for an inprogress assessment which has an


existing improvement action

Request to delete the improvement


action

4
5
6

Confirm

Request to save the widget response


The system persists the deletion

The actions are displayed


There is not an option to add an action
There is not an option to edit or remove
individual actions

N
N
N

The system validates that the user has at least


one v8+ assessment

There is an option to select the assessment to


report on (v8+ assessments only)

The format of the assessments in the drop-down Y


is: Version <version number> (<start year><end year>)"

There is an option to select the widget owner (a


list of all users from the organisation plus an
option to specify all owners [default])

4/6/2010

3/29/2010

Des

Pass

There is an option to select the Report Type,


including:
- Improvement Plan (incomplete items only)
(default)
- Improvement Plan (including completed items)
- Completed Items Only

3/18/2010

3/17/2010

Des

Pass

Request to view a widget for an


assessment which has an existing
improvement action when it is "not
editable by me"

Definition of "not editable by me":


1) I am not a user from the owning
organisation, or
2) The widget status is past "In Progress"

3
4
5

Medium

Des

There is an option to specify widget owners

Main

Pass

Cancel button takes you back to widgets list


screen without saving any changes

Pop-up way too big on 800x600. Also, if High


I have my screen on full-res but the
window not full size, the pop-up is still
too big

Produce Improvement Plan Organisation User Produce an improvement


and Evidence Report
plan for my organisation

complete

Pass

S114

3/17/2010 RJM

Pass

View improvement actions Main

3/15/2010

CMC

View Improvement Actions General

Pass

Print/Download Multiple to be changed from links Y


to buttons (as per prototype)

CMC

9
10

S138

Pass

complete

3/18/2010 N/A

1b

Pass

complete

3/17/2010 RJM

3/18/2010 N/A

1a

complete

3/17/2010 RJM

3/15/2010

10a

3/17/2010 RJM

3/15/2010

Organisation
Administrator

3/15/2010

Print/Download to be changed from links to


buttons (as per prototype)

The PQR Assurance Statement pop-up is small


enough to fit into a browser which is maximised
on an 800x600 resolution screen

Specify a Second Widget


Owner

Top row of buttons to appear below header


panel, not above page title

The system displays the PQR Assurance


Statement (no change)

S118

Widget question text preceded by the key icon


for a key widget

1d

Pass

10
11

1c

complete

3/15/2010

1b

3/17/2010 RJM

1a

3/15/2010

There is *not* an option to enter requireemntlevel comments

S112

Header panel background colour is light blue (no Y


matter whether widget is a key widget or not)

Low

4/26/2010
4/26/2010
4/26/2010

Request to produce an evidence and


action report

3/18/2010

3/17/2010

Low

8
9
10

There is an option to set report options,


including:
- Evidence (default checked)
- Actions (default checked)

3/18/2010

3/29/2010

Des

Pass

Both boxes should be ticked by default

Medium

Closed

Des 25/05 - Fixed

Pass

Context help icon missing to RHS of


options

Low

Closed

Des 25/05 - Fixed

Pass

If I have previously opened the report


and I open it again, it reuses the same
popup window but doesn't bring it to
the front. Either bring it to the front or
open in a new window

Medium

Closed

Des 25/05 - Fixed

Pass

Organisation name not displayed

Medium

Closed

Des 25/05 - Fixed

Pass

Look and feel needs some work - try to


match prototype as much as possible
e.g.:
- font
- line spacing a bit wider between
paragraphs
- left hand margin

Low

Closed

Des 02/06 - Fixed

Pass

Please can you add curved corner


boxes around each widget. This will
clearly separate each widget. I think
this is something we can do quickly and
easily to make it appear better. Tony to
compile prototype.
He has now done this
(improvement_plan_report_results.html)
and it's important to note the gap in
between each req. Please make sure
it's roughly the same gap as shown.
Also, the org name is formatted using
<h2>

Closed

Des 15/06 - FIXED


Des 16/06: Refer to Christ email
dt.16.06.10 18:19

Current level NR, target level 2 - the


widget should be displayed (it's up to
the user to change their target level to
NR to get it to not display)

High

Closed

Des 25/05 - Fixed


TH 26/5 - it only displays the criteria that
are not marked as achieved but that is OK

Select report criteria


Request to produce report
The system displays the report in a new window

3/18/2010

3/17/2010

Des

corners are not curved but other than


that all looks good.

11

The report includes all widgets for which there is Y


one or more attainment criteria to display (see
below)

3/18/2010

3/17/2010

Des

Pass

12

The displayed widgets are in numerical order

3/18/2010

3/17/2010

Des

Pass

13

For each displayed widget, the widget question is Y


included

3/18/2010

3/17/2010

Des

Pass

14

For each displayed widget, the widget owner (if


any) is included

3/18/2010

3/17/2010

Des

Pass

If there is no widget owner, don't


display the line at all

Low

Closed

Des 25/05 - Fixed

15

For each displayed widget, the current level is


included

3/18/2010

3/17/2010

Des

Pass

If there is no current level then display


"(not answered)"

Low

Closed

Des 25/05 - Fixed

Pass

If the current level is exempt, it should


display "Exempt" instead of blank

Low

Closed

Des 25/05 - Fixed

Pass

On reflection, the suffixes


(excluding/including maintenance) are
confusing so remove them (sorry!)

Low

Closed

Des 25/05 - Fixed

Pass

If the target level is NR it's showing "4" Low


and if the target level is EX is is
showing "5"

Closed

Des 26/05 - Fixed


TH 7/6 - can you change "NR" to "Not
Relevant" and "EX" to Exempt so it
matches the "Current Level" labels?
Des 09/06: Fixed

Pass

The attainment criteria Ids are beign


High
displayed as just "a", "b", "c" etc.
instead of "1a", "1b", "1c". This is
because we have changed the way we
store the ID in the database - you need
to construct the displayed ID from the
attainment level and the criteria ID e.g.
"1" & "a" -> "1a"

Closed

Des 25/05 - Fixed

Pass

A.test:acute, req 204, current level 0,


target level 3: the system is displaying
criteria 1a, 1b, 2c and 3d but not 2b,
2c, 3a, 3b or 3c. It seems that each
letter is only displayed once - is it deduplicating letters and if so this might
be fixed by fixing the above defect
which will make each criterion ID
unique

High

Closed

Des 25/05 - Fixed

I have a gp assessment where first 2


High
reqs are set to level 2 but their target
levels are 3. These both show when I
produce an imp plan report. However,
the third req is set to level 1 with no
target level set so can see a red cross. I
would also expect to see this on the
imp plan report but it isn't.
Also tried to send an ad-hoc email to
the req owner of the third one but their
name is not in the list to send an email
to. Just the first 2 owners of the first 2
reqs.

Closed

Des 21/06: Not able to re-produce

Widgets are showing with a target of


NR (currently showing as "4" due to
another defect) and EX (currently
showing as 5)

Closed

Des 26/05 - Fixed


Des 11/06: Fixed
TH 7/6 - still showing a widget which is
current level "Exempt" and target level
"EX". Suspect this will be fixed when above
defect re. changing "EX" to "Exempt" is
fixed, although the system probably
shouldn't be relying on the exact wording
to detect a match!

For each displayed widget, the "calculated target Y


level" is included, as follows:
- If the org has set a target level for this req't
then use that target level
- If the org has not set a target level then use
level 3 but display "Not set (assumed Level 3)
- If the target level determined above is level 3
and the org achieved L3 for this widget in their
previous assessment, then the target level is
level 3 including maintenance criteria, otherwise
it is level 3 excluding maintenance criteria - so
display a suffix of " - excluding maintenance" or "
- including maintenance" as appropriate

16

17

3/18/2010

3/17/2010

The report includes all attainment criteria for


which any of the following is true:

Des

Des

18

- The Report Type specifies incomplete items and N


the attainment criterion is "outstanding" (see
definition below)

3/18/2010

3/17/2010

Des

Pass

19

Definition of "outstanding": an attainment


criterion is defined as "outstanding" if:
1) it is not marked achieved
AND
2) it is within the "calculated target level" (see
definition above)

3/18/2010

3/17/2010

Des

Pass

EP - I need to try and re-produce this


because Des can't recreate this and
neither can I now
EP - Can't reproduce this now. Weird
things happening with imp plan.

20

For the avoidance of doubt, if the target level is


NR or EX then the attainment criterion is *not*
outstanding

N/A

N/A

Des

Pass

Medium

will only show completed items on the


plan if there is evidence obtained and
ticked or actions complete. I didn't
have any items under the NR & EX
widgets

I have a login a.test:gp and set:


1st req to current level 3 and target
level 3
2nd req to current level NR and target
level NR
3rd req to current level EX and target
level EX
I choose to display an 'improvement
plan (uncluding completed items)' and
only the 1st req shows (should show all
of them. Same happens with the
'Completed items only' plan.

Closed

EP - This was because I was logged in Pass


as XYZ and ticking the obtained box
didn't automatically tick the box to the
right hand side. Once I manually tick
this, the details do show on the imp
plan.

Related to the above, I added evidence


and actions under the NR & EX widgets
and they still don't show on the
completed items improvement plans

Closed

Same scenario as above, for the 1st req


that shows, in the 'improvement plan
(uncluding completed items)' plan it
shows the yellow evidence secion but
in the 'Completed items only' plan it
doesn't show this evidence section.
Both tickboxes to show this detail are
ticked for both plans.

Closed

DES - fixed 17/06 / 18/06

Emailed Tony to confirm if this is


correct processing.
Tony raising new story for gp issue should auto tick the criterion box once
all evidence/actions beneath are
obtained/complete

EP - a.test:gp is currently in this state. I


am now using acute2 user for further
tests for now
EP - This defect is not occuring now for
some reason.

UPDATE 17/06
The 'improvement plan (uncluding
completed items)' plan shows evidence
& actions but the 'Completed items
only' plan only shows evidence, not
actions. Odd

2a

1a

21

- The Report Type specifies completed items and N


the attainment criterion is marked achieved

3/18/2010

3/17/2010

Des

Pass

22

The displayed attainment criteria are in alpha


order within their parent widget (Level 3
Maintenance criteria appear after other L3
criteria)

3/18/2010

3/17/2010

Des

Pass

23

For each displayed attainment criterion, the


attainment criterion description is included

3/18/2010

3/17/2010

Des

Pass

24

For each displayed attainment criterion, the


attainment criterion "achieved" status is
displayed

3/18/2010

3/17/2010

Des

Pass

25

If the user requested for evidence to be


displayed then evidence items are displayed
under each of the displayed attainment criteria
according to the following rules:

26

- If the Report Type specified incomplete items


then show evidence items which are not "fully
specified" as per definition in S033

3/18/2010

3/17/2010

Des

Pass

I marked an evidence item as obtained Medium


but did not fully specify the evidence
location. It should have been included
in the report (because it is not "fully
specified"). Chat to Richard about the
business rules for "fully specified" there may be some business logic that
can be re-used

Closed

Des 28/05 - Fixed

Pass

If the evidence location is not specified, Low


display "[not specified]" instead of
leaving it blank

Closed

Des 02/06 - Fixed

Pass

For an uploaded file, display "Uploaded" Low


followed by the filename (see defect
below - the filename also needs to be a
hyperlink)

Closed

Des 02/06 - Fixed

Closed

27

- If the Report Type specified complete items


then show evidence items which are "fully
specified" as per definition in S033

3/18/2010

3/17/2010

Des

Pass

Need to fix above defect first

28

For each evidence item, Evidence Location


includes a hyperlink to view the document (in a
new window) for appropriate location types

3/18/2010

3/17/2010

Des

Pass

No hyperlink for uploaded evidence

Medium

Closed

Des 02/06 - Fixed

29

If the user requested for actions to be displayed


then actions are displayed under each of the
displayed attainment criteria according to the
following rules:

30

- If the Report Type specified incomplete items


then show actions which are not marked
complete

3/18/2010

3/17/2010

Des

Pass

Due date is showing time as well as


date (only date required)

Medium

Closed

Des 26/05: Fixed

31

- If the Report Type specified complete items


then actions items which are marked complete

3/18/2010

3/17/2010

Des

Pass

1
2

The org has no v8+ assessments


The system displays a single option of "<No
assessments at v8 or greater>"

Des

Pass

Edge case not tested

All other options are displayed as per main flow

Des

Pass

Edge case not tested

4
1

The "Show Report" button is disabled

Des

Pass

Edge case not tested

Request to produce an evidence and


action report, logged on as XYZ ABC
user

System displays "Reports Single Organisation


Chooser" (as used in other reports)

4/6/2010 N/A

Des

Pass

There is an option to search for and select an


organisation to report on

4/6/2010 N/A

Des

Pass

Search for and select an organisation to


report on

S116

Send Ad-hoc Improvement Organisation


Action Reminders
Admin

Send ad-hoc email


reminders to widget
owners with outstanding
improvement actions

Main

Rejoin main flow at step 2, reporting on the


specified organisation

The system displays the Improvement Plan


Admin page

Des

Pass

The system validates that the organisation has


an "in-progress" assessment (not yet confirmed
or submitted as appropriate)

Des

Pass

The system validates that there is at least one


widget owner with "incomplete" widgets on the
current assessment (as per steps 9 and 10 of
S115)

Des

Pass

There is an option to send an ad-hoc email


reminder, including the following data entry
fields:

3/18/2010

3/17/2010

Des

Pass

"To" - a list of all widget owners with


Y
"incomplete" widgets on the current assessment
(as per steps 9 and 10 of S115).
There is also an option to send a reminder to
them all.
The default value is "<Select>"

3/18/2010

3/17/2010

Des

Pass

Not in the spec but the list of


Medium
"incomplete" widgets needs to exclude
any that are "marked complete" (also
applies to S115)

Closed

Des 04/06 - Fixed

Pass

Setup an EXEMPT req. This has a req


owner setup. When I send the ad hoc
email an email is sent to this person
but it is completely blank.

High

Closed

Des 21/06: Fixed.

Organisation
Admin

Send regular email


reminders to widget
owners with outstanding
improvement actions

Main

Label should be "Cc:", not "CC:"

Low

Closed

Des 02/06 - Fixed

S122

S137

View Past Attainment Level Organisation User View my attainment level


for a (v8+) widget on my
previous assessment

Set Target Attainment


Level and Date

Set Target Attainment


Level of 0, NR or EX

Organisation User Set a target attainment


level and date for a given
(v8+) widget

Organisation User Set a target attainment


level of 0, NR or EX

Main

Main

Main

Low

Closed

Des 03/06 - Fixed

Closed

3/18/2010

3/17/2010

Des

Pass

3/18/2010

3/17/2010

Des

Pass

11

The system validates that I have selected a


recipient (or "All") in the "To" field

N/A

3/18/2010

3/17/2010

Des

Pass

Error message refers to "Widget Owner" Low


but field label is "To"

Closed

Des 04/06 - Fixed

12

The system validates that I have specified zero


or more valid email addresses in the "CC" field
(separated by semi-colons or commas)

N/A

3/18/2010

3/17/2010

Des

Pass

error message - should be "The


following emails are not valid"

Low

Closed

Des 02/06 - Fixed

Pass

System won't handle whitespace after


the comma or semicolon - it says the
secont email address is invalid

Medium

Closed

Des 02/06 - Fixed

10

Request to send the ad-hoc reminder

13

The system sends a separate reminder email to


each specified recipient (if they have an email
address set up)

3/18/2010

3/17/2010

Des

Pass

14

Each email is copied to all email addresses in the Y


"CC field"

3/18/2010

3/17/2010

Des

Pass

15

The content of the email is as specified in S115

3/18/2010

3/17/2010

Des

Pass

Waiting for fixes to S114 before testing

Pass

Heading font too large (e.g. "A Message Low


from your PQR App Administrator")

Closed

Des 03/06 - Fixed

Pass

Remove "PQR App Administrator" name Medium


from the sender details so it just
displays DONOTREPLAY@...

Closed

Des 02/06 - Fixed

Pass

remove gap between recipient name


and comma

Low

Closed

Des 02/06 - Fixed

Pass

Increase paragraph spacing

Low

Closed

Des 04/06 - Fixed

Pass

Outstanding evidence not displayed (I


haven't tried but I'm guessing that
outstanding actions are not displayed
either)

High

Closed

Des 02/06 - Fixed

Des

Pass

The system should treat newlines in the Low


preamble as starting a new paragraph
(i.e. insert <p> tags as appropriate. If
there are two newlines together, do not
include a blank paragraph (assuming of
course that you have set up the
formatting to include a bit of
whitespace between paras)

Closed

Des 04/06 - Fixed

16

The email also includes the preamble (see


prototype for location)

TBC

17

Any HTML special characters (&, <, > etc.) are


correctly displayed in the email

Des

Pass

18

The email does not have to be sent immediately N/A


but is sent within 30 minutes

4/6/2010

Des

Pass

19

The system confirms who it has sent an email to N


and who it has failed to send an email to due to a
lack of email address

4/6/2010

Des

Pass

See prototype for wording

Low

Closed

Des 03/06 - Fixed

20

The system tells the user that the emails will be


sent within 30 minutes

4/6/2010

Des

Pass

See prototype for wording

Low

Closed

Des 03/06 - Fixed

The system displays a message to say I can't


send an ad-hoc reminder at the moment (see
prototype for wording)

Des

Pass

Waiting for defect at MF step 3 to be


fixed

The system displays a message to say I can't


send an ad-hoc reminder at the moment (see
prototype for wording)

Des

MSG - You cannot send an ad-hoc


Pass
reminder at the moment because there
are no widget owners with incomplete
widgets

The system displays the Improvement Plan


Admin page

3/18/2010

3/17/2010

Des

Pass

There is an option to indicate whether regular


email reminders should be sent

3/18/2010

3/17/2010

Des

Pass

The system validates that all potential email


recipients have email addresses set up

4/6/2010

Des

Had to setup a user at an acute trust to Pass


test this. Set up and chose option
'don't email' in dropdown. When this
user is then set as a req owner and you
go to the imp plan admin page you get
a msg to say the user does not have an
email address

The system persists my changes

3/18/2010

3/17/2010

Des

Pass

The system validates that the organisation has


an assessment which is:
a) v8 or above and
b) not yet submitted

N/A

4/6/2010

3/17/2010

Des

Pass

4/6/2010

3/17/2010

Des

EP - I have a setup where I am the


Pass
widget owner of 3 widgets and all 3 are
currently not answered. I run the job
and no email is sent. If I change one of
the widgets to level 1 (so still not
obtained properly) the email is sent.
This email then contains details of all 3
req's, even though 2 are still
completely unanswered

Closed

DES fixed 17/06

Des

If current and target levels are NR / EX, Pass


widgets do not show on the email.
If current level is NR or EX but target
level is blank, widgets do show on the
email.

Set 3 widgets to me as the owner. 1st is High


set to level 3 and complete, 2nd is NR
& 3rd is EX. When I run the job I get an
email but there are no incomplete
items on it. I shouldn't get an email in
this case.

Closed

DES 22/06: Fixed

Setup an action with a due date in the Medium


past but it appears on the email like the
rest of the future due date actions. Is
not specifically flagged as overdue (that
I can see anyway)!

Closed

DES 22/06: Fixed

Working as a.test:acute2, req 102


High
should have past level 3 and req 103
should have no past level (req 103
doesn't exist in previous assessment).
But if I click "Next" from req 102, it
shows past level as 3 for req 103 (looks
like it is remembering the past level
from req 102 instead of blanking it out)

Closed

3/18/2010

N/A

3/17/2010

N/A

The organisation does not have an inprogress assessment

There is *not* at least one widget owner


with "incomplete" widgets on the current
assessment (as per steps 9 and 10 of
S115)

Request to administer improvement plan


settings

Indicate that regular email reminders


should be sent

6
7
8
9

Request to save my changes


Wait until the 1st of the month

10

The system sends an email to each widget owner Y


with "incomplete" widgets on this assessment
(so long as they have an email address).
A widget is "incomplete" if either:
i) the current level is lower than target level, or
ii) it has incomplete improvement actions
However, a widget is *not* incomplete if it has
been marked complete.

11

For the avoidance of doubt, if the target level is N/A


"NR" or "EX" then the widget is *not* incomplete

12

The email includes a list of the incomplete


widgets

4/6/2010

4/6/2010

Des

Pass

13

For each incomplete widget, the email states the Y


current attainment level

4/6/2010

4/6/2010

Des

Pass

14

For each incomplete widget, the email states the Y


target attainment level (if set)

4/6/2010

4/6/2010

Des

Pass

15

For each incomplete widget, the email includes a Y


list of all evidence (including whether obtained,
location type and comments)

4/6/2010

4/6/2010

Des

Pass

16

For each incomplete widget, the email includes a Y


list of all actions (if any), including all details

4/6/2010

4/6/2010

Des

Pass

17

For each action, the email includes the


description, owner and due date

4/6/2010

4/6/2010

Des

Pass

18

If the due date is in the past the action is flagged Y


as overdue

4/6/2010

4/6/2010

Des

Pass

The email includes a link to the PQR App website

4/6/2010

3/17/2010

Des

Pass

The email includes contact details for the


organisation's PQRT administrator

4/6/2010

3/17/2010

Des

Pass

The system displays a warning listing the


Y
potential email recipients who do not have email
addresses set up

4/6/2010

Des

Pass

Rejoin main flow at next step

4/6/2010

Des

Pass

20

S121

I marked the assessment as confirmed


but the system didn't display the error
message

19

4a

3/17/2010

Preamble - a free format text area (default blank)


Enter details for the ad-hoc reminder

Send Regular
Improvement Action
Reminders

3/18/2010

"Cc" - a free format text box (default blank)

S115

Pass

Des

4a

Des

3a

4/6/2010 N/A

Request to administer improvement plan


settings

N/A

N/A

There are one or more potential email


recipeints who do not have an email
address set up

Request to view a (v8+) widget, within


the context of an assessment

The system displays my "past attainment level"


for this widget, as follows (this is as per existing
functionality for v7- widgets):

- If I have no previous assessments, it is blank.

N/A

N/A

RJM

Pass

- If my most recent assessment was against a


widget set which did not have the same widget
number in, it is blank.

N/A

N/A

RJM

Pass

- Otherwise, it is the attainment level I achieved


against the same widget number in my most
recent assessment.

N/A

N/A

RJM

Pass

Request to view a (v8+) widget, within


the context of an assessment

There is an option to set a target attainment


Y
level (the options are blank [default], 1, 2 and 3 not 0 or NR).

RJM

Pass

There is an option to set a target date (default


blank).

N/A

N/A

RJM

Pass

The system validates that the target date is a


valid date (future or past)

N/A

N/A

RJM

Pass

If I type an invalid date and hit enter,


the screen fades to white and back
again but no pop-up is displayed. If I
tab out of the field I do get the popup.

Low

Closed

The target level and date are persisted along


with the widget response

N/A

N/A

RJM

Pass

If I set the target level and date and


then navigate to the next widget, the
same target level and date are redisplayed

High

Closed

Pass

Set target level -> done -> select


previous reqt -> next -> target level is
blank

High

Closed

RJM/CMC

If I set the target level as NR and then


click "Next" I get a system error

High

Closed

Data removed from database script. Needs


re-instating.

4
5

Set the target level and date

6
7

Request to save my changes

Request to view a (v8+) widget, within


the context of an assessment
There is an option to set a target attainment
level of 0

3/25/2010

If NR is allowed for this widget, there is an option Y


to set a target attainment level of NR

4/12/2010

RJM

Pass

RJM

Pass

S123

Mark Widget as Complete

Organisation
User (or
Reviewer or
Admin)

Mark a (v8+) widget


response as complete

Main

2b

S124

Mark Widget as Confirmed Organisation


Reviewer (or
Admin)

Mark a (v8+) widget


response as confirmed

Main

If the organisation has been exempted from this


widget, there is an option to set a target
attainment level of EX

4/12/2010

RJM

Pass

The system validates that the user's org type is


not a "simplified interface" org type

4/22/2010

RJM

Pass

The system validates that the widget response


N
includes a current attainment level (you can't
mark it complete if you haven't answered it).
This is *not* synonymous with a widget status of
"In Progress"

4/22/2010

RJM

Pass

If the assessment is subject to 3-stage reporting, N


the system validates that the user's assessment
has been performance updated

4/22/2010

RJM

Pass

There is an option to mark the widget response


as "complete"

4/22/2010

RJM

Pass

The system persists the fact that the widget has


been marked complete and also captures the
date and time and the current user

4/22/2010

RJM

Pass

10

The system displays the date and time the


widget response was marked complete and the
user who marked it complete

4/22/2010

RJM

Pass

11

The widget is now "locked down" and is no


longer editable (the only way to unlock it is to
untick "widget complete")

4/22/2010

RJM

Pass

The widget response status is "Marked Complete" N

4/22/2010

RJM

Pass

The system performs validations as per Main


Flow steps 3, 4 and 5

4/22/2010

RJM

Pass

The system displays whether the widget is


marked complete (read-only e.g. Disabled
checkbox)

4/22/2010

RJM

Pass

The system validates that the user's org type is


not a "simplified interface" org type

4/22/2010

RJM

Pass

The system validates that the widget response is N


already marked "Complete"

4/22/2010

RJM

Pass

There is an option to mark the widget response


as "confirmed complete"

4/22/2010

RJM

Pass

The system "locks" the "complete" flag by


making it read-only

4/22/2010

RJM

Pass

The system persists the fact that the widget has


been confirmed complete and also captures the
date and time and the current user

4/22/2010

RJM

Pass

The system displays the date and time the


widget response was confirmed complete and
the user who marked it complete

4/22/2010

RJM

Pass

The widget response status is "Confirmed


Complete"

4/22/2010

RJM

Pass

There is an option to mark the widget response


as "confirmed complete" but it is disabled

4/22/2010

RJM

Pass

The system "unlocks" the "complete" flag by


making it editable

4/22/2010

RJM

Pass

The system displays the "complete" and


"confirmed" statuses (both will be ticked) but
they are read-only

4/22/2010

RJM

This story implements the same


functionality for v8+ widgets as already
exists for v7- widgets

Request to view a (v8+) widget, within


the context of an in-progress
assessment

Mark the widget response as complete

8
9

Request to save my changes

12
13

Return to the widget list page

Request to view a (v8+) widget, within


the context of an in-progress
assessment, as an XYZ ABC user

This story implements the same


functionality for v8+ widgets as already
exists for v7- widgets, but with some
"improvements"

Request to view a (v8+) widget, within


the context of an in-progress
assessment

14
15

Return to the widget list page

4a

The widget is not already marked


"complete"

9a

Mark the widget as *not* confirmed


complete

Request to view a (v8+) widget, within


the context of a "confirmed" assessment

2b

S127

S128

Odds and Ends

Unsubmit
Baseline/Performance
Update: Changed
Permissions

General User

XYZ ABC User

See a range of random


and unrelated point
improvements across the
site

Unsubmit baselines and


performance updates
whereas organisation
admins cannot

Main

Main

Closed

Logged in as ABC user and was still


able to mark the widget as exempt

Medium

Closed

Can you make it so that when I mark


complete, the caonfirmed checkbox
immediately becomes enabled rather
than me having to save it first? This is
not actually a valid real-life scenario
because it's supposed to be a different
user doing the "confirm" but I know
that some orgs have a single person
doing both and also it will speed up
testing quite a bit.

Low

Closed

Pass

Complete and confirmed flags not


displayed

Medium

Closed

Pass

Attainment level checkboxes not


Medium
displayed - should be displayed "greyed
out" (although Current Level is
displayed correctly)

Closed

Not really a fail, but the prototype was Low


wrong, sorry. Can you move the
Information Mappign Admin links below
"Improvement Plan Admin" please?

Closed

Sorry, I missed out an "8" between


Version and Beta

Closed

Need test data (org type with not


simplified interface and not 3 stage
reporting)

Request to view a (v8+) widget, within


the context of an in-progress
assessment, as an XYZ ABC user

The system performs validations as per Main


Flow steps 3, 4 and 5

4/22/2010

RJM

The system displays whether the widget is


marked confirmed (read-only e.g. Disabled
checkbox)

4/22/2010

RJM

The tooltip on the User ID field on the Home


Page refers to "User ID" not "login name"

The What's New section of the Home Page


displays just the top 4 news articles

The links on the Admin page are in the same


order as per the prototype

N/A

On the Org Admin org chooser screen, the note


Y
next to the Look For field says organisation code
not NACS code

The Cancel button on the Widget Details page


Y
has a tooltip "Cancel your changes and return to
the widget list"

N/A

N/A

Pass
Pass

CMC

DONE

Pass

3/17/2003 CMC

DONE

Pass

N/A

CMC

DONE

Pass

N/A

N/A

CMC

DONE

Pass

N/A

N/A

RJM

DONE

Pass

The Done button on the Widget Details page has N


a tooltip "Save your changes and return to the
widget list"

N/A

N/A

RJM

DONE

Pass

When logged in, the Previous and Next buttons


on the Widget Details page have tooltips "Save
any changes and go to the previous (next)
widget"

N/A

N/A

RJM

DONE

Pass

When not logged in, the Previous and Next


N
buttons on the Widget Details page have tooltips
"Go to the previous (next) widget"

N/A

N/A

RJM

DONE

Pass

10

The Save button on the Widget Details page has N


a tooltip "Save your changes and remain on this
page"

N/A

N/A

RJM

DONE

Pass

11

All "custom" (i.e. jquery) tooltips have a 15


N
second timeout to cater for the fact that in some
cases they don't disappear when the mouse
leaves the relevant hover zone

N/A

N/A

RJM

DONE

Pass

13
14

Section headers are black, not blue


Glossary text is green, not black (including
underline)

Y
Y

N/A
N/A

N/A
N/A

CMC
CMC

DONE
DONE

Pass
Pass

15

When you float over a hyperlink the underline


disappears rather than getting a blue
background

N/A

N/A

CMC

DONE

Pass

16

Home page alert says "<h2>PQRT Version Beta N


Test Phase 1</h2><p>Welcome to the PQRT
Version 8 Beta Test site. Thank you for agreeing
to take part in the beta testing. If you don't
already have one, you will need <a href="...">a
copy of the test script</a>. Happy testing!</p>"

N/A

N/A

CMC

PARTLY DONE: Need Test script URL


reference adding

Pass

17

Register Step 3 - wording matches wording on


prototype (including "contact our Helpdesk"
instead of "contact us")

N/A

N/A

CMC

DONE

Pass

19

Contact Us page - insert a space between


"Frequently Asked Questions" and "(FAQ)"

N/A

N/A

CMC

DONE

Pass

20

Contact Us page - add a third bullet after "the


Y
Online Help": "your local PQR App Administrator"
(see prototype - but don't put the "(who is this?)"
link, because we haven't done that yet!

N/A

N/A

CMC

This was already done, including the


Who Is This link. Maybe tested when
not logged in or logged in under XYZ
CfH which would explain why it wasn't
displayed ?
TH 08/04: fair point. Tested and raised
defect to right

Pass

The "who is this" floater isn't obviously Low


a floater - I propose the following CSS
(see prototype): span.floatable
{color:blue; border-bottom:dashed 1px
blue; cursor:pointer}

Closed

Pass

When I float over "Who is this", most of Medium


the header bar of the page suddenly
goes white, even after the pop-up has
disappeared

Closed

Pass

When I float over "Who is this", the


Low
tooltip is positioned OK but if I scroll the
page down a bit and try again, the
tooltip is positioned too high up the
page (IE6 and IE7)

Closed

3/18/2010

High

21

Widgets org type chooser - the list of org types is Y


supposed to have bullet points

N/A

N/A

CMC

DONE

Pass

22

Widget Details page - header bar data on RHS


needs to *not* have lots of padding to the right)

N/A

N/A

CMC

DONE

Pass

23

Widget Details page - Attainment Levels section - N


context help icons for attainment levels and
attainment criteria should only be displayed if
the tick boxes they refer to are displayed

N/A

N/A

RJM

DONE

Pass

24

Widget Details page (not logged in) - too much


white space below the evidence table - suspect
this is due to an invisible/not displayed "add
evidence" link.

N/A

N/A

RJM

DONE

Pass

25

If I expand 1a and then expand 1b then the


N
accordian facility works, but 1a does not collapse
slowly, it just disappears, meaning that section
1b opens but then suddenly jumps updards and I
lose track of where it is. Can this be made
smoother?

N/A

N/A

RJM

CANT BE DONE IN IE WORKS OK IN


Pass
FIREFOX AND CHROME. IE CANT
HANDLE THE SLIDE VERY WELL SO
THIS HAS TO BE SHOWN OR HIDDEN.
FIREFOX/CHROME HANDLE SLIDE
REALLY NICELY AS IS VERY ELEGANT. IE
IS CLUNKY.
TH 08/04 Let's see what the users say
about it in beta testing

26

Widget Details page - level 3 maintetnance


Y
criteria - include an extra sentence below the
criterion description as follows:"<br/><br/>[Only
required if Attainment Level 3 was achieved in
the previous assessment]"

N/A

N/A

CMC

DONE

Pass

29

Can you add a skeleton "About" page - title:


"About the PQR App" with content of "Content
TBC" and link to it from (a) the top links and (b)
the intro paragraph on the Home Page

N/A

N/A

CMC

DONE

Pass

Title is too small - use <h1>

Low

Closed

30

Likewise the "quick start" guide, linked in from


N
the home page (both not logged in and logged in
variants)

N/A

N/A

CMC

DONE

Pass

Title is too small - use <h1>

Low

Closed

31

Widgets list page - only display the "not met key Y


widget" cross if the user has actually answered
the question

N/A

N/A

CMC

DONE

Pass

34

Widget Details page: remove or hide "Date Last


Modified", which isn't working properly anyway
(it changes the date last modified for all criteria
at the same time, even if I only modify one of
them)

N/A

N/A

CMC

DONE: Note we should either treat this Pass


problem though as a DR or else
remove date modified entirely i.e. from
database model as well etc

35

a.test:acute, req't 102 - criteria 1b, 2b and 2c are N


being (incorrectly) displayed as if they were
Level 3 Maintenance criteria - this is probably a
test data issue

N/A

N/A

CMC

Low priority:DONE wouldn't have


affected UAT anyway

Data removed from database script. Needs


re-instating.

Request to save my changes

11

2a

High

Mark the widget response as confirmed


complete

8
9
10

If I set the target level as exempt and


then click "Next" I get a system error

[logged in as XYZ ABC]


View a 3-stage assessment for an
organisation which has been baselined
but not performance updated

Pass

RJM

1a

3
4
1

Submit
Baseline/Performance
Update Warnings

Organisation
Admin

Receive warnings when


submitting baselines and
performance updates

Main

S132

S133

Can't Delete User

Beta Test Phase 1 Defects

Odds and Ends 2

Organisation
Admin, XYZ ABC
User

General User

General User

Not delete a user who is


referenced from various
other data within the
system

Main

See various defects/issues Main


resolved that appeared in
Beta Test Phase 1

See a range of random


and unrelated point
improvements across the
site

Main

3/15/2010

nili

Pass

3/15/2010

nili

Pass

There is *not* an option to unsubmit the baseline N

3/15/2010

nili

Pass

There is *not* an option to unsubmit the


performance update

3/15/2010

nili

Pass

There is an option to submit a baseline [no


change]

Pass

3/15/2010

nili

3/15/2010

nili

The system presents the following warning:


N
"Once you have submitted your Baseline you will
not be able to unsubmit it without contacting
us", with options to proceed or cancel

3/15/2010

nili

The system submits the baseline as per current


functionality [no change]

3/15/2010

nili

Pass

The system does not submit the baseline

3/15/2010

nili

Pass

There is an option to submit a performance


update [no change]

3/15/2010

nili

Pass

The option is labelled "submit performance


update", not just "performance update"

3/15/2010

nili

Pass

The system presents the following warning:


"Once you have submitted your Performance
Update you will not be able to unsubmit it
without contacting us", with options to proceed
or cancel

3/15/2010

nili

The system submits the performance update as


per current functionality [no change]

3/15/2010

nili

Pass

The system does not submit the performance


update

3/15/2010

nili

Pass

nili

Pass
N/A

Request to submit a baseline

6
7

Request to proceed

1
2
1

Request to cancel

Pass

Should the message be clearer about


who they might need to contact? (ie
who is the 'us' in the message)?

Pass

View my 3-stage assessment which is


ready to be performance updated

Request to submit a performance update

S130

The system unsubmits the performance update

4
5

1b.6a

There is an option to unsubmit the performance


update

The option is labelled "submit baseline", not just N


"baseline"

1b

Pass

View my 3-stage assessment which is


ready to be baselined

6a

Pass

nili

[logged in as an org admin]


View my 3-stage assessment which has
been performance updated but not
submitted

S129

nili

3/15/2010

[logged in as an org admin]


View my 3-stage assessment which has
been baselined but not performance
updated

2
1c

3/15/2010

Request to unsubmit the performance


update

4
1b

The system unsubmits the baseline


[logged in as XYZ ABC]
View a 3-stage assessment for an
organisation which has been
performance updated but not submitted

2
3

There is an option to unsubmit the baseline


Request to unsubmit the baseline

6
7

Request to proceed

1
2

Request to cancel

Request to edit details for a user

Should the message be clearer about


who they might need to contact? (ie
who is the 'us' in the message)?

Pass

The system validates that the user is related to


(or referenced from) any of the following data
items:

3
4

Widget.Owner
AssessmentCriterion. ModifiedUserId

N/A
N/A

4/6/2010
4/6/2010

AssessmentCriterionEvidence.
CustomCreatedUserId

N/A

4/6/2010

N/A

Not tested due to lack of time and low


priority

AssessmentCriterionEvidence. ModifiedUserId

N/A

4/6/2010

N/A

Not tested due to lack of time and low


priority

AssessmentCriterionEvidenceUpload.
UploadedUserId

N/A

4/6/2010

N/A

Not tested due to lack of time and low


priority

AssessmentCriterionImprovementAction.
CreatedUserID

N/A

4/6/2010

N/A

Not tested due to lack of time and low


priority

AssessmentCriterionImprovementAction.
ModifiedUserID

N/A

4/6/2010

N/A

Not tested due to lack of time and low


priority

10

AssessmentHistory.OrganisationUserID

N/A

4/6/2010

N/A

Not tested due to lack of time and low


priority

11

AssessmentWidget.ExemptionGrantedBy

N/A

4/6/2010

N/A

Not tested due to lack of time and low


priority

12

AssessmentWidgetScore.OrganisationUserID

N/A

4/6/2010

N/A

Not tested due to lack of time and low


priority

13

BulkEmail. CreatedBy

N/A

4/6/2010

N/A

Not tested due to lack of time and low


priority

14

BulkEmail. UpdatedBy

N/A

4/6/2010

N/A

Not tested due to lack of time and low


priority

15

PQRAFOrganisationSubmitted.
SubmittedByUserId

N/A

4/6/2010

N/A

Not tested due to lack of time and low


priority

16

System does *not* provide the option to delete


the user

N/A

4/6/2010

N/A

Not tested due to lack of time and low


priority

Glossary terms are not matching e.g. Req 210


N/A
"information assets" - suspect it might be due to
differences in capitalisation

N/A

N/A

CMC

done

Pass

Evidence items truncated by commas e.g. req


210, 1b evidence.
Also, evidence for req 210 2b has two items
the second item text is actually part of the first
item text looks like a problem with comma
delimiters.
Also, speech marks around the evidence items

N/A

N/A

N/A

CMC

done

Pass

Evidence location has red cross even though


evidence not marked as obtained
Evidence Location does not have [select]
When I click Evidence Location pop-up arrow,
screen refreshes and no pop-up appears
Seems to work OK for custom evidence, so
maybe its a data problem (perhaps the publish
process?)

N/A

N/A

N/A

RIMA

done

Pass

When I click "Save" on the Widget Details page, I N/A


get "The page cannot be displayed"

N/A

N/A

RIMA

done

Pass

5
6

Widget PDFs not there


Need to link home page through to test script
when it's ready

N/A
N/A

N/A
N/A

N/A
N/A

CMC
CMC

done
done

Pass
Pass

Glossary PDF is out of date - suspect it has not


N/A
been correctly re-published (how can there even
be a PDF file in there if the glossary PDF publish
failed - is there a default PDF file in SourceSafe if so remove it because it hides the problem)

N/A

N/A

CMC

done

Pass

Defect fixes/enhancements to Home Page "At a


Glance" section as per S079

N/A

N/A

N/A

CMC

done

Pass

Knowledge Base section layout is wrong when


viewed in IE6 (tabs on left, content on right)

N/A

N/A

RIMA

done

Pass

10

Tooltips disappear off the RHS of the screen

N/A

N/A

N/A

CMC

done, also handles bottom of the [page Pass


as well a right hand side

11

Widget Details page: When you attempt to click


an attainment criterion tick box, the system
warns you that you need to enter evidence
details. Can you make it so that it also expands
the attainment criterion to make the evidence
visible?

4/26/2010

CMC

done

Pass

12

Widget Details page: When you attempt to click N


an attainment level tick box, can you make the
system warn you that you need to complete the
individual criteria (same text as for the context
help tooltip to the side - which is different for
each attainment level) Can you also make it so
that it expands the attainment level to make the
criteria visible (and because it is accordian style
you will need to collapse any other open
section)?

4/26/2010

CMC

done

Pass

13

Replace "TBCs" with real context help on the


Widget Details page (ref. context help file v2)

N/A

N/A

CMC

done

Pass

14

If I select an org type which has no widgets set


N
up, I get a server error. In the current live system
it just displays an empty list (e.g. For Dentists)

N/A

N/A

CMC

done

Pass

15

Tooltip for Current Level context help appears


behind Target Level drop down (IE6)

N/A

N/A

RIMA

done

Pass

16

Widget Details page - remove context help


criterionComments - no longer required

N/A

N/A

CMC

done

Pass

17

Assessment Summary page - in IE6, create or


N
delete an assessment - page content goes blank
and page header partially blanked out. Click
refresh and it's OK again

N/A

N/A

CMC

done

Pass

18

Widget Details page (when completing an


assessment) - NR option is displayed even
though NR isn't an option (it's OK on the readonly view)

N/A

N/A

CMC

done

Pass

19

When I float over a glossary definition,


N
sometimes I get: "Undefined - unable to get
definition from the server", and when I float over
it again a comple of seconds later I get the
correct definition. A timing issue perhaps? A
simple fix might be to change the message to
say "temporarily unavailable" or "loading, try
again in a few seconds"

N/A

N/A

CMC

done, I think. Found some issues with Pass


glossary terms which I think may have
ben causing the issue hard to be 100%
sure as problem only occurred
sporadically.

20

Evidence upload - this is not disabled but it


doesn't work properly. Needs disabling (as per
Duplicate Evidence)

N/A

N/A

RIMA

done

Pass

21

Created new acute org "acutest11" and user


"test"/"4testing", log in, create assessment then
nav to req 202. Attainment levels showing -1
instead of 1,2,3. Req 210 the same but Req 310
and 312 are OK

N/A

N/A

CMC

done

Pass

22

Req 312 - when I complete criteria 1a and 1b,


they are both ticked but AL1 is not ticked. Tried
Req 310 which is OK

N/A

N/A

CMC

done

Pass

23

Widget Details page, KB section - tab headers


should be Key Resources, Exemplar Materials,
Useful Websites, not Key Resources, Exemplar,
Exemplar Materials

N/A

N/A

CMC

done

Pass

24

When I navigate from one req't to another, the


attainment levels should always start out
collapsed (unlike the top-level sections, which
should be the same as the previous page).

N/A

N/A

CMC

done

Pass

25

Not logged in, navigate the req 210, observe 2x


material changes. Then click Next then Previous
and it says "no material changes"

N/A

N/A

CMC

done

Pass

A marked up glossary term which is a plural


N
matches against a glossary which is singular. For
example "Calditott Guardians" should match
"Caldicott Guardian" and "spies" should match
"spy"

CMC

done

Pass

Widget Details page (read only) - "Evidence


Required" as a bullet list (as per prototype)
instead of table

Context help to RHS of "Evidence Required:"


Y
when not logged in - to be same as per
"Evidence Required" column header when logged
in (see context help file v2 for details)

For better alignment of attainment levels,


Y
change the following CSS in igt.requireemnt.css:
"div.attainmentLevel div.attainmentLevelNumber
{float:left; width:41px; font-weight:bold; fontsize:1.5em; text-align:right; padding-right:4px;
line-height:80%}
"

10

On the Widgets List page, if the widget set is v7


or before, when I select a widget it should
display it using the "old style" Widget Details
page

4/6/2010

nili

4/26/2010

N/A

N/A

done

Pass

N/A

done

N/A

4/8/2010 N/A

done

Pass

done.

Pass

N/A

Not tested due to lack of time and low


priority

One defect remaining (recorded against


S079) but is cosmetic

Test using SUO

Superseded

S135

Organisation Type Names

General User

See better, shorter names Main


for organisation types

11

Home page - logged in as XYZABC user - At A


Glance - don't display "start working on your
assessment" for ABC users

N/A

N/A

Done

N/A

13

Org type a.test:gp - req't 101 and 102 are


N
showing attainment levels of NR and -1. Might be
a test data issue, if so can you add suitable test
data (need to be able to test XYZs)

N/A

N/A

Done

Pass

16

The email address validator should allow


N
apostrophes (well, at least fay o'sullivan thinks
so). This applies to all screens which accept
email address input (I am hoping we use a single
validator in all cases)

N/A

N/A

Done. Problem was new areas of code Pass


i.e. Registration rewrite and Contact Us
didn't use existing email validation

17

A widget should only have a status of


N
"Answered" (aka "In Progress") if it actually has
an answer i.e. An attainment level, NR or EX. If
the user subsequently edits the widget response
such that there is no answer (e.g. Unticks "NR")
then the status should revert back to "Not
Answered" (aka "Not Started")

N/A

N/A

Done

Pass

18

On the Widget Details page, for the non


N
simplified interface, if all other conditions are
met, the Mark Complete and Confirm Complete
options should be available if the widget
response is "NR" or "EX" (not just if an
attainment level has been obtained). This should
be synonymous with a widget status of
"Answered".

N/A

N/A

Done

Pass

19

On the Assessment Summary page, for the


N
purposes of determining whether the various
Submit options (baseline, performance update
and final) should be available, a widget response
of "EX" should be considered as a valid answer to
a widget. Put another way, if all other conditions
for submittion are met, a widget response of
"EX" should not block the submission.

N/A

N/A

Done

Pass

20

Currently if you mark a widget as exempt if its a N


key widget when you go back to the widgets list
screen it shows the word Exempt but also shows
a red cross to indicate you havent met the
minimum level. This is wrong, no cross should
be displayed as per for widgets marked Not
Relevant.

N/A

N/A

Done

Pass

Request to view the Widgets Org


Chooser page

The org type names are as per "PQRT v8


Organisation Type Names v1.docx"

2/11/2010

nili

Pass

Org type names have not changed possibly due to migration script not
having run

The org type names in the Organisation Type


drop-down are as per "PQRT v8 Organisation
Type Names v1.docx"

2/11/2010

nili

Pass

As above

Note: the org type names appear elsewhere in


the system too but it is assumed that they are
always populated from the same source (in the
database) so this story does not explicitly check
each appearance

2/11/2010

nili

N/A

The system sends me an approval email (no


change)

4/22/2010

nili

Pass

The email includes the following amended


paragraph:
"Note that the PQR App assessment must be
completed annually whilst an organisation
continues to use XYZ Connecting For Health
systems and services such as N3. Each new
version of the PQR App assessment is usually
made available by 30th June and must be
submitted by 31st March in the following year."

4/22/2010

nili

Pass

There is an option to view another organisation's Y


Assessment Report

4/22/2010

CMC

Pass

The supplementary text is as per the prototype

4/22/2010

CMC

Pass

The system displays the Assessment Report Org


Chooser page

4/22/2010

CMC

Pass

The "Search" button is the default button i.e. It


fires if I hit Enter

CMC

Pass

The system displays the Assessment Report


Criteria page

4/22/2010

CMC

Pass

The system displays the organisation name

4/22/2010

CMC

Pass

10

There is an option to select an assessment to


Y
report on, including all *approved* assessments
in reverse date order - default latest assessment
(no change)

4/22/2010

CMC

Pass

11

The format of the assessment in the list is:


Y
Version <version number> (<start year>-<end
year>)"

4/22/2010

CMC

Pass

12

There is an option to compare with previous


Y
assessments, with a sub-option to select which
assessment to go back to (list of all assessments
except the most recent one, default is the lastbut one assessment)

4/29/2010

CMC

Pass

13

There is *not* an option to select the report


Y
breakdown (this is specified in a separate story S143)

4/22/2010

CMC

Pass

14

There is *not* an option to order the results


(initiatives are to be displayed in a fixed order 100s, 200s etc.)

4/22/2010

CMC

Pass

The system opens the report as an MS Excel


document (XLS format i.e. compatible with XL
97-2003)

4/22/2010

CMC

S141

S142

PQRT Release Cycle Info in Organisation


Approval Email Text
Admin

View Improved
Assessment Report

General User

Receive a message about Main


the PQRT release cycle as
part of the approval email

View an organisation's
Assessment Report with
various enhancements

Main

15
16
17

View Improved
Assessment Report (Own
Org)

General User

View an organisation's
Assessment Report with
various enhancements

Main

Single quotes around 'Show Report'


please

Low

Closed

Pass

System error - Aspose licence not


installed

High

Closed

Pass

If I create a report XLS but don't close


Medium
it, then try to create another report, the
system brings the first report into focus
rather than opening a new report probably due to same filename. Maybe
we could add the current time to the
filename or some other unique suffix?

Search for and select an organisation

Select report criteria


Request report

The report includes the organisation name

4/22/2010

CMC

Pass

The report includes the assessment version, start Y


year and end year.

4/22/2010

CMC

Pass

The report includes the date it was prepared on

4/22/2010

CMC

Pass

21

The report contains a table with a row of data for Y


the selected assessment

4/22/2010

CMC

Pass

22

If the user selected "compare with previous


assessments", the table contains a row of data
for the all assessments in the selected range

4/22/2010

CMC

Pass

23
24

The assessments are in reverse date order


For each assessment, the following data is
displayed:

6/24/2010

CMC

Pass

25

- Assessment version number, start date and end Y


date. Format: "Version 8 (2010-2011)", and in the
HTML version, use a non-breaking hyphen
(&#8209;) to ensure the best layout

4/22/2010

CMC

Pass

26

- Overall Score (expressed as a percentage)

4/22/2010

CMC

Pass

27

The percentage scores take into account where a N/A


widget has been assessed as EX (i.e. Excluded
from score as per NR)

4/26/2010

CMC

Pass

28
29

- Grade, as follows:
- For a v7- assessment, this is the RAG status
calculated from the Overall Score (no change)

Y
Y

4/22/2010
4/22/2010

CMC
CMC

Pass

30

- For a v8+ assessment, this is "Satisfactory" or Y


"Not Satisfactory", as per Assessment Summary
page

4/22/2010

CMC

Pass

31

For a v7- assessment, the background colour of


the Grade matches the RAG status (no change,
but currently not working in sys test)

4/22/2010

CMC

Pass

32

For a v8+ assessment, the Grade is colour coded Y


- green for Satisfactory or Red for Not
Satisfactory

4/22/2010

CMC

Pass

34

There is a key to explain the Assessment Grade


(see prototype)

4/22/2010

CMC

Pass

35

The key includes v7 details if there are any v7 or Y


before assessments in the report

6/24/2010

CMC

Pass

36

The key includes v8 details if there are any v8 or Y


after assessments in the report

6/24/2010

CMC

Pass

Request to view reports

There is an option to view my own organisation's Y


Assessment Report

4/22/2010

CMC

Pass

The system displays the Assessment Report


Criteria page

4/22/2010

CMC

Pass

5
6

Proceed as per S142 except:


- the list of available assessments includes any
non-approved assessment as well as all
approved ones

4/22/2010
4/22/2010

CMC
CMC

Pass
Pass

- if the report includes a not-yet submitted


assessment, the report includes a "Stage
Column" which says "Final" for submitted
assessments and "Current" for non-submitted
assessments (see prototype example 2)

4/22/2010

CMC

Pass

For each assessment (in progress or approved)


there is an option to view a summary report

4/26/2010

CMC

Pass

The system displays the Assessment Report


Criteria page

4/26/2010

CMC

Pass

Proceed as per S142 except that the default


Y
assessment is the selected assessment from the
Assessment Summary page

4/26/2010

CMC

Pass

There is an option to view another organisation's N


Assessment Report (no change)

4/22/2010

CMC

Pass

Request to view an Assessment Report


on my own organisation

Request to view my Assessment


Summary

Request to view a summary report for a


given assessment

Request to view reports as an XYZ ABC


user

Request to view an Assessment Report

Proceed as per S142 except:


- Allow in-progress assessments as per Main Flow N
above

Pass

CMC

Pass

Proceed as per S142 except allow in-progress


assessments as per Main Flow above if the
selected organisation is a trust within my EFG
area (same business rule as for PPR report)

4/22/2010

CMC

Pass

There is an option to view another organisation's N


Assessment Report (no change)

4/22/2010

CMC

Pass

Request to view reports as an GHJ user

CMC

4/22/2010

Request to view an Assessment Report

4/22/2010

There is an option to view another organisation's N


Assessment Report (no change)

Request to view reports as an EFG user

1d

N/A

20

1c

Closed

Request to view an Assessment Report

1b

I've updated the prototype - can you


Low
get the new heading/preamble wording
from there please

nili: re-formatted text

Request to view reports

1a

Text OK but formatting bad. Needs


blank lines here & there and also there
are newlines where there shouldn't be
e.g. Between "31st" and "March"

Closed

19

Closed

Low

18

Closed

Have an XYZ ABC user approve my


submitted assessment

3
4

Medium

Request to view an Assessment Report

S143

Superseded

Request to view an Assessment Report

Closed

CMC:Was fixed as part of new approach


taken to get over other issues with the
Excel report opening

S144

View Improved
Assessment Report Breakdown by Attainment
Level

General User

View an organisation's
Main
Assessment Report broken
down by attainment level

Select report criteria, including option to


show breakdown by attainment criteria

4
5

Organisation User View an organisation's


Assessment Report
including baseline,
performance update and
target scores

Main

Request report

View Improved
Assessment Report Breakdown by Initiative

General User

View an organisation's
Main
Assessment Report broken
down by initiative

View Improved
General User
Assessment Report Breakdown by Key Widget
Status

View an organisation's
Main
Assessment Report broken
down by key widget status

Create an HTML version of Main


the assessment report

4/22/2010

CMC

Pass

4/22/2010

CMC

Pass

- no. of reqts at level 0, 1, 2 and 3 (four separate Y


columns)

4/22/2010

CMC

Pass

- no. of reqts marked Not Relevant (column only


shown if any non-zero values in it)

4/22/2010

CMC

Pass

- no. of reqts marked Exempt (column only


shown if any non-zero values in it)

4/22/2010

CMC

Pass

- total no. of reqts

4/22/2010

CMC

Pass

There is an option to show Baseline and


Performance Update scores

4/22/2010

CMC

CMC:The role for this story is


Pass
organisation user but have made this
option avaialable to XYZ CfH and also
any parent organisation e.g. EFGs
viewing a Trust as this information is
available anyway from other reports so
for consistency feels like should be
accessible by these types of users here
as well

There is an option to show target scores

4/22/2010

CMC

CMC:Have made this option available


for XYZ CfH users as well just so that
support staff can view the report if
necessary

Pass

Make available for EFG and GHJ too

Medium

Closed

There is an option to show the date for each


reporting stage

4/22/2010

CMC

CMC:Permissions for this as for Step 2. Pass


Have also made this option only
selectable if the Baseline and
Performance Update scores are
selected as otherwise doesn't seem to
make sense, paticularly as we dont
display a stage column in all the
assessments are at the submitted
stage (see step 7 for S143 above)

Make available for EFG and GHJ too

Medium

Withdrawn CMC: It is available to parent EFG/GHJs not


sure why this has been raised
TH 12/7 - sorry, my mistake - withdrawn

- If I selected to show Baseline and Performance Y


Update scores, the report includes an extra row
of data for each Baseline or Performance Update
that has been "captured" for the displayed
assessments (this can be derived based on the
assessment status and whether the assessment
is subject to 3-stage reporting)

4/22/2010

CMC

Pass

- The data shown for the Baseline and PU stages N/A


is the data as it was at the date and time when
the Baseline or PU was performed (not as of the
official Baseline or PU date, which might be
different)

4/22/2010

CMC

Pass

10

If I selected to show target scores, the report


Y
includes an extra row for each assessment
showing target scores (but only if there is one or
more target score for the assessment)

4/22/2010

CMC

CMC:Although we expect either all or


Pass
no target scores to be set for an
assessment the application doesn't
enforce this so have to allow for only
partial targets set. Therefore if not all
targets set it includes the Not Yet
Answered column count for those
widgets not given a target. If we have
this for partially targeted assessments
do we not also want to display this
column if no targets set, it seems more
consistent that way.

11

If I selected to show the date for each reporting Y


stage, the report includes a column showing this
data for Baseline, Performance Update and
Current/Final data sets (note this is the official
stage date, not the date that the organisation
actually completed the stage)

4/22/2010

CMC

Pass

There is an option to show a breakdown by


initiative

4/22/2010

Alignment of text "Iniiative" - extra


space on LHS

Low

Closed

- the whole table of data in the report is repeated Y


once per initiative

4/22/2010

CMC

Pass

- the initiative name is shown as the overall


header for the table

4/22/2010

CMC

Pass

- the initiatives are displayed in the following


order:
- Information Governance Management
- Confidentiality and Data Protection Assurance
- Information Security Assurance
- Clinical Information Assurance
- Secondary Use Assurance
- Corporate Information Assurance

4/22/2010

CMC

Pass

Appear to be alphabetically ordered (in Low


sys test) - this is probably due to the
test data not having the correct order
plumbed in, cos it seems OK for v8 data

Closed

- the overall totals (i.e. Across all initiatives) are


shown last, with a heading of "Overall"

In order for the report to look tidy, if


Low
any of the initiatives include a "Not Yet
Answered", "NR" or "EX" column, then
you should include these columns in all
tables so it all lines up nicely and so the
Grade column is always in the same
place (otherwise it's not always wide
enough)

Closed

Closed

This story extends S142 - branch from


S142 after step 15

Select report criteria


Request report
The report includes the following additional data
(see prototype example 3):

This story extends S142 - branch from


S142 after step 15

Select report criteria, including the


option to show a breakdown by initiative

4
5

Request report

Pass

The report includes the following additional data


(see prototype example 4):

4/22/2010

CMC

Pass

- the set of initiatives used is the superset of all N


initiatives across all assessments included in the
report

4/22/2010

CMC

Pass

- a given assessment is only included under a


N
given initiative if it includes one or more widgets
from the initiative

4/22/2010

CMC

Pass

- the data within each initaitve table is


(obviously) based only on widgets belonging to
that initiative

4/22/2010

CMC

Pass

There is an option to show a breakdown by key


widget status

4/26/2010

CMC

Select report criteria, including option to


show breakdown by key widget status

4
5

Request report

CMC:Note wasn't sure if Key Widgets


applied to target scores as prototype
didn't make this clear have assumed
they do. Have also assumed a key
widget will never be marked Not
Relevant or Exempt and thus if one
were to me marked as such it would
currently appear as Not Met.

Pass

The report includes the following additional


columns (see prototype example 5):

- no. of key widgets not yet answered (only


shown if it contains any non-zero values)

4/26/2010

CMC

Pass

- no. of key widgets not achieved "pass"


attainment level (generally level 2)

4/26/2010

CMC

Pass

- no. of key widgets achieved "pass" attainment


level (generally level 2)

4/26/2010

CMC

Pass

NR or EX should be treated as Key


Widget Met

Fail

In order for the report to look tidy, if


Low
any of the initiatives include a "Key
Req'ts Not Yet Answered" column, then
you should include this columns in all
tables so it all lines up nicely and so the
Grade column is always in the same
place (otherwise it's not always wide
enough)

Raised

Medium

- total no. of key widgets

4/26/2010

CMC

Pass

The system displays the report in HTML format


on the same page, below the report criteria

4/26/2010

CMC

Pass

The content and layout of the HTML format


Y
report are as per the XL report (ref. stories S142S146, S152 and also see the prototype)

4/26/2010

CMC

Pass

Include <h2> tage Report Results as


per prototype

Low

Closed

Pass

Remove date prepared - I know


someone might print out the report so
the date might be useful but it just
looks a bit weird on an online report
with the criteria at the top

Low

Closed

Pass

Table format - change all table styles


from "listing" to "simple"

Low

Closed

Pass

Button to create XL: change label to


"Export Report (MS Excel) - with a
tooltip "Click to export the report to
Microsoft Excel (XLS format)"

Low

Closed

Pass

Use classes "RAGRed", "RAGAmber"


and "RAGGreen" for the RAG/grade
colours (see prototype)

Low

Closed

Pass

Don't put the report within a scrollable


frame (the prototype seems OK re. the
table going off the RHS of the page)

Low

Closed

Pass

Put an <hr> before "Report Results" (as Low


per prototype)

Closed

Pass

You have a empty <tr> at the end of


Low
the report table which is showing up as
an extra horizontal black line

Closed

Pass

You are not using the "odd" and "even" Low


classes to set the background colours
for alternate rows in the table - instead
you have a black border separator. Note
that all rows for a gve version should be
the same bg colour (see. Prototype
example 3]

Closed

This story extends S142 by first


displaying an HTML version of the report
and then allowing the user to create an
XL version if they wish

Branch from S142 Main Flow at step 16


(request report)

Pass

You have black borders hard-coded in


as HTML styles - remove them

Low

Closed

There is a context help to explain the


Assessment Grade (HTML version only)

4/22/2010

CMC

Pass

Context help link not there

Low

Closed

There is an option to drill down on each *current* Y


or *final* score (by initiative or overall)

4/26/2010

CMC

Pass

4/26/2010

CMC

Pass

Tested target but not stages

CMC

Pass

When clicked "back to Assessment


High
Report" got a system error (specifically
if no previous assessment to report on)

7
8
9

Was a data issue but only for the test i.e.


Acute:Test and Gp:Test org types was
missing the ordering in the test data script

This story extends S142 - branch from


S142 after step 15

9
View Improved
General User
Assessment Report - HTML
Version

There is an option to show a breakdown by


attainment level

- no of reqts not yet answered (column only


shown if there are any non-zero values in it)

S147

Pass

The report includes the following additional


columns (see prototype example 3):

S152

CMC

5
6
7

S146

4/22/2010

10
View Improved
Assessment Report Stages and Targets

This story extends S142 - branch from


S142 after step 15

S145

Proceed as per S142 except allow in-progress


assessments as per Main Flow above if the
selected organisation is a XYZ, thingy or Prison
Health Unit within my EFG area (same business
rule as for PPR report)

There is *not* an option to drill down on stage or Y


target scores
Request to drill down on one of the
scores
The system displays the Widgets List page for
the selected assessment (no change)

N/A

Closed

Content is being cut off at the RHS due to


overflow:hidden in IE6.css

7a

10

If I selected a drill down on a given initiative, the N


system only displays the results for that initiative
(no change)

CMC

Pass

11

The system does not display the widget status


N
(currently displays it for "overall results"
drilldown but not for a single initiative drilldown)

4/26/2010

CMC

Pass

12

The system does not display widget owners

4/26/2010

CMC

Pass

The widget status *is* displayed


Y
The widget owners *are* shown (but only if there Y
actually are any widget owners)

4/26/2010
4/26/2010

CMC
CMC

Pass
Pass

The widget status *is* displayed


Y
The widget owners *are* shown (but only if there Y
actually are any widget owners)

4/26/2010
4/26/2010

CMC
CMC

Pass
Pass

If the report include a breakdown by attainment


level, there is an option to drill down on
individual attainment level counts (for current,
final and target scores)

4/29/2010

If the report include a breakdown by key widget


status, there is an option to drill down on
individual attainment level counts (for current,
final and target scores)

4/29/2010

The system displays the Widgets List page for


the selected assessment

4/29/2010

The list includes the subset of widgets that were N


included in the selected widget count. For
example, if the user clicked on Target/Level 3,
the system displays just those widgets with a
target of level 3.

4/29/2010

The system displays the Individual PPR page (no N


change)

4/22/2010

nili

Pass

For each widget, there is a "Details" link (instead N


of the "Guidance" link for v7- widgets (if it's
easier, you can change the v7- link to "Details"
too))

4/22/2010

nili

Pass

It says "Guidance" for v8+ and


Low
"Details" for v7-...the wrong way round!

Closed

The system displays the widget PDF document


for the selected assessment version, org type
and widget number.

4/22/2010

nili

Pass

URL is
High
"https://www.igt.connectingforhealth.nh
s.uk/PQRTTest/UserControls/" with no
document name

Closed

The system displays the Individual PPR page

4/22/2010

nili

Pass

For each widget, there is a "Guidance" or


"Details" link

4/22/2010

nili

Pass

The system displays the widget guidance (MS


Word) document for the selected assessment
version, org type and widget number.

4/22/2010

nili

Pass

URL is
High
"https://www.igt.connectingforhealth.nh
s.uk/PQRTTest/WidgetDocuments/"
whereas in live it is something like
"https://www.igt.connectingforhealth.nh
s.uk/Guidance/PQRM_Acute_101_V7%2
009-03-24.doc"

Closed

The table is displayed and the formatting is as


per the RATty preview

4/26/2010

Pass

Bullet lists in tables (e.g. Reqt 101 in


UAT):
- less white space before, after and
between each para
- indent the bullets a bit

Closed

The table is displayed and the formatting is as


per the RATty preview

4/26/2010

Pass

The main heading is displayed and the


formatting is as per the RATty preview

4/26/2010

Pass

The main heading is displayed and the


formatting is as per the RATty preview

4/26/2010

Pass

The hyperlink is displayed and the formatting is


as per the RATty preview

4/29/2010

Pass

The hyperlink is displayed and the formatting is


as per the RATty preview

4/29/2010

Pass

The total score calculation takes into account any N


exemptions that the widget has been granted on
individual widgets (they are treated the same as
"not relevant"

4/26/2010

nili

Pass

The total score calculation takes into account any N


exemptions that the widget has been granted on
individual widgets (they are treated the same as
"not relevant"

4/26/2010

nili

Pass

The total score calculation takes into account any N


exemptions that the widget has been granted on
individual widgets (they are treated the same as
"not relevant"

4/26/2010

nili

Pass

There is not an option to submit my assessment

4/26/2010

nili

Pass

There *is* an option to submit my assessment

4/26/2010

nili

Pass

The system submits my assessment as per


current

4/26/2010

nili

Pass

The widget is "locked out" - all the fields are


disabled read-only

4/26/2010

nili

Pass

The system unsubmits my assessment as per


current

4/26/2010

nili

Pass

The widget is no longer "locked out" - all the


fields are disabled read-only

4/26/2010

nili

Pass

The system updates the status of the widget


response to "In Progress"

N/A

Pass

The widget status is shown as "In Progress"

N/A

Pass

The Attainment Level is shown as "Exempt"

N/A

Pass

12

The widget status is shown as "In Progress"

N/A

Pass

13

The Attainment Level is shown as "Exempt"

N/A

Pass

There is an option to submit a Baseline

N/A

Pass

Request to drill down on one of the


scores for my own organisation

2
3
7b

Request to drill down on one of the


scores as an XYZABC user

2
3

S162

View Improved
Assessment Report - Drill
Down on Breakdown

General User

Drill down into the details


of an assessment report
for specific breakdown
figures (e.g. Key widgets
met/not met)

Main

S150

View Widget from


Performance Progress
Report

Organisation User View the correct


Main
"guidance" document from
the Performance Progress
Report for a v8+
assessment

Branch from S147 Main Flow after step 6

Request to drill down on an individual


widget count

Request to view an (individual) PPR for a


specific organisation and v8+
assessment (either directly from reports
or via a multiple org PPR)

Select the "Details" link for a specific


widget

1a

Request to view an (individual) PPR for a


specific organisation and v7+
assessment (either directly from reports
or via a multiple org PPR)

2
3
4

Select the "Details" link for a specific


widget

S153

View Widget Containing


Table

General User

View a (v8+) widget with a Main


table within the guidance
text

Add a table into a (v8+) widget using


RATty using the RATML <table> format
(as specified in LDM v5)

Preview the widget in RATty in both


HTML and PDF format

3
4

Publish the widget to PQRT


View the widget in PQRT in HTML format

View Widget Containing


Main Heading

General User

View a (v8+) widget with a Main


main heading within the
guidance text

Add a main heading into a (v8+) widget


using RATty using the RATML <mh>
format (as specified in LDM v5)

Preview the widget in RATty in both


HTML and PDF format

3
4

Publish the widget to PQRT


View the widget in PQRT in HTML format

5
6

View the widget in PQRT in PDF format

S157

View Widget Containing


Hyperlink

General User

View a (v8+) widget with a Main


hyperlink within any
RATML field

Add a hyperlink into a (v8+) widget


using RATty using the RATML <a>
format (as specified in LDM v5)

Preview the widget in RATty in both


HTML and PDF format

3
4

Publish the widget to PQRT


View the widget in PQRT in HTML format

5
6

View the widget in PQRT in PDF format

S155

Incorporate Exemptions
into Report Scores

General User

Have the system take


Main
exemptions into account
when calculating overall %
scores

Request to view a Performance Progress


Report (Multiple)

3
4

Request to export to CSV

Request to view a Performance Progress


Report (Individual)

S156

Submit Assessment
(Simplified Interface)

Org User

Submit my (v8+)
assessment once I have
entered a score for each
widget

Main

I have an assessment where I have not


got an "answer" for all widgets (an
"answer" is an attainment level, NR or
EX)

Request to view the assessment


summary page

3
4

Complete my assessment such that I


have an "answer" for all requierements

Request to view the assessment


summary page

6
7
8

Request to submit my assessment

10

View a specific widget within the


assessment

11
12

As an XYZ ABC user, request to


unsubmit the assessment

13
14

View a specific widget within the


assessment

15

S158

View Exemption in Widgets Org User


List

View the fact that I have


been exempt from a
widget in the widgets list

Main

Log in as XYZ ABC

Locate a (v8+) assessment for any


organisation

Browse to a specific widget for which


"not relevant" is *not* an option

4
5
6

Mark the widget as exempt


Save my changes

7
8

Return to the Widgets List page

9
10

Log in as an org user for the amended


organisation

11

Go to the Widgets List page for the same


assessment

14
15

Answer all other widgets at level 0


Go to the assessment summary page

16
S159

View Assessment as an
XYZ ABC User

XYZ ABC User

View an organisation's
assessment details as an
XYZ ABC user, with the
relevant fields visible but
read-only

Main

Low

View the widget in PQRT in PDF format

S154

N/A

Request to view a (v8+) assessment for


a specific organisation (one which has
widgets owners set up)

Request to view the details of a specific


widget

The attainment level tickboxes are visible and


N
correctly set, but disabled (greyed out to make it
clear that this data is read-only to a ABC user)

4/29/2010

Pass

This includes the NR tickbox where appropriate

4/29/2010

Pass

The attainment criteria tickboxes are visible and


correctly set, but disabled

4/29/2010

Pass

Attainment criterion comments are displayed


read-only

4/29/2010

Pass

The total % score is also excluding "not High


answered" widgets from the calc
instead of treating them as Attainment
Level 0 - the correct formula is being
used on the Assessment Summary
page so it might be worth trying to
hook into the same code

Closed

Need an example in test data.

S160

View Assessment as a
General User

General User

View an organisation's
assessment details as a
General user, with the
relevant fields visible but
read-only

Main

The evidence details are visible but read-only


(including location and comments pop-ups)

4/29/2010

Pass

There is *not* an option to add new evidence

4/29/2010

Pass

The action details are visible but read-only


(including location and comments pop-ups)

4/29/2010

Pass

10

There is *not* an option to add an improvement


action

4/29/2010

Pass

The attainment level tickboxes are visible and


N
correctly set, but disabled (greyed out to make it
clear that this data is read-only to a general
user)

4/29/2010

Request to view a (v8+) assessment for


a specific organisation (one which has
widgets owners set up)

Request to view the details of a specific


widget

S165

View Assessment as a
General User (Mark 2)

General User

View an organisation's
assessment details as a
General user, with the
relevant fields visible but
read-only

Main

Closed

See defect above

Low

Closed

Fail

NR tickbox shown but level 0-3


tickboxes not shown

Low

Raised

Pass

Version 8 assessment (approved), org


a.test:acute - got system error

High

Closed

This includes the NR and EX tickboxes where


appropriate

The attainment criteria tickboxes are visible and


correctly set, but disabled

N/A

N/A

Superseded by S165

None of the detail below each attainment


criterion is displayed (and there is no expander
because there is nothing to expand) - NOTE: if
this is tricky to code we could look at simpler
alternatives e.g. Display evidence list and
evidence obtained but nothing else

N/A

N/A

Superseded by S165

The past level is not shown (including the label)

4/29/2010

Pass

The target level and date are not shown


(including the labels)

4/29/2010

Pass

The widget complete and confirmed fields are


not shown (including the labels)

4/29/2010

Pass

None of the detail below each attainment level is N


displayed (and there is no expander because
there is nothing to expand) - NOTE: if this is
tricky to code we could look at simpler
alternatives e.g. Display evidence list and
evidence obtained but nothing else

4/29/2010

RJM

Fail

Attainment criteria are shown - there


should be no expanders against the
attainment levels

Low

Raised

This includes EX - a general user should not be


able to view the reason for exemption

4/29/2010

RJM

Fail

The data is not shown but the expander Low


is there - remove it if the user is not
entitled to see the details

Raised

The system asks me to confirm that it is OK to


lose my changes

4/29/2010

Pass

The system displays the Widgets List page


(without persisting my changes)

4/29/2010

Pass

The system remains on the Widget Details page

4/29/2010

Pass

My amendments remain in place

4/29/2010

Pass

Rejoin main flow at step 4

4/29/2010

Pass

Rejoin main flow at step 4

4/29/2010

Pass

The system displays the "Forgotten User Details" Y


page

5/6/2010

nili

Pass

There is an option to receive a reminder of my


user details by email, including an input field for
my email address and a sub-option to have my
password reset.

5/6/2010

nili

Pass

The system validates that there is a uniquely


matching active account for the specified email
address

5/6/2010

nili

Pass

If I type my email address and hit


Medium
"Enter", it doesn't fire the "Remind Me"
button (the page refreshes but nothing
else)

Closed

The system sends me a reminder email


containing my org code and user ID (see
prototype for wording)

5/6/2010

nili

Pass

Can you put in some blank lines to


Low
make the email easier to read e.g. After
"Dear PQR App user"

Closed

The email is from the standard "DONOTREPLY"


PQRT email address

The system validates that I requested a


password reset

5/6/2010

nili

Pass

9
10

The system resets my password


The system sends me an email containing my
new password (see prototype for wording)

Y
Y

5/6/2010
5/6/2010

nili
nili

Pass
Pass

Can you put in some blank lines to


Low
make the email easier to read e.g. After
"Dear PQR App user"

Closed

11

The email is from the standard "DONOTREPLY"


PQRT email address

12

The system tells me that it has sent me a


reminder email

5/6/2010

nili

Pass

13

If I requested a password reset, the system tells


me it has reset my password and sent it in a
separate email

5/6/2010

nili

Pass

14

The system tells me how to log on (including a


link to the home page)

5/6/2010

nili

Pass

The system tells me this and provides a link to


the "contact us" page

5/6/2010

nili

Pass

Can you top justify the error test with


Low
the error icon (use <div
class="infoMessage"> which sorts it for
free and also gives you the icon

Closed

The system tells me this and provides a link to


the "contact us" page

5/6/2010

nili

Pass

Can you top justify the error test with


Low
the error icon (use <div
class="infoMessage"> which sorts it for
free and also gives you the icon

Closed

Skip to Main Flow step 12

5/6/2010

nili

Pass

The top-level sections are initiailly collapsed

5/6/2010

RJM

done

Pass

WITHDRAWN: When I move to a new widget the N


top levels are also initially collapsed (the system
does not remember how I left them)

The Attainment Levels section is after the


Guidance section

5/6/2010

RJM

done

Pass

The tables within the KB section do not have a


Y
table heading which repeats the name on the tab
(e.g. "Key Resources")

5/6/2010

RJM

done

Pass

The tables within the KB section do not have


rounded corners (see prototype)

5/6/2010

RJM

done

Pass

If there are no widget changes to display, the


system displays the text: "There are no material
changes since the last major version of this
widget." instead of just "There are no material
changes."

5/6/2010

RJM

done

Pass

The attainment levels expand and collapse


normally rather than in "accordion" style

5/6/2010

RJM

done

Pass

The attainment criteria expand and collapse


normally rather than in "accordion" style

5/6/2010

RJM

done

Pass

10

The attainment criterion ID for Level 3


Maintenance criteria is displayed instead of the
word "Maint"

5/6/2010

RJM

TH: RJM says no change required

Pass

11

For Level 3 maintenance criteria, the phrase


"[Only required if Attainment Level 3 was
achieved in the previous assessment]" appears
above the criterion description instead of below

5/6/2010

RJM

done

Pass

12

The width of the attainment criterion ID div has


narrowed (because its contents have narrowed,
since e.g. "1a" is now just "a" and "Main" is now
just e.g. "c")
Specifically, style "attainmentCriterionNumber"
is 53px wide instead of 56 and
"attainmentCriterionDescription" is 586px wide
instead of 583px

5/6/2010

RJM

done

Pass

13

There is a sentence below the Attainment Levels Y


heading indicating that the attainment levels are
cumulative

5/6/2010

RJM

done

Pass

14

There is a sentence within each attainment level Y


(1-3) indicating that all criteria must be satisfied

5/6/2010

RJM

done

Pass

15

If evidence provision is mandatory for the current Y


org type, the evidence heading reads "The
following evidence must <strong>all</strong>
be obtained:" (currently "<strong>Evidence
Required:</strong>)

5/6/2010

RJM

done

Pass

When not logged in, the system


Medium
displays a blank line followed by bullets

Closed

Pass

The bullets are too far indented relative Low


to the new pre-bullet staement. On the
prototype I have the bluuets less
indented but an alternative would be to
indent the pre-bullet statement if you
think it looks better that way

Closed

Pass

When not logged in, Can't get through


to the widget details page as there is
no link from the widgets list page! (the
"Action" column has disappeared!

Closed

Text showing is "The following evidence Medium


must all be obtained"

4/29/2010

There is a pencil icon agains the


Low
comments column - I can't edit the
comments but the icon shouldn't be
there. Likewise action owner and there
is also a calendar icon for the action
date
TH 16/6 as discussed, change back to a
pencil icon but hide the pencil if the
comments field is shorter than 30 chars

Pass

This story is an amendment to S160

2 Request to view a (v8+) assessment for


a specific organisation (one which has
widgets owners set up)
3

S161

Receive Dirty Flag Warning Org User


for Widget

Receive a warning if I
attempt to leave the
Widget Details page
without saving my
changes

Main

5a

Request to view the details of a specific


widget

View a specific (v8+) widget within the


context of an in-progress assessment

2
3
4

Amend any data on the page


Request to Cancel my edits

5
6

Confirm

1
2

Cancel the cancel (!)

3a

3
1

3b

2
1

Navigate to any other page by clicking a


link on the page (e.g. Contact Us)

Navigate to any other page by explicitly


typing a URL

2
S103

Look & Feel - Forgotten


User Details

General User

Get help with forgotten


user details (org code,
user ID, password)

Main

5a

From the home page (not logged in),


indicate that I have forgotten my user
details

Enter details and request a password


reminder

Widget Details Page


Enhancements

General User

See various
enhancements as
suggested during Beta
Test Phase 1

N/A

Pass

There are multiple matching active


accounts for the specified email address

S166

Pass

There is no matching active account for


the specified email address

5b

N/A

8a

1
2

Password reset not requested

Main

View the Widget Details page for a (v8+)


widget

N/A

16

If evidence provision is optional for the current


N
org type, the evidence heading reads "The
following evidence should <strong>all</strong>
be obtained (recommended but not mandatory):"
(currently "<strong>Evidence
Required:</strong>)

5/6/2010

RJM

done

Pass

17

The context help next to "Evidence Required:" is Y


no longer needed and can be removed.

5/6/2010

RJM

done

Pass

18

The Print and Download buttons appear at the


bottom of the page as well as at the top

5/6/2010

RJM

done

N/A

Superseded by later widget

19
20

The print button is labelled "Print (PDF)


The tooltip for the print button is "View a
printable (PDF) version of this widget"

Y
Y

5/6/2010
5/6/2010

RJM
RJM

done
done

N/A
Pass

Superseded by later widget

21

The Cancel button is always available, not just


once changes have been made to the response

RJM

done

Pass

22

The expander icon is used for the evidence


Y
location and evidence details pop-ups (instead of
the "down arrow" icon)

RJM

done

Pass

23

The key icon in the widget header panel (if


present) has style "vertical-align:middle" which
gives a good compromise between it poking out
the top too much versus too big a gap between
first and second line of text

N/A

RJM

done

Pass

24

The "expand all/collapse all" icons are top-aligned Y

N/A

RJM

done

Pass

N/A

5/24/2010

High

Closed

1a

1b

S183

S167

S168

Widget Details Page


Callouts

Organisation User See "help" callouts on the Main


widget details page

Widget PDF Enhancements General User

View Widget PDF Variants

General User

See various
enhancements as
suggested during Beta
Test Phase 1

Be able to select from


three variants of the
widget PDF

Main

Main

25

The "missing information" icon in the Location


column, and in various places on the Evidence
Location pop-up, is as per the prototype.

5/24/2010

RJM

done

Pass

26

The training tool boilerplate text (first para) says Y


"The Information Governance Policy team within
the Department of Health (DH) has developed an
Information Governance Training Tool (PQRTT)."

5/17/2010

RJM

done

Pass

27
28

(defect) Section expanders aren't working!


Glossary terms within attainment levels have
dashed underlines (currently they are green but
with no underline)

N/A
N/A

RJM
RJM

done
done

Pass
Pass

29

The "expand all", "collapse all", "print" and


"download" buttons are links
(style/wording/position as per prototype). The
tooltips are still in place for them. Note that the
download button only appears for logged in
users.

5/24/2010

The attainment level tick boxes are not greyed


out

5/6/2010

RJM

done

Pass

The attainment criterion tick boxes are not


greyed out

5/6/2010

RJM

done

Pass

If I attempt to click on the "Current Level" field, I N


get a (pop-up) warning saying, "You cannot enter
the Current Level yourself. The system calculates
it automatically based on the data you enter in
the table above."

5/6/2010

RJM

done

Pass

If I attempt to mark an attainment criterion as


N
achieved (and evidence provision is mandatory),
the message displayed is the same as the
context help text i.e. "You cannot tick this box
yourself. The system ticks it automatically once
you have obtained all required evidence and
either uploaded it or otherwise fully specified its
location."

5/6/2010

RJM

done

Pass

If evidence provision is mandatory for the current Y


org type, there is a sentence within each
criterion indicating that all of the stated evidence
items must be obtained

5/6/2010

RJM

done

Pass

If evidence provision is optional for the current


org type, there is a sentence within each
criterion saying "The following evidence should
<strong>all</strong> be obtained
(recommended but not mandatory):"

5/6/2010

RJM

done

Pass

The evidence comments column is renamed as


"Details"

5/6/2010

RJM

done

Pass

If the assessment is in progress and this is not


the last widget, the "Next" button is yellow

5/11/2010

RJM

done

Pass

10

If the assessment is in progress and this *is* the


last widget, the "Done" button is yellow

5/11/2010

RJM

done

Pass

11

"Add Improvement Action" link - change to "Add


an action"

RJM

done

Pass

The various tick boxes are read-only but not


greyed out

5/6/2010

RJM

done

Pass

If I click any of the tick boxes I do not get a


warning message about not being able to tick
the box

5/6/2010

RJM

done

Pass

If I click in the Current Level box I do not get a


warning about not being able to enter the
current level

5/6/2010

RJM

done

Pass

When I first view the page, there is a callout (or Y


other device) drawing my attention to the first
expander explaining what it does e.g. "To see the
details for each section, click on the expander
icon:". The callout has an option to close and an
option to "don't show me this again"

5/6/2010

RJM

done

Pass

When a glossary term is first visible, there is a


Y
callout (or other device) drawing my attention to
the first glossary term explaining what it does
e.g. "<p>To see a definition of this term, hover
your mouse pointer over it.</p>
<p>To view the Glossary in full, click on it.</p>".
The callout has an option to close and an option
to "don't show me this again"

5/6/2010

RJM

done. Not possible to show on load


becuase the terms are hidden in
expandable divs.

N/A

When I first view the page, there is a callout (or


other device) drawing my attention to the
Attainment Levels section explaining what it
does e.g. "Expand this section to enter or edit
your answer to this widget.". The callout has an
option to close and an option to "don't show me
this again"

5/6/2010

RJM

done

Pass

When I mark an evidence item as obtained, and Y


the evidence location is not fully specified, the
system displays a red cross in the evidence
location field (no change) and also displays a
call-out to explain what the red cross means. The
call-out includes a "close" option and a "don't
show me this again" option

5/6/2010

RJM

done

Pass

The attainment criterion ID for Level 3


Maintenance criteria is displayed instead of the
word "Maint"

5/6/2010

done

Pass

For Level 3 maintenance criteria, the phrase


"[Only required if Attainment Level 3 was
achieved in the previous assessment]" appears
above the criterion description instead of below

5/6/2010

done

Pass

The width of the attainment criterion ID div has


narrowed (because its contents have narrowed,
since e.g. "1a" is now just "a" and "Main" is now
just e.g. "C")

5/6/2010

done

Pass

Individual table cells within attainment levels are N


not split across a page

5/6/2010

done

Pass

Section headings are not split from the first


paragraph below them

5/6/2010

done

Pass

Long tables split across multiple pages (currently N


expanding into the footer)

5/6/2010

done

Pass

The page footer is lower down, providing more


space on the page

5/6/2010

done

Pass

Keep table header with at least the first table row N

5/6/2010

done

Pass

10

Widget booklets - start each widget on a new


odd page

5/24/2010

done

Pass

11

Check booklet footer to make sure version


number and org type appearing

N/A

done

Pass

12

Numbered paragraphs - first line correctly aligned Y

N/A

done

Pass

13

Special characters (e.g. Left and right hand


quotes) are correctly displayed in all fields

N/A

N/A

done

Pass

The system displays a pop-up asking "Please


select an option:" then three radio buttons: "Full
widget", "Guidance only", "Attainment
levels/checklist only".

5/6/2010

The system displays the full widget variant of the N


widget PDF

5/6/2010

The system displays the "guidance only" variant


of the widget PDF (note, this may require some
enhancements to the publish process)

5/6/2010

The system displays the "attainment levels only" N


variant of the widget PDF (note, this may require
some enhancements to the publish process)

5/6/2010

3b

Contact Us Page Mark 2

General User

See various
enhancements as
suggested during Beta
Test Phase 1

Main

Registration Mark 2

General User

See various
enhancements as
suggested during Beta
Test Phase 1

Main

Select the "Full widget" option

Select the "Guidance only" option

Select the "Attainment levels/checklist


only" option

View the "Contact Us" page

5/11/2010

Des

Pass

The headings "Contact us Online and Contact us Y


by Phone" have a capital "U" for "Us"

5/11/2010

Des

Pass

The label "Email me a Copy of my Enquiry" has a Y


capital "E" on "Enquiry"

5/11/2010

Des

Pass

5
6

The SLA text is as per the prototype


Y
The required field markers are a bit bigger
Y
(1.2em) and there is an explanation of what they
mean at the bottom of the blue box (see
prototype)

5/24/2010
5/11/2010

Des
Des

Pass
Pass

There is an option to specify my Organisation


Name (not mandatory, default blank)

5/11/2010

Des

Pass

There is an option to specify my Organisation


Code (not mandatory, default blank)

5/11/2010

Des

Pass

If I am logged in, both the above fields are prepopulated

5/11/2010

Des

Pass

The email subject line says "PQR App", not


"PQRT" and is suffixed with "query"

5/11/2010

Des
Des

Pass

The email includes the org name and org code


specified

5/11/2010

Des

Pass

2
3

The system displays Register Step 1


There is *not* a link through to the ODS Online
Enquiries facility

Y
Y

5/11/2010
5/6/2010

Des
Des

Pass
Pass

The last para says if I don't know the above


Y
information the contact us, with a link through to
the Contact Us page

5/6/2010

Des

Pass

There is a (gray) "Contact Us" button after the


Next button which also goes to the Contact Us
page

Des

Pass

The "Next" button is yellow

5/11/2010

Des

Pass

The system displays Register Step 2


The "Next" button is yellow

Y
Y

5/11/2010
5/11/2010

Des
Des

Pass
Pass

The system displays Register Step 3 (see


prototype "register_3b.html"

5/11/2010

Des

Pass

12

The system tells me that it cannot provide


contact details for the local admin for security
reasons

5/11/2010

Des

Pass

13

There is a (yellow) "Contact Us" button after the


Next button which also goes to the Contact Us
page

5/11/2010

Des

Pass

2
3

The system displays Register Step 2


The system tells me that it didn't recognise the
org code (see prototype "register_2b.html")

Y
Y

5/11/2010
5/11/2010

Des
Des

Pass
Pass

The system gives me options to go back or


contact us (hyperlink to Contact Us page)

5/11/2010

Des

Pass

There is a (yellow) "Contact Us" button after the


Next button which also goes to the Contact Us
page

5/11/2010

Des

Pass

There is no "Next" button

5/11/2010

Des

Pass

The system displays Register Step 2

5/11/2010

Des

Pass

8
9
10
11

6b

6
1

Closed

The sentence "It is not mandatory to


enter details for the criteria but it is
recommended" below the attainment
level needs to be the same as for
"evidence provision mandatory" i.e.
"The following criteria must all be
satisfied:"

Low

Closed

If I am looking at the widget not within


the context of an assessment, there
should be no yellow button (neither
"Next" nor "Done")

Low

Closed

CMC:Dont think it could have been


putting this in at all as the XML was
missing the maintenanceCriteria
element

Closed

Des

The wording of the "Contact Us by phone"


section has changed (as per prototype)

6
7

6a

N/A

Text is still "You cannot directly mark an Low


attainment criteria as achieved. Please
use the criteria section to enter
evidence for the criteria"

Request to print a (v8+) widget

Click Submit

12

S170

Closed

View the PDF version of a (v8+) widget

1
2

10
11

Low

View the Widget Details page for a (v8+)


widget within the context of an
assessment

3
4

The spacing around the bar separators


is inconsistent - in some places you
have double spaces and in others you
have single spaces

View the Widget Details page for a (v8+)


widget within the context of an
assessment, as a ABC user or as a user
from another org

S169

Pass

View the Widget Details page for a (v8+)


widget within the context of an
assessment

3a

N/A
N/A

Wording doesn't match prototype

Low

Closed

Des 20/05 - Fixed

Button should be gray not yellow

Low

Pass

Des 24/05 - Fixed

Request to register an account

Enter an org code for an org which


already has an administrator

Click "Next"

Enter an unknown org code and click


"Next"

Enter org name keywords which won't


generate a unique match and click
"Next"

6c

Home Page Mark 2

General User

See various
enhancements as
suggested during Beta
Test Phase 1

Main

Assessment Summary
Mark 2

Organisation User See various


enhancements as
suggested during Beta
Test Phase 1

Main

5/11/2010

Des

Pass

5/11/2010

Des

Pass

There is a (yellow) "Contact Us" button after the


Next button which also goes to the Contact Us
page

5/11/2010

Des

Pass

There is no "Next" button

5/11/2010

Des

Pass

The system displays a validation error telling me N


I must enter one or the other

5/11/2010

Des

Pass

View the home page (not logged in)

Des

2
3

The log in button is yellow


The "Register Now" button is labelled "Register"
(less emphasis on ability to do it right now)

Y
Y

5/11/2010
5/11/2010

Des
Des

Pass
Pass

4
5

The register button is yellow


The context help icon for "Organisation Code" is
just one space away from the field (currently
there is a gap which is taken up by a hidden
mandaotry field marker but there is another
defect elsewhere to get rid of this)

Y
Y

5/11/2010

Des
Des

Pass
Pass

The "At a Glance" section includes a "User


Details" table containing the followiong data:

5/11/2010

Des
Des

Pass

8
9
10
11
12

- user name
- organisation name
- user email address
- user phone number
- last log in

Y
Y
Y
Y
Y

5/11/2010
5/11/2010
5/11/2010
5/11/2010
5/11/2010

Des
Des
Des
Des

Pass
Pass
Pass
Pass
Pass

12

Below the table there is an option to update my


user details (links through to the "update user
details" page

5/11/2010

Des

Pass

13

The user details panel (in the nav bar) does not
include my email address and phone number

5/11/2010

Des

Pass

14

The user details panel (in the nav bar) does not
include an option to update my user details

5/11/2010

Des

Pass

15

The "At a Glance" section includes a "Current


Assessment" table containing the followiong
data:

5/11/2010

Des

16

- Version

5/11/2010

Des

17
18
19

- Status
- Next deadline
Below the table there is a (yellow) button
labelled "Go To The Assessments Page" which
links through to the assessment summary page

Y
Y
Y

5/11/2010
5/11/2010
5/11/2010

Des
Des
Des

Pass
Pass
Pass

6
7

S173

The system gives me options to go back or


contact us (hyperlink to Contact Us page)

Leave both fields blank and click "next"

S171

The system tells me that it couldn't find a


uniquely matching organisation (see prototype
"register_2c.html")

N/A

Log in

20

If this is not the latest version of my assessment, Y


the system tells me (no functional change but
see prototype for new wording)

21

The "New Users..." section is at the top, above


the "At a Glance..." section

N/A

Styling as per prototype please - it is


Low
OK to use table tags to present this
data because it really *is* a table of
data - no need to convert to dvis (table
class="assessmentSummaryData")

Closed

Des 26/05: Fixed

If I have never logged in before, display Low


"(first log in)" instead of leaving it blank

Closed

Des 26/05: Fixed

This link is a "shortcut" to Admin/My


Low
Details, so (a) the Nav Bar should be
highlighted on "Admin" and (b) the
breadcrumb should show "Admin -> My
Details"

Closed

TH 7/6 failed re-test


Des 07/06: Latest version might not have
been in the test

Pass

Styling as per prototype please - it is


Low
OK to use table tags to present this
data because it really *is* a table of
data - no need to convert to dvis (table
class="assessmentSummaryData")

Closed

Des 26/05: Fixed

Pass

Current Assessment section (including Medium


out of date warning) should not appear
for a non-assessing org type e.g. XYZ
ABC

Closed

Pass

Logged in as REM, whose latest


High
assessment is v7. Version was showing
as v8 (whereas status was correctly
showing as "Updated"). If I go to the
Asessments page it correctly shows v7
as the most recent.

Closed

CMC:Fixed

"Assessments" should be plural

Closed

Des 26/05: Fixed

Pass

Nav bar should highlight "Assessments" Medium


and breadcrumb should show
"Assessments" (i.e. It should be the
same as if you clicked the
"Assessments" option on the nav bar

Closed

TH 7/6 failed re-test


Des 07/06: Latest version might not have
been in the test

Des

Pass

As well as the correct text showing on


the RHS of "At a Glance", the old
version of the text is also showing on
the LHS

High

Closed

Des 26/05: Fixed

Des

Pass

Missing full stop at end of


introductionary para "This page gives
you..."

Low

Closed

5/24/2010

The system displays a list of all my assessments Y


(there will always be at least one assessment)

5/11/2010

CMC

Pass

The assessments are ordered by creation date


(i.e. Primary key), most recent first

5/11/2010

CMC

Pass

The system validates that I am *not* using the


"simplified interface"

5/11/2010

CMC

Pass

For each assessment, the system does the


following:

The system validates that the assessment is not


yet approved

5/11/2010

CMC

Pass

If the assessment is not the latest version of my


assessment, the system warns me that it is out
of date (see prototype for new wording)

5/11/2010

CMC

Pass

The system displays the following "headline"


information:

10
11
12

- Assessment Ref
- Status
- Next Deadline (unless already submitted)

Y
Y
Y

5/11/2010
5/11/2010
5/11/2010

CMC
CMC
CMC

Pass
Pass
Pass

13

The system displays the following "widget


status" information:

14

- No. of reqts "not answered" (aka not started)

5/11/2010

CMC

Pass

15
16
17
18

- No. of reqts "answered" (aka in progress"


- No. of reqts marked complete
- No. of reqts confirmed complete
The above figures include reqts marked NR or EX

Y
Y
Y
N/A

5/11/2010
5/11/2010
5/11/2010
5/11/2010

CMC
CMC
CMC
CMC

Pass
Pass
Pass
Pass

19

The system displays the following "score"


information:

20
21

- Current score
Y
- Target score (only if I have set any target scores) Y

5/11/2010
5/11/2010

CMC
CMC

Pass
Pass

This story extends/alters S073

Request to view a summary of my


current and previous assessments

Pass

5a

7a

28a

2a

S174

Greyed Out Submit


Buttons

Organisation User See greyed out submit


buttons on the
Assessment Summary
page

Main

3a

Low

Showing a target score of 0%. I have


Medium
not set any target scores so the system
should not show this table row

Closed

I set target levels of <blank>, 2 and 3. Medium


The <blank> should be treated as 0 to
give a target score of (2+3+0)/(3*3) =
55%
However, the <blank> is being ignored
to give a target score of (2+3)/
(3*2)=87%

Closed

Widgets not answered should be


treated as level 0 for the purposes of
determining the grade

Medium

Closed

Some context help not showing - need


latest version of context help file
installing

Medium

Closed

RJM

RJM

22

- Current grade (in v8 or v7 notation as


appropriate)

5/11/2010

CMC

Pass

23

- Target grade (in v8 or v7 notation as


Y
appropriate) (only if I have set any target scores)

5/11/2010

CMC

Pass

24

Current and target grade are colour-coded


Y
RAGRed, RAGAmber or RAGGreen as appropriate

5/11/2010

CMC

Pass

25

There is context help for current/target score and Y


current/target grade (keys as per prototype)

5/11/2010

CMC

Pass

26

Ther context help for current/target grade relates Y


to v8 or v7 notation as appropriate

5/11/2010

CMC

Pass

27

There is an option to view the assessment status Y


history (no change)

5/11/2010

CMC

Pass

Status history pop-up doesn't work

High

Closed

Pass

change "View History" link to "view


history" (i.e. No caps)

Low

Closed

28

The system validates that the assessment is not


yet "locked down" (confirmed for non-simplified
interface or submitted for simplified interface)

5/11/2010

CMC

Pass

29

There is an option to "Work On This Assessment" Y


(button) which links through to the Widgets List
page. This is instead of the "View widgets" link
but only if the assessment is in progress

5/11/2010

CMC

Pass

30

The "Work On This Assessment" button is yellow Y


unless another button is yellow (see below),
otherwise it is gray

5/11/2010

CMC

Pass

31

If I am in a position to perform a baseline or PU


(and I have the relevant permissions), and the
current date is within 7 calendar days of the
baseline or PU deadline (or after) then the
relevant submission button (baseline, PU) is
yellow

5/11/2010

CMC

Pass

32

If I am in a position to perform a confirm or final


submission then the relevant submission button
(confirm, submit) is yellow

5/11/2010

CMC

Pass

33

If present, the "Performance Update" button is


labelled "Submit Performance Update"

5/11/2010

CMC

Pass

34

If present, the "Baseline" button is labelled


"Submit Baseline"

5/11/2010

CMC

Pass

Proceed as per main flow except:


- don't display reqts marked complete
- don't display reqts confirmed complete

N
N

5/11/2010
5/11/2010

CMC
CMC

Pass
Pass

Proceed as per main flow except:


- don't display Next Deadline
- don't display "widget status" information

N
N

5/11/2010
5/11/2010

CMC
CMC

Pass
Pass

Proceed as per main flow except:


- the system displays "view details" instead of
"Work on This Assessment"

5/11/2010

CMC

Pass

2
3

Proceed as per main flow except:


- the system displays "view details" instead of
"Work on This Assessment" (regardless of
assessment status)

5/11/2010

CMC

Pass

The available "state change" buttons are


appropriate for an XYZ ABC user

5/11/2010

CMC

Pass

If the Approve button is present then it is yellow

5/11/2010

CMC

Pass

The system validates that I have an in-progress


assessment that hasn't yet been submitted

5/11/2010

CMC

Pass

The system validates that the next stage for my


assessment is a baseline but that it is not yet
ready for a baseline (because not all widgets
answereed)

5/11/2010

CMC

Pass

The system validates that I have the necessary


permissions to perform a baseline

5/11/2010

CMC

Pass

The system displays the "Submit Baseline"


button but it is disabled

5/11/2010

CMC

Pass

The tooltip on the "Submit Baseline" button says Y


"You cannot submit a baseline until all widgets
have been answered"

5/11/2010

CMC

Pass

The system validates that the next stage for my


assessment is confirmation but that it is not yet
ready for confirmation (because not all widgets
confirmed complete)

5/11/2010

CMC

Pass

The system validates that I have the necessary


permissions to perform a confirm

5/11/2010

CMC

Pass

The system displays the "Confirm" button but it


is disabled

5/11/2010

CMC

Pass

The tooltip on the "Confirm" button says "You


cannot confirm this assessment until all
individual widgets have been confirmed
complete"

5/11/2010

CMC

Pass

1
2
3
4
1
2
3
4
1
2
3
1

I am using the simplified interface

The system is already approved

The assessment is "locked down"

View thw assessment summary as an


XYZ ABC user

Request to view my assessment


summary

I am unable to unapprove the


High
assessment once approved (don't need
to fix for beta test phase 2)

Closed

TH 16/6 CMC says he fixed this yesterday

3b

S175

Widgets List Mark 2

Organisation User See various


enhancements as
suggested during Beta
Test Phase 1

Main

The system validates that the next stage for my


assessment is final submission but that it is not
yet ready for submission (because not all
widgets answered)

5/11/2010

CMC

Pass

The system validates that I have the necessary


permissions to submit

5/11/2010

CMC

Pass

The system displays the "Submit" button but it is N


disabled

5/11/2010

CMC

Pass

The tooltip on the "Submit" button says "You


cannot submit this assessment until all widgets
have been answered"

5/11/2010

CMC

Pass

The system displays the "Widgets List" page

5/11/2010

RJM

done

Pass

The page title is:


h1:
"Version <version> (<start year>-<end year>)
Assessment"
h2:
"Widgets List"

5/11/2010

RJM

done

Pass

The table headings and look and feel of the page Y


and table are as per the prototype
("widgets_list_acute_logged_in.html")

5/11/2010

RJM

done

Pass

Table shouldn't have thick blue border

Low

Closed

Pass

Req numbers should be larger, bold,


black

Low

Closed

Pass
Pass

Table text should be black


Initiative headnings should be black

Low
Low

Closed
Closed

Pass

Remove nbsp from "Req No" table


heading so column can be narrower

Low

Closed

Pass

Although gramatically correct, can you Low


remove the "." from "Req." in "Req. No"
and "Key Req." column headings please

Closed

Pass

Remove nbsp from "Attainment Level"


table heading so column can be
narrower

Closed

Request to view the widgets list for my


own in-progress assessment

The PQRAF pass/fail icons in the "Attainment


Y
Level" column are top-aligned. To do this, insert
style="vertical-align:top;" within the <img> tag.

5/24/2010

RJM

done

Pass

The widget status for a "not started" widget is


displayed as "Not Answered" (yes, it's a u-turn!)

5/11/2010

RJM

done

Pass

The widget status for an "in progress" widget is


displayed as "Answered" (yes, it's a u-turn!)

5/11/2010

RJM

done

Pass

The widget descriptions are *not* clickable

5/11/2010

RJM

done

Pass

For each widget there is a button (in a separate Y


column) which links through to the widget details
page

5/11/2010

RJM

done

Pass

If the widget is "not answered" then the button


label is "Answer"

5/24/2010

RJM

done

Pass

10

If the widget is "not answered" then the button


label is "Edit"

5/24/2010

RJM

done

Pass

11

If there are any widgets that are "not answered", Y


the button for the topmost one is coloured yellow

5/11/2010

RJM

done

Pass

12

There is an option "Back To Assessments page"


(button) - links back to the Assessments page

5/24/2010

RJM

done

Pass

13

If the assessment is "ready to advance" i.e. If the N


"next stage" button on the Assessment
Syummary page would be displayed in yellow
then the "Back To Assessments Page" button is
yellow

5/24/2010

done

Pass

14

If I am in a position to perform a final submission, N


and I am using the simplified interface, there is
*not* an option to submit the assessment from
this page (rather, I need to return to the
Assessment Summary page)

5/24/2010

RJM

done

Pass

The links "Printable version", "Downloads and


Y
booklets" and "Assign widget owners" (if
available to the current user) are positioned on a
single line as per prototype.

5/24/2010

RJM

done

Pass

16

The system displays the printable version (no


change)

5/27/2010

RJM

done

17

The page title is as per the non-printable version


of the page

5/27/2010

RJM

done

15

15

1a

S172

S176

Look and Feel Mark 3

Auto Create Assessment

General User

Experience a yet further


enhanced look and feel

Main

Organisation User Have the user auto create Main


a new assessment for me
instead of having to create
it myself

1a

Pass

The printable version includes an


Low
empty Action column - can you remove
it?

Closed

Pass

Showing as "Matching Widgets"

Medium

Closed

Note the buttons are changed to "View"


once each req't is marked complete
which is OK

Medium

Closed

As per main flow except:


The widget details button labels are all "View"

5/24/2010

RJM

done

Pass

As per main flow except:


The widget details button labels are all "View"

5/24/2010

RJM

done

Pass

5/27/2010

RJM

done

Pass

5/27/2010

RJM

done

Pass

Request to view the widgets list for


another organisation's assessment
(including XYZ ABC user)

Request to view the widgets list for a


given org type (i.e. Not within the
context of an assessment)

As per main flow (where applicable outside of an


assessment) except:

The page title is:


h1:
"Acute Trust Version <version> (<start year><end year>)"
h2:
"Widgets List"

The table headings and look and feel of the page


and table are as per the prototype
("widgets_list_acute.html")

Closed

Request to view the widgets list for my


own "confirmed" (i.e. Not in progress)
assessment

2
3
1c

This button should only be yellow if the Medium


assessment is "ready to advance"
(check with Chris for rules). If not, all
buttons should be gray (which I admit is
not perfect)

Request to view a printable version of


the page

2
3

1b

Currently says "Acute Assessment"

View any page

All pages have <h1> headings (some currently


have no headings)

Des 22/06: Implemented

Pass

All buttons are styled as per prototype (unless


otherwise stated in a specific story, all buttons
are gray, not yellow).

5/11/2010

done

Pass

If there are any yellow buttons in the page, the


first yellow button is the default button.

6/24/2010

Des 25/06: Implemented

Pass

The Nav Bar options have (standard) tooltips as


per the prototype (index.html and
index_logged_in.html)

5/11/2010

Des 22/06: Implemented

Pass

All font sizes are relative, to allow users the


option to change the font size via their browser

7
8

All alert boxes are yellow instead of pink


Y
Hyperlinks within the breadcrumb are underlined Y
by default and the underline disappears on hover

5/11/2010
6/24/2010

done
Medium

Pass
Pass

The logos in the header bar have sharper


definition (see prototype)

6/24/2010

done

Pass

10

The title in the header bar matches the font for


the rest of the site

6/24/2010

done

Pass

11

There are various stylesheet changes (Tony to


provide updated versions of master.css and
igt.widgets.css)

N/A

12

When a modal pop-up is displayed, the main


page fades to dark, not to white

N/A

Des 23/06: Implemented

Pass

13

On all modal pop-ups, the background colour for


the button bar is the same as for the rest of the
pop-up

N/A

Des 23/06: Implemented

Pass

14

The blue colour below the nav bar and around


the bottom of the page is a little lighter

15
16

All context help icons are top-aligned


The context help icons (normal and alternate)
are as per the prototype

Y
Y

17

All errors and warnings use the "info" icon as per Y


the prototype with the text to the right of it (<div
class="infoMessage"> includes the image
automatically as a background - see prototype
"assessments.html" for an example of use)

18

The PQRAF pass/fail icons are as per the


prototype

19

Context help HTML formatting - see Register Step N


1/Organisation Code - there needs to be less
space between paragraphs and the text for
bullet points needs to remain indented on the
second line

N/A

N/A

20

Transparent PNGs don't work in IE6 - keep them


as PNGs but use a workaround (see google for
details!)

N/A

21

ISO/IEC page - make main title an <h1> tag

N/A

22

On the Create Organisation page change


"National Code" to "Organisation Code"

23

24

Low

N/A

N/A

Pass

What's New article headers seem to be Low


fixed size

Closed

No underlines - CSS problem I suspect

Low

Closed

Home page - log in validation failure


doesn't have a "!" icon

Low

Fixed

5/11/2010

Pass

N/A
N/A

done

Pass
Pass

Des 22/06: Implemented

Fail

done

Pass

done

Pass

N/A

High

Pass

N/A

Des 22/06: Implemented

Pass

N/A

N/A

Des 22/06: Implemented

Pass

What's New - in IE6 the separator bar is about 10 N


px deep. Note there is a related defect to format
as per prototype somewhere

N/A

N/A

All field sets use <table class="dataLayout"> for Y


layout. Two reasons: (1) the label widths adjust
automatically, (2) the formatting is more
consistent when I change the browser text size
See index.html for example

N/A

N/A

Text for a bullet point which goes onto a Low


second line could be better indented

Des 23/06: Fixed

Closed

Des 23/06: Could not find any issue. Need


specific instances.

Closed

Des 23/06: Fixed

Pass

Registration Step 1 - can you explicitly Low


set the width of the first column in both
tables to the same so that they line up
(see prototype for markup)

Closed

Pass

Registration Step 6 - can you explicitly Low


set the width of the first column in both
tables to the same so that they line up
(see prototype for markup)

Closed

Pass

You've added tables but not set the


class "dataLayout" (you will also need
to copy the relevant styles from
master_delta.css")

Medium

Closed

Closed

Pass

done

Log in

5/11/2010

CMC

Pass

The system automatically creates an assessment N


for me. Note that this already happens for the
simplified interface, so this is only a change for
non-simplified interface

5/11/2010

CMC

Pass

Working as a.test:acute2:
Medium
- deleted v99 assessment manually via
database (since you can no longer
delete via the front end)
- unapproved v7 assessment (manually
via DB since "Unapprove" button not
available on Ass Summ screen - defect)
- cycled v7 assessment through various
statre changes, finally ending up at
"approved" again
- Logged out and logged in
- System showing v7 assessment but
hasn't created v99 assessment

The system validates that I am in a position to


delete the current assessment (no change)

5/24/2010

CMC

Not Tested

Not tested since no change fron current

The system provides an option to "Reset" the


assessment (previously "Delete"

5/24/2010

CMC

Pass

The system deletes the assessment (no change)

5/24/2010

CMC

Pass

The system automatically creates a new


assessment of the same version (as per autocreate above)

5/24/2010

CMC

Pass

Log in
Request to view my assessment

Closed

Low

Remove the <h3> tag starting "BSI


ISO/IEC" which is immediately below
the <h1> tag

The system validates that my organisation is in a N


position to start a new assessment i.e. I do not
already have an assessment for the latest widget
version and I do not have an incomplete previous
assessment

5
6

current 1.1em for <h3> and 0.9em for


<p>
TH 25/6 - need to update #mainContent.h3
to 1.1em too

Pass

1
2
3

Font size still too small - see prototype for


appropriate style "widgetNumber"

Request to delete the assessment

CMC:This was a problem with the test data


set up in that you had 2 different versions
(Acute Test V7 and V99) which had the
same start/end dates. This would never
happen in real life and so have changed
the test data to make it reflect how it
would be in real life (V7 being set to have
data reange of a year before V99) and all
works ok.
TH 16/6 didn't retest since only test data

S085

View Quick Start Guide

General User

Get up to speed with using Main


PQRT as quickly as
possible

View the help page

There is an option to view the quick start guide

5/24/2010

RJM

done

Pass

The system displays the quick start guide page


(in a new window)

5/24/2010

RJM

done

Pass

The page content is as per the prototype


(including images)

5/24/2010

RJM

done

Pass

There is an option to print the page (selecting


this triggers the print dialog)

5/24/2010

RJM

done

Pass

There is an option to view the quick start guide


(within the "New Users" panel) - see prototype
for "stronger" wording

5/24/2010

RJM

done

Pass

The system displays the quick start guide page


(in a new window)

5/24/2010

RJM

done

Pass

There is an option to view the quick start guide


(within the "New Users" panel) - see prototype
for "stronger" wording

5/24/2010

RJM

done

Pass

The system displays the quick start guide page


(in a new window)

RJM

done

Pass

Performance Progress Report - when logged in as N


XYZ ABC and viewing the PPR of another
organisation, the report shows the XYZ ABC
admin, whereas it should show the reported org
admin

N/A

N/A

CMC

Done

Pass

3
4

Admin page - typo on "User Admin" line


Resources page - make Downloads the topmost
link (only if avialable to user)

N
N

N/A
N/A

N/A
N/A

CMC
CMC

Done
Done

Pass
Pass

PPR report (individual) - needs gaps between the N


3 tables (currently merged together)

N/A

N/A

CMC

Done

Pass

ABC org admin page - make sure hyperlinks are


on separate lines (or separated by a bar
character)

N/A

N/A

CMC

Done

Pass

The alert box on the Home Page says "PQRT


Version 8 Beta Test", and there are two links one to the "Trust Phase 2 test script" and one to
"XYZ test script".

N/A

N/A

CMC

Done

Pass

10

Assessment report org chooser - change table


heading "National Code" to "Organisation Code"

N/A

N/A

CMC

Done

Pass

11

Knowledge base page - include file type and size Y


after filename for internal files (as per widget
details page)

N/A

N/A

CMC

Done

Pass

14

Reports page: improvement plan and evidence


report to appear after PPR

N/A

N/A

CMC

Done. CMC:Also fixed security hole


Pass
with Improvement plan report whereby
querystring params could be spoofed
to view another organisations report

16

Assessment Summary page - in Google Chrome


the button bar sticks out of the bottom of the
blue <div>. OK in prototype.

N/A

N/A

Done

Pass

17

Publish process - the text "[DRAFT] is prefixed to N


the Question Text field". This is to support beta
test phase 2 and will need to be removed for golive (so make it configurable if you like)

N/A

N/A

Done

Pass

18

glossary.pdf, contextHelp.xml and


contextHelp.xsd should probably *not* be
published to the folder KnowledgeBaseNew
(which is supposed to be for knowledge base
docs)

N/A

N/A

CMC

CMC:Very much agree, Done

Pass

Request to view the quick start guide

6
1a

S181

S184

Odds and Ends 3

Add Improvement Action


Usability

General User

See a range of random


and unrelated point
improvements across the
site

Main

Organisation User Be able to add


Main
improvement actions more
easily, with less reliance
on pop-ups

1
2

Log in

Request to view the quick start guide

View an in-progress (v8+) widget within


the context of an in-progress
assessment

Request to add an action against a given


attainment criterion
The system provides the option to add details for N
the action

5/27/2010

RJM

done

Pass

The method of input is easier to use than current N


in that it does *not* involve using multiple
individual pop-ups for each data field. But at the
same time the page is not littered with white
input fields on a yellow background (looks too
untidy/cluttered).
One option would be to have a single pop-up that
takes input for all three fields (Action, Owner,
Due Date).
An alternative would be to dynamically insert
input fields into the yellow table if the user clicks
"edit".

5/27/2010

RJM

done

Pass

Can you make the cursor focus in the


"action" field when I click "add an
action"

Low

Closed

Pass

Can you change the Evidence Location


and Evidence Description "plus" icons
to "pencil" (edit) icons (and the minus
icon to "tick" icons)

Low

Closed

It is still possible to enter a date by typing rather N


than only via the calendar selector

5/27/2010

RJM

done

Pass

It is still possible to mark the action as complete


without going via a pop-up

5/27/2010

RJM

done

Pass

The system provides the option to edit details for N


the action

5/27/2010

RJM

done

Pass

As per "add", the method of input is easier to use N


than current.

5/27/2010

RJM

done

Pass

If my email address is too long (e.g.


marie.greenfield@dh.dsi.gov.uk) then in IE7 it
extends past the RHS of the "user info" box. In
IE6 it causes the user info box to widen and
forces the main panel down below the nav bar

N/A

N/A

THMA

Medium

Pass

RJM

Widget Details page (Req 202), IE6: scroll down N


so that para 1 is near the top of the screen. Float
over "National Information Governance Board for
Health and Social Care" (para 5), which should
be near the bottom and then float over "Caldicott
Guardians" (para 6). The tooltip appears near the
top of the screen instead of next to the text.

N/A

N/A

Low

Pass

IE6 fix: Keep your eyes closed then you


wont notice. No widget 202. Not sufficient
information on conditions to recreate
problem.

If the widget is *not* a key widget, the "Key


N/A
Widget" box in the header panel should *not* be
coloured in yellow

N/A

N/A

Low

Pass

In IE6, req't 210 (not logged in), the main


content panel is displayed below the nav bar
instead of to the right of it. Other reqts are OK
and 210 in context of assessment is OK too.

N/A

N/A

N/A

Medium

Pass

Resources page - ISO/IEC link - mis-spelling of


"access"

N/A

N/A

N/A

Medium

Pass

(IE6) Contact Us page - Organisation Type


context help pop-up appears behind the Subject
drop-down field

N/A

N/A

N/A

Low

Pass

RJM: problem with z-index on IE6. Placed


jQuery bgiframe plugin onto master page
to overcome it

On the widget details page, if I change the target N/A


date, the save button is not enabled

N/A

N/A

Medium

Pass

RJM

10

Widgets list screen, for older assessments (or


N/A
maybe current ones as well) if a widget has
comments entered against it then the row
shading on the new View button on the right
hand side goes wrong. Specifically it doesnt
look as if its allowing for the extra row(s) for the
comments.

N/A

N/A

Medium

Pass

RJM

11

If you log in as CfH go to the Assessments option N/A


and pick an organisation to view their
assessments (e.g. REM). Drill down into the View
Details link to get the widgets list. If you now
click the Back To Assessments Page its lost the
details of what organisation was being viewed.

N/A

N/A

Medium

Pass

RJM:Not found

12

On widgets details page had a problem that


when logged on as CfH user if set a widget to
Exempt and click Next or Prev button to save it,
it doesnt get saved.

N/A

N/A

N/A

Medium

Pass

RJM

13

Widgets List page - if I am working on an


assessment and there is a widget marked Not
Relevant or Exempt, the button says "View"
instead of "Edit"

N/A

N/A

N/A

Low

Pass

14

As a.test:gp, completed all widgets then


N/A
submitted assessment. Went back to Req Details
page and the attainment level and attainment
criteria tickboxes were still enabled (although
there was correctly no save button)

N/A

N/A

High

Pass

15

PQRAF statement hidden behind nav bar in IE6

N/A

N/A

High

Pass

16

Javascript error when trying to define new info


mapping report (see CC for details)

N/A

N/A

High

Pass

17

On UAT site, created a new user "test" under org N


"RVV" with just user permissions. Attempted to
edit user and got a server error. Other (existing)
users can be edited OK.

N/A

N/A

High

Pass

18

Assessments page very slow to load, especially


N
for orgs with a full assessment history going back
to v1

N/A

N/A

High

Pass

19

Widgets List page very slow to load, especially


N
for orgs with a full assessment history going back
to v1

N/A

N/A

High

Pass

20
21

About page - "HS" should be "XYZ"


in UAT, v8 baseline deadline is showing as 31
July - I think it should be 31 Oct 2010

N
N

N/A
N/A

N/A
N/A

Low
High

Pass
Pass

22

in UAT, with full widget set, the Improvement


Plan Report pop-up very slow to load (probably
slower due to having full reqt set)

N/A

N/A

N/A

Withdrawn - couldn't re-create

N/A

23

In UAT: Not logged in, select Reports/Assessment N/A


Report. Search for KMH123, click "Report" and
get a system error. Other orgs are OK. KMH123 is
a test org created by Kim Hobday

N/A

N/A

Fixed

Pass

25

In UAT, Contact Us page, not logged in, fill in


contact form and submit - Org Name, Org Code
not being included on email

N/A

N/A

N/A

Medium

Pass

26

Improvement Plan report - Incomplete Items Only N/A


- widget was not yet answered and target not set
- and it wasn't included in the report - I would
expect it to assume current level 0 and target
level 3 and thus show all criteria in levels 1, 2
and 3 (subject to rules on Level 3 Maintenance)

N/A

N/A

Medium

Pass

27

Improvement Plan report pop-up - context help


N/A
icon image filenames are wrong - is this because
PNGs have changed to GIFs?

N/A

N/A

Medium

Pass

28

Org a.test:sc - answered all widgets then went to N/A


Req List page. It displayed the "submit now"
panel which was supposed to have been
removed.

N/A

N/A

Medium

Pass

RJM

29

In IE6 it is possible to tick attainment criteria (for N/A


an acute org) - details from Ellie or Richard

N/A

N/A

High

Pass

RJM

30

Create new user as an Org Admin (Acute, XYZ or N/A


any other type) - the system should only present
the "General New User" email template, and not
the "PQRScO Applicant" email template

N/A

N/A

Low

Pass

CMC

31

Req Details page - system error when clicking


"Next" (intermittant) - screenshot of error
message sent to RJM on 10/06/2010

N/A

N/A

N/A

High

Pass

32

Evidence Location pop-up - if I specify "Local File" N/A


and select a file and then do the same again
(same file) against another evidence item, the
filename won't populate. If I click Save on the
Req Details page and then try again it works.

N/A

N/A

High

Pass

RJM

33

Quick Start Guide - missing word: "The PQR App


has been designed to be used..."

N/A

N/A

Low

Pass

RJM

S185

Miscellaneous Defects

Developer

Left over defects not yet


fixed

Main

5/24/2010

2a

CMC/RJM

Request to view the quick start guide

4
1b

Closed

View the home page (not logged in)

I'm pretty sure the help topic HTML files Low


should not be in the
knowledgebasenew folder

1
2

Request to edit an existing action

N/A

RJM

Withdrawn RJM: NOT FOUND: Req 210 does not exist


in test data so unable to test or verify it.
TH 14/06: req 210 was in UAT but no longer
there so cannot recreate

RJM

The checkboxes are disabled but I get


Low
the "you can't tick this yourself"
warnings whereas in this case they are
*really* disabled because the
assessment is submitted so the warning
is not appropriate

Closed

By implementation of s208

RJM
Closed

RJM

Closed

Re-test in UAT once re-deployed

Closed

RJM
CMC

Des 16/06: Fixed

EP - This seems to have rectified itself.


Perhaps with a subsequent fix for
another defect.

Withdrawn Not found


TH 22/6 - can't re-create

34

Evidence upload: uploaded Word doc then


N/A
clicked "View" - got MS Word pop-up message
"Word cannot start the converter mswrd32.wpc".
IE7. Originally raised by Kim Hobday (2nd line,
Exeter) if you need a demo!

N/A

N/A

Medium

Pass

Withdrawn RJM: Not a defect. It is a feature of IE6/7.


They need to ask their own tech support to
fix the issue with Word/IE6/7. The problem
occurs with .docx files - ie the new word
2007 format. If you just click OK, OK, OK...
the file will display. This message can
appear if:
The converter was not properly registered.
The converter was inadvertently deleted
without removing the registry information.
The converter support files are corrupt.
The converter installation was removed
and the uninstall tool did not finish clearing
the registry settings.
The hard disk is damaged where the
converter files were stored.
Usually, reinstalling the converter will
overcome this problem. If the converter
reports that it is already installed, first
uninstall it so that the setup program can
remove the files and registry settings.
If removing and reinstalling the converter
is not successful, there may be a problem
with a resource on the computer (for
example, an executable file that is needed
to properly register the converters on the
computer has failed or stopped running). In
this case, it is best to turn off the computer
and start over.
TH 22/6 - withdrawn

35

Improvement Plan Report - if no records, you get N/A


the message "There aren't any record to
generate..." Record should be plural i.e. Records.

N/A

N/A

Low

Pass

36

About page: Change the sentence Organisations N/A


are required to carry out self-assessments of
their compliance against the PQR widgets. To
The organisations described below are required
to carry out self-assessments of their compliance
against the PQR widgets.

N/A

N/A

Low

Pass

37

About page: Change hyperlink text Guidance


N/A
about Compliance: Essential standards of quality
and safety to Essential standards of quality and
safety

N/A

N/A

Low

Pass

RJM

38

IE6, one of the beta testers: Assessment report - N/A


when click "Show report" I get the XLS file
displayed as raw text in the browser window
(email sent to CC/RJM on 11/6)

N/A

N/A

High

Pass

CMC

39

Beta tester: Evidence location pop-up: Uploaded N/A


a file, the changed the drop down back to
[select]. Then clicked "View" and got an error
saying "Unable to find the specified file. It may
have been removed form the Server"!

N/A

N/A

Medium

Pass

RJM

40

Improvement Plan Admin: Only widget owners


N/A
that have started the widgets are listed. Need
this changed to those that are not answered as
well

N/A

N/A

High

Pass

Des 15/06: Fixed

41

Req List/Req Details - click yellow "Answer"


N/A
button and get system error "Invalid postback or
callback argument" (full error sent in email to
RJM/CC on 11/6)

N/A

N/A

High

Pass

RJM

42

Assessment Report in UAT - org code RDE,


compare with v1, not showing result for v2
assessment even though it is displayed on
Assessment Summary page

N/A

N/A

N/A

High

Pass

CMC

43

HTML markup within the Evidence Required field N/A


of the yellow evidence table is being displayed
raw e.g. "<strong>Blah blah
blah</strong>"(example req 203 criterion 2a)

N/A

N/A

Low

Pass

RJM

44

Req List page, logged in as nhscfh - viewing


assessments for org a.test:acute, the "Back to
Assessments Page" button takes me the
assessments page but with no assessment data
showing

N/A

N/A

N/A

Low

Pass

RJM

46

As a CTP, when I have answered all req'ts I am


still getting the Submit panel on the Req List
page. This needs to go.

N/A

N/A

N/A

Medium

Pass

Closed

RJM: this was discussed and agreed that it


would stay for Simplified Interface User's.
However, the submit panel has now been
completely removed for all users as per
this new request that overrides the agreed
way of doing it.

47

Logged into UAT as nhscfh user (elpe) and I go to N/A


the admin area and search for org RXL. I click to
view users and then on edit next to the first user
pabu. I get an error:
Conversion failed when converting the varchar
value 'tohe1' to data type int

N/A

N/A

Pass

Closed

CMC

Closed

Tried in sys test and its still not grouping by


initiative

Closed

Not found

RJM

Closed

Not found
TH 22/6 - Last sentence in para under
heading "What is the PQR App?"

Interestingly this does not occur in sys test


environment.

48

Downloads - download ZIP and try to open PDFs - N/A


PDFs won't open (OK in WinRAR but not Windows
Explorer)

N/A

N/A

High

Pass

49

PDF version of req't (and probably booklets too) - N/A


Changes section always blank even when there
are changes in the online widget - presume the
publish process isn't populating the XML file
correctly

N/A

N/A

Medium

Pass

50

PDF booklet - widgets not being ordered by req't N/A


number (e.g. 116 and 324 are out of order at the
end)

N/A

N/A

Medium

Pass

52

[email from Rees Cox, sent to RJM/CMC]


IE8, UAT env't - Req Details page (logged in) reqt 8603 - expand Attainment Levels then
expand Guidance. Blue boxes obscure the
guidance text

N/A

N/A

N/A

High - Ellie can re-create this


Pass
consistently
EP - retest with latest UAT build (25/06)
and looks fine now.

53

Resources -> Knowledgebase Archive -> Search


(without specifying text) -> Exception Details:
System.Data.OleDb.OleDbException: Service is
not running.

N/A

N/A

N/A

Withdrawn - environment issue due to N/A


MS Index Server not being installed on
test server - not worth installing to
test. Chris promises it will be Okk in
live

54

Log on as acute trust user with no permissions.


"Go to Assessments Page" button should not be
displayed (in the same way that the
Assessments option on the nav bar is not
displayed (and if you click the button you get an
error)

55

Registratuion Step 7 - the two yellow alert boxes N/A


need the "!" icon adding (use <div
class="infoMessage">)

N/A

57

On the Forgotten User Details screen the


N/A
sentence at the top reads 'To receive a reminder
of your user details by email, fill in the form
below, then click 'Remind Me':
Please can you change the : to be a . As per the
prototype

N/A

58

Logged in as XYZABC, Assessments ->Select org N/A


-> Req List -> Req Details -> Done -> Go Back to
Assessment Page - takes me back into the req
details page instead of back to the assessments
page

59

Attempt to upload virus-infected file and then


attempt to upload a normal file immediately
afterwards. Get error re. startIndex (see eamil
from Pete Spence, 22/06)

63

64

Need UAT rebuild with full req't set

Medium

Pass

CMC

N/A

Low

Pass

Closed

N/A

Low

Pass

Closed

N/A

N/A

Medium

Pass

Closed

N/A

N/A

N/A

Medium
EP - Tested in IE7

Pass

Closed

Req Details page, not logged in - NR option not


showing for reqt which allows NR

N/A

N/A

N/A

Medium

Pass

Closed

Whats new articles should show the date only,


and not the time

N/A

N/A

N/A

Low

Pass

65

PDFs (individual and booklets) - Not Relevant


Reason not appearing in the Attainment Levels
table

N/A

N/A

N/A

Medium

Pass

It's an issue with widget2fo.xsl - TH has


emailed update to TM

66

In UAT: v8 acute assessment says "2010-1"


(defect previously raised but through to only
affect test data)

N/A

N/A

N/A

Medium

Pass

EP - retested again 24/06 on UAT


(IE6&7) with login P87024 / elpe /
4testing and i can see the same thing
(2010-1). This does not however
happen on system test environment
where it shows 'Version 99 (20102011).

Nothing to do with sequence. It's due to


attempting to upload a file without an
extension.

Closed

Closed

25/06 EP - Need to retest once UAT


rebuilt
25/6 TH re-tested OK in sys test but EP
to retest in UAT
EP - retested in systest by creating a
proper gp new user showing a V8 (not a
V99). Looks fine.

S177

S187

New Org Type: Eyecare

Accessibility

General User

General User

Be able to view widgets


and complete
assessments for eyecare
organisations

Be able to access the site


as a disabled user

Main

Main

67

Click "Register" - the system displays register


step 7!

N/A

N/A

N/A

High

Pass

71

Home page (logged in) - Help On Assessments


link doesn't work - suggest removing the link for
now

N/A

N/A

N/A

Medium

Pass

72

Widgets XL download - Report and Calculations


tabs need removing

N/A

N/A

N/A

Medium

Pass

Closed

73

Noticed now that when I click to open an


improvement plan, it opens in a new browser
window but on the task bar instead of being
visable immedialtely on your screen in a new
window.

N/A

N/A

N/A

Medium

Pass

Closed

Des 25/06: Fixed


EP - Retest passed 25/06

74

Opened up an improvement plan and clicked to N/A


open a piece of attached evidence but I get the
error:
Unable to view the document. An exception
occurred: Value cannot be null. Parameter name:
String

N/A

N/A

High

Pass

Closed

Des 25/06: Fixed


EP - Retest passed 25/06

Closed

View the widgets (not logged in)

There is an option to view widgets for a new org


type: "Eye Care Service" (code "EYE")

5/27/2010 N/A

Pass

Properties of eye care org type are as per thingy

5/27/2010 N/A

Pass

RJM

View any page


The first element within the <body> of each
Y
page should be an <h1> containing the site title
"Information Governance App"

N/A

N/A

Pass

RJM

First set of links "DH Home, XYZ ABC Home, etc." Y


are less important than the main navigation
links. These should move down the mark-up.
Possibly move to the bottom and use CSS to
display them at the top.

N/A

N/A

Pass

RJM

All data input fields with a label should have the


label marked up with the <label> tag, and the
<label> tag should have a 'for="**"' element
referring to the ID of the labelled element

N/A

N/A

Pass

home page - extraneous <label> tag in Medium


TD cell to left of "Log In" button

Closed

Fail

Regsiter 1 - no "for" in labels

Medium

Failed

The "for" ID is wrong - looks like a static ID


instead of matching the .net created ID.
After discussion with TH left for next
iteration.

Pass

ReportsOrganisationChooser.aspx - no
"for" in Org Code label

Medium

Closed

The "for" ID is wrong - it's missing


"_ddlOrgTypes" off the end

Pass

Assessment Report page - Assessment


label not marked up as a label

Medium

Closed

Pass

Assessment Report page - First group of Medium


checkboxes not marked up as labels

Closed

Pass

Assessment Report page - second


group of checkboxes *are* marked up
as labels and are consequently
appearing in bold, which looks wrong.
Suggest adding a new style
checkboxLabel and making them not
bold

Low

Closed

Fail

Register Step 4
Fields:
Name (Forename Surname)
Email
Confirm Email
Telephone

Medium

Raised

nili: after discussions with TH left for next


iteration

Pass

Admin link
New User link
Field:
Name (Forename Surename)

Medium

Closed

EP - Retest failed

EP - Retest failed

S202

S189

Odds and Ends 4

Assessment Report Graphs

General User

General User

See a range of random


and unrelated point
improvements across the
site

View graphs within my


Assessment Summary XL
file

Main

On the Widgets List page, when viewing my own N


assessment, if the assessment is "locked" i.e.
Status of "confirmed" or later, there is *not* an
option to add or amend requireemnt owners

N/A

Contact Us page - probably need to remove link


to FAQ since we aren't going to have any FAQ
(leave this until confirmed)

N/A

Assessments page - for each (v8+) assessment


there is a link through to the Improvement Plan
and Evidence report (and when you get there,
the relevant assessment is selected by default)

Widget Details page: in IE6 there are big


whitespace gaps between the Attainment Level
description and the <hr> tag. Likewise for
Attainment Criteria. These don't appear in IE7

N/A

N/A

Assessment Summary page - when I click


"Reset", the wording on the warning pop-up
makes it clear that it will create me a latest
version assessment

N/A

N/A

Home page (logged in) and Assessment


Summary page - wording re. out-of-date
assessment should refer to "Reset" instead of
"Delete"

N/A

N/A

Home Page/At a Glance/Last Log In - if last log in N


was today, display "Today" abd then the time

N/A

10

New user and password emails - URL links to site N


at bottom of email need updating (currently refer
to GettingStartedChooser.aspx) - change them to
point to the home page

N/A

12

Put a link to "Change Password" page from


"Update User Details" page

14

Unless there's a good reason not to, can we


N
make the default style for bullet lists to actuall
display the bullet points and then get rid of the
class "bulletList" - check first with Tom why he
did it this way in the first place in case there's a
good reason. This will also resolve a defect that
the training tool text on tyhe Req Details page is
not showing bullet points

15

16

General User

See the major version


Main
number as a prefix to the
widget number (v8+ only,
req list, req details and
PDFs only)

Raised

nili: after discussions with TH left for next


iteration

Medium

Raised

nili: after discussions with TH left for next


iteration

Fail

Trust User
Medium
Submit Baseline & Performance Update
Widget Details screen
Fields:
Widget Complete
Widget Confirmed

Raised

nili: after discussions with TH left for next


iteration

Fail

EP NEW
Assessment Report screen
aka ReportsOrganisationChooser.aspx
Organisation Type drop down

Medium

Raised

Above the reset box it randomly says:


"Question 30:"

Low

Closed

Pass

Pass

N/A

Low

Pass

It says "Today" but not the time!

Medium

Closed

N/A

Medium

Pass

Could you also remove the text "and


read the appropriate "Getting Started"
material" - this is now obsolete

Low

Closed

N/A

N/A

Des 18/06: Implemented

Pass

N/A

N/A

Des 18/06: Implemented

Pass

Assessment Summary page - "view history" link - N


exclude brackets from hyperlink

N/A

N/A

Low

Pass

Improvement Plan pop-up - add a "Print this


page" link jsut below the title which triggers the
browser print function (see quickstart.html for a
cut&paste example)

N/A

N/A

Des 16/06: Implemented

Pass

18

Glossary PDF - don't break table rows across


pages

N/A

N/A

Done

Pass

19

Widget PDF filenames - change reqt no from 4


digits to 3

N/A

N/A

Low

Pass

The system displays the Assessment Report


Criteria page

6/14/2010

CMC

Pass

There is an sub-option under "break down by


attainment level" which is to include a pie chart

6/14/2010

CMC

Pass

The sub-option is disabled

6/14/2010

CMC

Pass

The sub-option is now enabled

6/14/2010

CMC

Pass

The report includes a pie chart below the data


table

6/14/2010

CMC

Pass

10

The pie chart references the attainment level


break down for the current/final scores on the
selected assessment (not any historical
assessments also in the report)

6/14/2010

CMC

Pass

11

The formatting and segment colours are as per


the prototype

6/14/2010

CMC

12

The pie chart title is as per the prototype

6/14/2010

13

If I selected breakdown by initiativwe, there is


one pie chart for each initiative and one for
overall

Each widget number has a prefix of the major


version number and a dash e.g. "8-101"

Medium

Closed

6/24/2010

RJM

Select break down by attainment level

Select to include a pie chart


Request to generate the report

CMC: Have slightly changed the


segment colours as thought the Not
Relevant/Exmpt/Not Answered
segments were'nt clear.

Pass

GT - This may not be a defect but


should the key grade colours match the
atainment colours? E.g. Atainment
Level 2 Yellow equals Grade
Satisfactory Yellow as satisfactory is
level two and above?

CMC

Pass

GT - You mentioned colours have


changed however I'm not sure which
ones. Grade colour - Red appears to be
a slightly different red. You mentioned Not yet answered colour has been
changed this was previously grey and is
now pink.

6/14/2010

CMC

CMC: Note only a chart for an initiative Pass


if that initiative contains break down
for the main assessment, can be
instances where it isn't e.g. when
displaying historical initiative which no
longer exist for current assessments

6/14/2010

CMC

Done

Pass

The widget number has a prefix of the major


version number and a dash e.g. "8-101"

6/14/2010

CMC

Done

Pass

The widget number has a prefix of the major


version number and a dash e.g. "8-101"

6/14/2010

THMA

Each widget number on the contents page has a N


prefix of the major version number and a dash
e.g. "8-101"

6/14/2010

THMA

XSL updates available from Tony on


request

Pass

Each widget number on the individual widget


pages has a prefix of the major version number
and a dash e.g. "8-101"

6/14/2010

THMA

XSL updates available from Tony on


request

Pass

Each widget number on the list tab has a prefix


of the major version number and a dash e.g. "8101"

6/14/2010

THMA

Pass

Each widget number on the details tab has a


prefix of the major version number and a dash
e.g. "8-101"

6/14/2010

THMA

Pass

No prefixes on the req numbers

6/14/2010

CMC

Done

Pass

done

Pass

View the widget details for one of the


widgets

View the printable version (having done


a re-publish)
Pass

View the various widget booklets


(having done a re-publish)

View the widgets XL download

View the widgets list for a v7assessment

View the help page


There is an option to view the Improvement
Plannign help topic (order and wording as per
prototype)

6/24/2010

nili

Improvement Planning help topic displayed in


new window

6/24/2010

nili

Pass

5
6

Content as per prototype including images


Y
There is an option to print the page at the top of Y
the page (which triggers the standar print dialog)

6/24/2010
6/24/2010

nili
nili

Pass
Pass

There is an option to close the window at the


bottom of the page (which closes the window)

6/24/2010

nili

Pass

There is an option to view the Improvement


Planning help topic (style as per prototype)

6/24/2010

nili

Pass

Improvement Planning help topic displayed in


new window

6/24/2010

nili

Pass

There is an option to view the Improvement


Planning help topic (style as per prototype)

6/24/2010

nili

Pass

Improvement Planning help topic displayed in


new window

6/24/2010

nili

Pass

There is an option to view the Improvement


Planning help topic (style as per prototype)

6/24/2010

nili

Pass

Improvement Planning help topic displayed in


new window

6/24/2010

nili

There is an option to view the Organisation Types Y


help topic (order and wording as per prototype)

6/24/2010

nil

Organisation Types help topic displayed in new


window

6/24/2010

nili

Pass

5
6

Content as per prototype including images


Y
There is an option to print the page at the top of Y
the page (which triggers the standar print dialog)

6/24/2010
6/24/2010

nili

Pass
Pass

There is an option to print the page at the


bottom of the page (which triggers the standar
print dialog)

nili

Pass

There is an option to close the window at the


bottom of the page (which closes the window)

Request to view the Improvement


Planning help topic

1
2

Request to assign widget owners

Request to view the Improvement


Planning help topic

4
1

Go to improvement plan report page

Request to view the Improvement


Planning help topic

4
1

Go to improvement plan admin page

Request to view the Improvement


Planning help topic

4
1
2

View the help page

3
4

Request to view the help topic

Pass

nili: help page only seems to include


CTPs & XYZ BP's

Pass

6/24/2010

nili

Pass

There is an option to view the Organisation Types Y


help topic (style as per prototype)

6/24/2010

nili

Pass

View widgets org type chooser page

GT - There now appears to be multiple


piecharts each of these are current.

View the widgets list for a v8+


assessment

Have commented it out.

Request to create an assessment report

1e

Medium

Evidence Location dialog box


Fields:
Evidence Location dropdown
Uploaded File (Uploaded File)
URL (Internet/Intranet)
Fielname (Local File)
Details (Other)

Medium

1d

Widget Details screen


Fields:
Target Level
Target Date

Fail

done

11

1c

Fail

Pass

9
10

1b

EP - Retest failed
TH - you need a suffix "_ddlOrgTypes" on
the ID in the "for" field

Low

1a

Closed

Pass

Main

Medium

Pass

View various help topics

Logged in as ABC
Admin link
Organisation Admin link
Field:
Organisation Type dropdown

Des 18/06: Implemented

General User

Pass

High

View Help Topics

Closed

N/A

S190

Closed

Medium

Pass

1a

Medium

Admin link
My Password link
Fields:
Current Password
New Password
Confirm New Password

Low

6
7
8
9

Widget Number Prefix

Admin link
My Details link
Field:
Name (Forename Surename)

Pass

N/A

4
5

S206

Pass

Request to view the help topic

Column A needs to be a bit wider to


accommodate the wider text

EP - Retest failed
TH - need suffix "_txtName" in "for" field

4
1f

6/24/2010

nili

Pass

There is an option to view the Organisation Types N


help topic (not prototyped)

6/24/2010

nili

Pass

Organisation Types help topic displayed in new


window

6/24/2010

nili

Pass

There is a link to Assessment help for XYZs etc.

6/24/2010

nili

Pass

There is a link to Assessment help for Trusts etc.

6/24/2010

nili

Pass

There is a link to Assessment help for Social Care Y


etc.

6/24/2010

nili

Pass

The relevant help topic opens in a new window

6/24/2010

nili

Pass

Content as per prototype including images

6/25/2010

nili

Pass

There is an option to print the page at the top of Y


the page (which triggers the standar print dialog)

6/26/2010

nili

Pass

There is an option to print the page at the


bottom of the page (which triggers the standar
print dialog)

6/27/2010

nili

Pass

10

There is an option to close the window at the


bottom of the page (which closes the window)

6/28/2010

nili

Pass

The content is as per the prototype (needs


updating)

6/28/2010

nili

Pass

At the bottom there are links to the three


assessment help topics

6/28/2010

nili

Pass

Each link opens the relevant heop topic in a new Y


window

6/28/2010

nili

Pass

The following styles render as per the prototype


(see master_delta.css for definitions):
- p.screenshot
- #mainContent.helpPage h2
- #mainContent.helpPage h2.mainSubHeading

6/28/2010

nili

Pass

Organisation Types help topic displayed in new


window
View the "Create Organisation page" (as
an XYZ ABC user)

1g

3
4

Request to view the help topic

1
2

View the help page

5
6

1h

1i

S207

Upload Evidence Last


Chance Saloon

Organisation User Be less confused when


uploading evidence

Main

1
2

Click any of the three links

Link to quick start guide (under step 1


of 5) doesn't work - needs to open in a
new window - applies to all 3 help files

Medium

Closed

Not updated yet

Medium

Closed

Medium

Closed

Medium

Closed

View the quick start guide

View any of the help topics


Not yet done

From the widget details page, request to


specify evidence location

The system displays the Evidence Location popup

6/24/2010

done

Pass

The "Uploaded" option is changed to "Upload


File"

6/24/2010

done

Pass

Closed

Pass

TH: "Upload File" looks good when you


first go into the dialog, but it looks bad
in the evidence table back on the Req
Details page, and also not so good if
you go back into the Evidence pop-up
tyo edit it. Is it possible to make it
display as "Upload File" only if the file
hasn't already been uploaded and
"Uploaded" otherwise?

Pass

Upload a document as evidence and


click 'Done', then upload another piece
of evidence. When you get the dialog
box up the option in the 'Evidence
Location' dropdown says 'Uploaded'. For
a new piece of evidence it should state
'Upload File'

Closed

24/06 EP - RAISED INCORRECTLY

Closed

25/06 EP - WHAT I ACTUALLY MEANT TO Pass


WRITE WAS:

The "Local File" option is no longer available

6/24/2010

done

Pass

The "Upload New File" button is above the


"Uploaded File" drop-down

6/24/2010

done

Pass

The context help icon to the RHS of the "Upload


New File" button has tag
"evidenceLocationUploadNewFile"

6/24/2010

done

Pass

Tested by TH

The context help icon to the RHS of the


"Uploaded File" button has tag
"evidenceLocationUploadedFile"

6/24/2010

done

Pass

Tested by TH

The default option for Uploaded File is "[Select a


previously uploaded file]"

6/24/2010

done
EP - Only if one file is uploaded and
available to select

Pass

There is a context help icon to the RHS of the


Y
"View" button, tag evidenceLocationIntranetView
(intranet only, not internet)

6/24/2010

done

Pass

The context help file has been updated to cover


the new tags mentioend above

6/24/2010

done

Pass

5
6

10
11

Medium

Closed

After uploading one document as


evidence, click to add another piece of
evidence and select 'Uploaded' (which
should actually be 'Upload File' as per
previous defect). The 'Upload File' drop
down in the middle (where you can
select a file shows '[select a previously
uploaded file]'. By default this area
should show the file that has already
been uploaded i.e 'DOC.docx'

After uploading one document as


evidence, click on the pencil icon
against that 'Uploaded' status to open
the evidence location dialog box again.
the drop down in the middle should
show the uploaded document name
with the 'View' button enabled. It is
showing '[select a previously uploaded
file]' and the 'View' button is disabled.
You have to actually select the file in
the drop down to view it which is
wrong. Should show there by default.

Closed

Closed

Select "Upload File"


Closed

Closed

Select "intranet"

12

6/24/2010

Pass

Not specifically related to test above


but it's in this area.
I uploaded the same file in different
places:

Low

Closed

Req 102 - 1a
Req 102 - 1b
Req 102 - 2a

Better Call-Outs on Widget Organisation User Experience better call-out Main


Details Page
help on the Widget Details
page

View the widget details page within the


context of a (v8+) assessment
The system displays the "expanders" call-out (no N
change)

6/24/2010

Pass

Closed

The system does not display the "Attainment


Levels" call-out

6/24/2010

Pass

Closed

The system displays the "Attainment Levels" call- N


out

6/24/2010

done

Pass

Closed

The system displays a call-out on the expander


for Attainment Level 1 saying something like
"Click here to view the attainment criteria."

6/24/2010

done
Pass
EP - System automatically expands this
section

Closed

Instead of the warning pop-up, the system


displays a warning call-out (including the
standard "close" and "don't show me this again"
options

6/24/2010

done

Pass

Closed

Instead of the warning pop-up, the system


displays a warning call-out (including the
standard "close" and "don't show me this again"
options

6/24/2010

done

Pass

Close the "expanders" call-out

Expand the Attainment Levels section

Click an attainment level 1, 2 or 3

Click on an attainment criterion (as an


org type for whom evidence is "overall
mandatory"

Pass

Closed

The callout that states: (next to


attainment level 1)

Low

Closed

Low

Closed

Low

Closed

Expand this section to enter or edit


your answer to this attainment criteria.
Should say:
Expand this section to view and edit the
criteria for this attainment level.

Pass

The callout that states: (next to


criterion 1)
Expand this section to enter your
attainment criteria evidence.
Please change the message to read:
Expand this section to enter evidence
and comments.

S209

Odds and Ends 5

General User

See a range of random


and unrelated point
improvements across the
site

Main

Assessment report XLS - change the filename


suffix to format yyyy_mm_dd_hh_mm_ss so that
multiple saved files would appear in date order
in Windows Explorer

N/A

XYZ ABC users shouldn't really get the yellow


buttons on the Req List and Req Details pages

N/A

Rename the Assessments page to "Assessment


Summary". This should affect the <h1> tag and
also the breadcrumb

On the home page, relabel the "Go To The


Assessments Page" button to "Go To The
Assessments Section"

On the Req Details page, the label "Widget


Confirmed" needs to be "Widget Confirmed
Complete"

N/A

Low

Pass

N/A

Done

Pass

6/24/2010 N/A

Done

Pass

6/24/2010 N/A

Done

Pass

6/24/2010 N/A

Done

Pass

Change text on submission email from the


N
original:
You have successfully submitted your
organisation's Information Governance App (PQR
App) assessment.
To: Thank you for submitting your organisation's
Information Governance App assessment. Before
it is approved, you may be requested to supply
an Improvement Plan or clarification.

6/24/2010 N/A

Low

Pass

Changes to igt.widgets.css as per prototype file


igt.widgets.css_delta. In particular, this will
hopefully fix the problem that the font in the
header panel on the Req Details pags has
shrunk!

Done

Pass

Criteria preamble (class


Low
"attainmentLevelPrompt") and evidence
preamble (class
"attainmentCriterionPrompt") are now
too small

Closed

10

Update Organisation Type help page (see


prototype)

Low. CMC: Also changes so open all


help pages in a window without
toolbars etc

Pass

Dental Practice section, "PQR App view" Low


para - should be in italics.
EFG section - ditto (not bold).
Sorry, my fault - prototype was wrong.

Closed

11

Downloads page - large file size warning should


only be displayed for files larger than 1MB

N/A

Low

Pass

12

Rename What's New page to "News" - also


rename the Nav Bar menu too (the tooltip is OK
though)

7/5/2010 N/A

Low

Pass

Home page "What's New..." section


Low
should not have been changed - since it
only shows the last 4 articles. Don't
forget the ellipses either :)

Closed

13

Archive various articles on the "What's New"


page (see email from Magi Nwolie 28/06/2010)

7/5/2010 N/A

Low

Pass

N/A

N/A

7/5/2010 N/A

N/A

Richard has put "Widget Complete


Confirmed" instead of "Widget
Confirmed Complete"

EP - This info doesn't appear to even be


there anymore. Need to check if ok? RJM:
these items are being displayed ok now as
required. Dont understand above
comment?
EP - Forgot to actually click 'save' after
adding documents! Whoops!. All fine.

Then whilst uploading to 3a I noticed it


says it's already linked to widgets
102(a), 102(b). This should probably
say 102(1a), 102(1b), 102(2a). As it
stands it's missing one out.

S208

Very odd change request that makes no


sense and completely changes the way the
upload evidence works currently. Will take
several hours to do.
TH 25/6 - explained to RJM on the phone
and now understood and already fixed!

Closed

S214

S210

Odds and Ends 6

Misc Defects 2

General User

Developer

See a range of random


and unrelated point
improvements across the
site

Left over defects not yet


fixed

Main

Main

14

Bulk Email Create page - page loads and


N
immediately scrolls down to bottom - presume
bacsue default button is the Create button and it
wants to get it on the page. Can we change it
somehow so that the top of the page displays
initially

N/A

N/A

Low: CMC Is a more generalised issue Pass


in that Des made the yellow button the
default button by always focusing on it.
This causes the page to jump to the
button. Is also apparent in other
screens such as Contact Us etc. Also
can cause a problem on screens such
as Widget details where the first yellow
button is actually the Done button for
the evidence upload even though its
not shown. Have now fixed so that
yellow button should work consistently
across the site.

15

Assessment Report: if no reports available, put


message "No reports are currently available for
this organisation" instead of "This organisation
does not have any assessments you able to
report on" (requested by Alistair Donaldson; he
can't find anything more significant that needs
changing :)

N/A

N/A

Low

Pass

16

Knowledge Base search - below the keywords


input field add "(only shows results where
<strong>all</strong> keywords match)".
See prototype for styling

N/A

N/A

Low

Pass

Need "s" on the end of "show" and


need bold for "all"

Low

Closed

17

Improvement Plan and Evidence Report - add the Y


date - see prototype for wording and styling

N/A

N/A

Medium

Pass

Org name and date should be <h2> not Low


<h3>

Closed

18

Org type Prison Health Unit needs changing back N


to Prison Health (feedback from prison staff
apparently!)

N/A

N/A

Low. CMC: Changed wording in some Pass


help files as well (sent mail to TOHE to
update his opies)

20

Some KB docs are in .XLSX/.DOCX format and


N
need converting to XLS/DOC and re-publishing to
the toolkit (Magi to update RATty DB and convert
docs)

N/A

N/A

Medium

Pass

21

When increase browser text size, top menu links N


and nav bar links overspill. Not sure what the
best way is to fix this - make them fixed size?

N/A

N/A

Low: CMC Have fixed font sizes for


navigation headers etc as was
unuseable anyway if increased text
size

Pass

Nav bar items have grown slightly in


Low
font size and now Information Mapping
crashes into the current item marker at
the RHS

Closed

22

About page: update "Who has to carry out an


information governance assessment?" section content as per prototype.

N/A

N/A

Low: CMC, couldn't actually see any


difference ? Have also changed
breadcrumb so that when about is
accessed correctly shows Help._About
rather than Home->About, have done
the same for Contact Us and
Accessibility in the page header

Pass

TH: Sorry, my fault, hadn't copied the


prototype across to the shared drive.
Have a look at it now.

Closed

23

Widgets List page: link to downloads should not N


be displayed for a v7 or less assessment. At
some future point we will have to extend in
preparation for v9 (separate item added to scope
list for this).

N/A

N/A

Medium

Pass

24

ISO/IEC 27002:2005 - rename page to "BS ISO


27000 Series of Information Secuerity
Standards", including link on Resources page.
Breadcrumb can be shortened to "BS ISO 27000
Series"

N/A

N/A

Low

Pass

25

Quick Start Guide:


1) Change "hover" to "move" (3 places)
2) Change "picture" to "symbol" (1 place)
3) After 1st para ("The PQR App has been
designed...", add the following para: "It also
includes links to specific help on how to comple
an PQR App assessment." (no hyperlinks though
as we want to user to scroll through the page to
find the links!)

N/A

N/A

Low

Pass

26

Assessment report - preamble para - change


"RAG status" to "grade". Also on Report chooser
page

N/A

N/A

Low

Pass

27

Req Details page - add whitespace between "Add N


other edidence" and the context help icon. Ditto
"Add an action" and context help icon

N/A

N/A

Low

Pass

28

Evidence Location pop-up, Upload File option,


info message "Evidence files are stored on our
secure server...". Change text from bold red to
normal black by changing class from (I think)
"infoMessage error" to "infoMessage"

N/A

N/A

Low

Pass

29

Assessment Summary page: make the


assessment status larger - font-size 1.2em (see
prototype for styling)

N/A

N/A

Low

Pass

30

Reqt Owners page - add a Save button to the top N


as well as at the bottom. Also

N/A

N/A

Low

Pass

31

Req Owners page: Owner column: context help - N


change tag to "widgetOwnerEditable" and get
latest context help file

N/A

N/A

Low

Pass

32

Req Owners page - add a "Cancel" button which


returns to the Req List page without saving
changes

N/A

N/A

Low

Pass

33

Req Owners page - add white space between the N


table and the Save button. In the prototype I
have a class "buttons" defined in
master_delta.css

N/A

N/A

Low

Pass

34

Req Owners page - change table style to match


that on Req List page

N/A

N/A

Low

Pass

35

Req Details page - evidence bullet list - second


and subsequent lines need to be indented

N/A

N/A

Done by TH via chanegs to


igt.widgets.css

Pass

36

Downloads page - XLS download - change ".XLS" Y


to just "XLS"

N/A

N/A

Low

Pass

40

Further updates to Assessment Help (simplified


Y
and Social Care) as per email from TH to CMC on
19/07/2010 (ref. Magi)

N/A

N/A

Low

Pass

Info Mapping pages need styling e.g. Tabbed


control with no borders (ref. Niall)

N/A

N/A

Low

System Error page - make it not log the user out


if possible

N/A

N/A

Low

System Error page - in test environment only,


provide direct link to the error display page

N/A

N/A

Low

System Error display page - make the system


cauture and display date & time the error
occurred

N/A

N/A

Low

News Article page - change "Back to What's New Y


page" to "Back to News page"

N/A

N/A

Low

On the Assessments Page, click "Work on this


N
Assessment" before page properly loaded (in IE8)
gives an error "Validation of Viewstate MAC
failed". Suggested fix is to disable the buttons
until the page is fully loaded.

N/A

N/A

High

Pass

Problem in live, ok in UAT: Create new user. Once N


created, the user details are re-displayed for
editing. The breadcrumb says just "Edit" and you
can't easily get back to the list of users for that
org.

N/A

N/A

Medium

Pass

In live: create bulk email; add attachment; view


attachment - attachment not shown. Also click
save bulk email and get an error (says Des)

N/A

N/A

Medium

Pass

Improvement Plan Report - context help icon not N


being displayed

N/A

N/A

Low

Pass

Improvement Plan report - can't view evidence


files - get permissions error (when logged in as
XYZ ABC viewing evidence file from org code
RDE)

N/A

N/A

Medium

Pass

Assessment Report XLS - problems opening file


(unknown file type) in IE6/XL2002 -seems to be
worst when all three breakdown options are
ticked (OK if only tick one or two options). See
email from Magi 29/06/2010

N/A

N/A

High

Pass

Yellow buttons no longer yellow in Chrome

N/A

N/A

Low

Pass

Contact Us page: Tooltips for Org Name and Org


Code need changing (cut & pasted from
Telephone field)

N/A

N/A

Low

Pass

Updates needed to content of XYZ and Trust


assessment help as per prototype

N/A

N/A

Medium

Pass

CMC: Also made this change live

Closed

10

Contact Us email - no newlines between Org


Name, Org Type and content

N/A

N/A

Low

Pass

CMC: Fixed this issue and some other


issues with this page i.e. was showing
the Org type as the code

Closed

TH 6/7 couldn't re-test since original issue


came by way of a help desk call

11

Registration - step 6 - click "create account"


(thingy org type) and get system error

N/A

N/A

High

Pass

Closed

Fixed in UAT but problem still occurring in


live e.g. Org code FVG16 (Pearl Chemist)
TH 12/7: re-tested OK by user

12

Assessment Report criteria - when I tick or untick N


options there is a jitter which I think is due to
running a bit of javascript (maybe some ajax) to
update the "Compare With Previous" drop-down
contents. It makes ticking the boxes a bit tricky
and unpredictable, especially in IE6. The JS
doesn't need to fire on every field, just on the
Assessment Version one.

N/A

N/A

Low

Pass

Closed

14

KB items with links to toolkit e.g. Link to ISO


page don't work

N/A

N/A

Medium

Pass

26

Assessments screen N/A


Logged in as gp on UAT environment where gp
has a V8 plus some other previous versions. The
'reset' and 'submit' buttons aren't placed
correctly within the blue section of V8. They kind
of straddle the V8 and the previous V7 blue
section.

N/A

N/A

Low

Pass

28

Some knowledge base files are missing from the N/A


live site. Example: 4 x XLSX files in req't 8-401
including "XYZ Number standard_Training Review
Log.xlsx"

N/A

N/A

Done

Pass

30

GHJ Overview Report - assessment status column N/A


- should be "Not Started" as opposed to "Not
Answered"

N/A

N/A

Low

Pass

32

XL publish (when adding a new widget) needs to


include all widgets in the XL sheet, not just the
added one.

High

Pass

37

Widgets XLS: The "Description" column on both N/A


the Req List and Details tabs should containg the
Widget Question Text, not the Widget
Description.

N/A

N/A

Medium

Pass

Closed

38

Knowledge Base page - Widget dropdown is


empty

N/A

N/A

N/A

Medium

Pass

Closed

39

Improvement Plan Admin page - CC field N/A


context help not showing - checked source code
and I think the tag is wrong - should have a lower
case "c" at the end of
"improvementPlanReminderCc"

N/A

N/A

Low

Pass

Closed

43

Evidence upload - every time I save a widget it


N/A
updates the "date uploaded" for each associated
piece of evidence. The date uploaded should
remain as the date and time it was actually first
uploaded. Unless of course it is re-uploaded

N/A

N/A

Medium

Pass

Closed

44

Req Details page. Add an action, type enough


N/A
words to over fill the input box. Then add an
owner, then click on the calendar icon to add a
date. In IE7, the table becomes too wide to fit in
the surrounding DIV and disappears off the RHS.
In IE8, the whole left hand half of the main panel
disappears. See email from Rees Cox,
13/06,2010 - forwarded by Tony Heap to Chris
Clark on 13/06/2010

N/A

N/A

Medium

Pass

Closed

47

Req Details page: the key widget image should


be Key.gif, not Key.png

N/A

N/A

N/A

Low

Pass

Closed

48

On live organisation RXYZ, widget 207 try and


N/A
view evidence against criteria 1a and you get an
error.

N/A

N/A

High

Pass

Closed

50

a.test:acute - answer level 0 on all req'ts,


baseline, perf update, mark all req'ts complete
and confirmed, then confirm assessment, submit,
approve. Now unapprove, unsubmit, unconfirm.
Drill down to Req 99-101. Got a system error
"Object reference not set to an instance of an
object"

Pass

Closed

51

Req 8-210 needs to be a Key Req't - fix it with a


DB tweak

N/A

52

Evidence Location pop-up: using IE6 on Citrix,


select "Upload File". System displays "Loading"
message and progress indicator, but progress
indicator is not animated and the system does
not respond (waited for 10 minutes)

N/A

TH

CMC

Need to rebuild test

Closed

Changed wording in some help files as


well

Low

Spare " at the end of added para

Closed

Too much - I only wanted a single


space!

Closed

Closed

CMC: Tested this in live and couldn't


recreate all appeared fine so marking
as fixed

Withdrawn TH 6/7 couldn't re-create either!

Closed

CMC:Again appeared fine in live so


marking as Fixed

Closed

TH 6/7 needs testing in live (can't test in


sys test)

Closed

Need to test in live

Closed

6/7 tested OK in live

Closed
Closed

Closed
DEV - login details
p87639/elpe/4testing. Not found. Need
more info re browser version etc. Tested
with IE8/Chrome.

Closed

CMC:Cant re-create on local or UAT


enviroment. I wonder iof changes to this
screen have fixed this issue anyway so
marked as fixed
TH 13/7 assumed fixed without retest

EP - Thats cos UAT has been rebuilt.


You just need to setup another gp user
to test this with.

CMC

CMC

7/2/2010 N/A
N/A

N/A

Closed

Closed

THMA Re-working

Closed

tested by cmc

High

Pass

DB tweak done - PDF files need recreating

Closed

Medium

Pass

TH 14/7 Suspect this is a Citrix security


permissions issue so have asked user to
check it out with their IT people
(lyndaharris2@nhs.net; 01582 568935).
Awaiting a response

Withdrawn TH 23/07 Assumed client-side problem user never got back to us to confirm

S215

Misc Defects 3

Developer

Left over defects not yet


fixed

Main

53

In sys test, cannot upload any evidence files N/A


getting a virus checker error message (even for a
gif)

N/A

N/A

Low

Pass

Bulk email send failed in live (see log for details) N


- every 31st email address fails

N/A

N/A

Medium

Fail

Raised

On the Req Details page, if I have achieved 1a


but not 1b, the score should be 0, not blank.
More generally, only leave the score blank if I
have not yet achieved *any* criteria.

N/A

N/A

N/A

Low

Fail

Raised

Create new user (Simplified Interface) - when I


create the new user it shows (greyed out) the
Reviewer and User permissions but not the
Admin permission - this is a bit confusing
because the system then allocates them Admin
permissions, plus also Info Mapping Admin and
Info Mapping User. I can guess why it works this
way but it doesn't seem right.

N/A

N/A

N/A

Low
One for CC probably

Fail

Raised

Performance Progress Report - an PQRAF req't


which is NR or Exempt should have a green
background, not blue

N/A

N/A

N/A

Low

Pending

Raised

On UAT, as ABC user, view assessment for org


ctptest2. Unapprove it. The page is redisplayed
but the bottom of the blue box is missing.

N/A

N/A

N/A

Low

Fail

Raised

IE7, Req Details page - top nav not showing (it's


OK on other pages, just this one!)

N/A

N/A

N/A

CMC

Low

Pending

Raised

CMC:Was only occuring on those widgets


which didn't have a Training Tool section
entry.

Firefox 3.5.2: yellow buttons aren't yellow, unless N/A


you hover! Some problem in the CSS perhaps?

N/A

N/A

CMC

Low

Pass

Closed

Firefox has a whole heap of it's own quirks

FF 3.5.2: on an evidence item which has a


N/A
location of "[select]", upload an evidence file and
then go back to the Req Details page. The
location remains as "[select]" even though the
evidence is there if you open the pop-up again.
Clicking "Save" updates the evidence table so it
is correct.

N/A

N/A

CMC

Low

Pass

Closed

As above

FF 3.5.2: clicking "Add other evidence" or "Add


an action" doesn't work (sends you to the top of
the page but doesn't add a blank row for you to
fill in)

N/A

N/A

N/A

CMC

Medium

Pass

Closed

As above. There are many issues on


several pages with Firefox.

10

Firefox 3.6.3 - completed req't up to level 3 (did


level 3 first followed by 1 and 2) but Current
Level not populated

N/A

N/A

CMC

High

Pass

Closed

11

Performance Progress Report N/A


Interestingly, when I click on the 'Guidance' link,
the hyperlink line is removed underneath the
word 'Guidance' (although it is still a link)

N/A

N/A

Low

Fail

12

Performance Progress Report The Choose Assessment drop down - there is no


gap between that and the 'Contact' section
below

N/A

N/A

N/A

Low

Fail

Failed

13

Submit baseline (a.test:acute) - message says


"go to your version 7 widgets" - should say "go
to your version 99 widgets". Message for
performance update is correct

N/A

N/A

N/A

Low

Fail

Raised

14

Publish process - copying of files to web servers


is currently a manual process due to issues with
file permissions. Need to find a way of
automating this. Includes widgets, knowledge
base and glossary

N/A

N/A

N/A

Medium

Fail

Raised

15

Improvement Plan report: in live, using Chrome,


log in as XYZ ABC, select Improvement Plan and
Evidence Report, search for RDE, select Show
Report. The report window does not open.

N/A

N/A

N/A

Medium

Fail

Raised

16

Req Details page: the time uploaded for an


N/A
evidence file gets updated every time the widget
is saved. Obviously it should remain at the time
the file was actually uploaded

N/A

N/A

Low

Fail

Raised

17

Req Details page (IE6) - target date calendar icon N/A


wraps onto separate line

N/A

N/A

Low

Fail

Raised

18

About page, "Who has to carry out..." section, 1st N/A


bullet - "HS" should be "XYZ" (sorry, my fault prototype was wrong)

N/A

N/A

CMC

Low

Pending

Raised

19

In live (using Firefox): org NP201, req 206 - level


1 and 2 ticked but current level shows as blank.

N/A

N/A

N/A

CMC

Low

N/A

Withdrawn This is related to problem outlined in step


10

20

Firefox: yellow buttons not yellow (only yellow on N/A


hover)

N/A

N/A

CMC

Low

N/A

Withdrawn This is duplicate of step 7

21

Firefox: News page: RSS Feed logo on RHS too


low down

N/A

N/A

N/A

CMC

Low

Pending

Raised

22

Assessments page: logged in as nhscfh, view


N/A
assessments for a.test:acute when the v99
assessment is approved. Importantly, the main
content is shorter than the nav bar. Unapprove
the assessment. The main panel grows in length
and overflows into the footer. The main content
does not expand. I think this is because
somewhere in javascript there is a bit which sets
the main content height to the same as the nav
bar height if it is smaller (to avoid a pale blue
background) - i am guessing that this function
isn't being triggered when the page refreshes
with the unapproved assessment. The most
elegant solution to this would be to change the
main content background to white and get rid of
the height fixer function (but then again the
height fixer is in there for a reason...)

N/A

N/A

Low

Fail

Raised

23

The breadcrumb trail is unable to display the full N/A


trail path due to size limitation in the sites
design.

N/A

N/A

Low

Fail

Raised

24

Get error when viewing widgets details page


N/A
when not logged in if just open the page directly
from previously saved breadcrumb without
navigating through the site

N/A

N/A

Medium

Pass

Closed

25

Can mark a widget as exempt even though the


assessment is submitted

N/A

N/A

N/A

CMC

Medium

Pending

Raised

26

When a requrement has been exempted if you


clear the exemtpion although the reason for the
exemption is clared on screen it remains in the
database even after a save and so gets redisplayed even though the widget is no longer
exempt
With IE6 when expand the criteria for an
attainment level the display jumps and puts the
main display below the navigation header

N/A

N/A

N/A

CMC

Medium

Pending

Raised

N/A

N/A

N/A

CMC

Medium

Pass

Closed

27

S212

S178

User Friendly Error Page

New Org Type: Thingy HQ

General User

XYZ ABC User

Receive a user friendly


error message when a
system error occurs,
including a reference
number to help ABC
diagnose the problem

Set up Thingy HQ users

Main

Main

Do something to cause a system error

Sys Admin

Import relationships
between pharmacies and
pharnacy HQs from TDB

S180

View Thingy Reports as


Thingy HQ

Organisation User Be able to view


Main
Performance Performance
Reports of Pharmacies as
a Thingy HQ

Main

Assign Organisation
Auditor Role

Organisation
Admin

Assign the "Organisation


Auditor" role to users
within my organisation

Main

N/A

N/A

6/30/2010 done

Pass

The wording on the error page is


confusing - Do I click the error ID or
click the email link?

Medium

Closed

N/A

N/A

6/30/2010 done

Pass

No server code in sys test - suspect this Medium


needs configuring so I can re-test

Closed

The server code is "L" for Leeds or "E" for Exeter Y


followed by "W" for WWW server or "N" for N3
server e.g. "LW" or "EN"

N/A

N/A

6/30/2010 done

Pass

The system logs the details of the error to an


error log file, including the error reference as
displayed to the user

N/A

N/A

6/30/2010 done

Pass

When I click on the error ref the system Medium


creates an email to the help desk out of
the back of the system. This is probably
a bad idea since the error might be that
the system cannot send emails.
Perhaps would be better to do the
following: when the user clicks the help
desk email address the system opens
an outlook email with the error ref
already populated

Closed

Pass

I suspect that the error details are


being stored in the DB - this is a bad
idea since the error might be that the
DB is down. Rather it should send the
error details to an error log

Medium

Closed

Pass

Created a system error using the


facility provided for ABC users under
"admin".
Attempted to view the error using the
provided error viewer page but it gave
an error "Incorrect error reference
specified"

High

Closed

Pending

GT - When editing a users role, once


Low
updated the screen should either return
to the previous screen and/or provide
confirmation that the role has been
updated. Also the commas between
each role title are sepearated by an
extra space between each title e.g.
Organisation Administrator ,
Organisation Auditor , User admin
sceen needs a Cancel button.

Changed the error handling so that if it


cannot write to the database it outputs a
particular error message stating this.
Writing to log files etc can produce their
own errors anyway

Request to create a new organisation

Create a Thingy HQ org, using the


correct ODS code as already specified in
ODS - format is "Pxxx"

Request to create a new user for the org

One of the available org types is "Thingy HQ"

6/30/2010 N/A

There is only one possible role - "Organisation


Admin" or similar (model it on the healthcare
commission)

6/30/2010 N/A

There are *not* details of my assessment


N
There is *not* an Assessments option on the nav N
bar

6/30/2010 N/A
6/30/2010 N/A

There are *not* any reports related to


assessments for my organisation

6/30/2010

The system imports the parent/child


N
relationships between pharmacies and thingy
HQs from TDB, based on thingy HQ org code and
thingy org code

6/30/2010 N/A

There is a report "Thingy HQ Overview Report"

6/30/2010 N/A

The system asks me to select which version


assessment I want to report on (default most
recent as per GHJ overview report)

6/30/2010 N/A

The system displays a report on all pharmacies


belonging to the Thingy HQ. The content of the
report is as per the GHJ Overview report

6/30/2010 N/A

The system validates that I am *not* using the


simplified interface

6/30/2010 N/A

CMC

There is an option to give them a role


"Organisation Auditor"

6/30/2010 N/A

CMC

6
7

Log in as the new user

8
9

Request to view reports

Wait overnight

Log in as a thingy HQ user

2
3

Request to view reports

4
5

Select this report

6
7
8

Select version
Request to view reports

Request to create a new user for my


own organisation

EP - Retest failed 25/06

To view the error details logon as


nhscfh goto admin and then view
system error. On the page enter the
error reference to view the detail

The system displays an error reference code in


Y
the format "PQRT-<server code>-<ref number>"

RJM: Makes sense that if anything entered


mark as L0. Doesn't make sense that if 1a
changed but not 1b mark 0. What if 1a &&
1b are changed? What if level is NR or EX
when you change any of the other criteria?
TH: I agree so only leave the score blank if
I have not yet achieved *any* criteria.

Raised

The system displays the user friendly "system


error" page (see error.html in prototype)

S195

[tohe] Stylesheet change required for


"vsisted" style of the link

Import Thingy HQ
Relationships

Closed

S179

CMC

Works OK in UAT - problem is sys test


doesn't have Symantec installed - so
just need to fix in sys test env't

Give them this role

GT - Not sure on this - simplified


interface?

Pass

Raised

CMC:Have added a user updated message


to the screen. Also changed to remove
extra whitespace in role summary on user
summary screen. Have also added Cancel
button to User details screem

2a

1a

5
6

Create the user

1
2

I am using the simplified interface

3
4

Create the user

Request to create a new user for an


organisation (as an XYZ ABC user)

S196

Organisation Auditor
Permissions

Organisation
Auditor

Access existing functions


as appropriate to my
status

Main

S197

Mark Assessment As
Audited

Organisation
Auditor

Mark an assessment as
audited

Main

3
4

Go to the Widgets List page

Drill down to the Widget Details page for


an in-progress assessment

6
1

Go to the Assessments page

S213

Tri State Tick Boxes on


Widget Details Page

Forgotten User Details


Enhanced

Organisation User See "really" disabled tick


boxes as greyed out but
see "auto tick by system"
tick boxes as not greyed
out

General User

Main

Receive user details


Main
reminders for multiple
accounts and with a more
secure password reset
solution

6/30/2010 N/A

CMC

GT - Assessment, PPR and Improvement High


Plan Reports are all visible for my
organisation and PPR for other
organisations

Withdrawn CMC:Cannot re-create locally or on system


test will need to check with Gee what org
type he used etc.

GT - Assessment, PPR and Improvement High


Plan Reports are all visible for my
organisation and PPR for other
organisations

Withdrawn CMC:Cannot re-create locally or on system


test will need to check with Gee what org
type he used etc.

Pass

As an nhscfh user i am unable to tick


the "Exempt" box (it's greyed out)

Closed

Fail

Tick widget as complete - all attainment Low


level and criterion boxes grey out
The untick complete and the other
boxes correctly un-grey.
Tick as complete again then click Save
Now untick complete. Only Level 0
achieved ungreys - level 1,2,3 and
attainment criteria remain gray.
In the original spec we said that the
checkboxes would only ever go grey or
ungrey on save, but the current state is
somewhere in between, which is
probably a bit confusing for users

Pass

Pass
The widgets link was not visible for the
user with Organisation Auditor
permissions?

6/30/2010 N/A

CMC

Pass

PPRs and GHJ overvioew reports are not available N


to me

6/30/2010 N/A

CMC

Pass

Pass

Pass

System displays the Audit Details page


The following fields are available (all default to
blank)

Y
Y

7/5/2010
7/5/2010

CMC
CMC

Pass
Pass

- Assessment Audited (checkbox)


- Audit Date (date field)
- Scope of Audit (text area)
- Lead Auditor (text)
- Auditor Organisation (text)
- Auditor Address (text)
- Auditor Telephone (text)
- Auditor Email (text)

Y
Y
Y
Y
Y
Y
Y
Y

7/5/2010
7/5/2010
7/5/2010
7/5/2010
7/5/2010
7/5/2010
7/5/2010
7/5/2010

CMC
CMC
CMC
CMC
CMC
CMC
CMC
CMC

Pass
Pass
Pass
Pass
Pass
Pass
Pass
Pass

The system saves my changes


Y
The system displays the "Assessment Summary" Y
page

7/5/2010
7/5/2010

CMC
CMC

Pass
Pass

The assessment is marked as having been


audited

7/5/2010

CMC

My changes are not saved


Y
The system displays the "Assessment Summary" Y
page

7/5/2010
7/5/2010

CMC
CMC

Pass
Pass

For each assessment (current and past), there a


row in the "Headlines" table indicating whether
each assessment has been audited

7/5/2010

CMC

Pass

If an assessment has been audited, there is an


option to view the audit details

7/5/2010

CMC

Pass

System displays the Audit Details page


The system displays the same data as for the
auditor but it is all read-only

Y
Y

7/5/2010
7/5/2010

CMC
CMC

Pass
Pass

The system displays the "Assessment Summary" Y


page

7/5/2010

CMC

Pass

There is not an option to view the audit details

7/5/2010

CMC

Pass

Request to edit audit details

Mark the assessment as audited and


enter the audit data
Click "Save"

Click Cancel

Request to view audit details

7
8

Click Done

1
2

An assessment hasn't been audited

Story details TBC

Pass
GT - If you click cancel then no
amendments are saved

Go to the assessments page (as a user


who does not have the Organisation
Auditor role)

4
5
6

Indicate that I have forgotten my user


details

The system displays the "Forgotten User Details" Y


page

7/5/2010

CMC

Pending

3
4

The system asks for my email address


Y
The system does *not* ask me whether I want to Y
reset my password or not

7/5/2010
7/5/2010

CMC
CMC

Pending
Pending

The system tells me it will send me an email


including instructions on how to reset my
password (see prototype for wording)

7/5/2010

CMC

Pending

The system validates that the email address


matches exactly one user account

7/5/2010

The system sends an email to the specified email Y


address

7/5/2010

The email lists the following details for the


matching account:

10
11
12
13
14

Org name
Org code
User ID
User Role(s)
The email includes a link to follow to reset the
password

Y
Y
Y
Y
Y

7/5/2010
7/5/2010
7/5/2010
7/5/2010
7/5/2010

The link is unique to this request and not


guessable

N/A

7/5/2010

Enter my email address and click


"Remind Me"

The system tells me it has sent me an email (see Y


prototype for wording)

7/5/2010

18

The system opens the "Reset Password" page in


a new browser window

7/5/2010

19

The system validates that less than an hour has


passed since the email was sent

7/5/2010

20

The system displays my org name, org code and Y


user id

7/5/2010

21

The system asks me for my password and to


confirm my password

7/5/2010

22

The system displays details of the password rules Y

7/5/2010

24

The system validates my password (as per


current)

N/A

7/5/2010

25

The system resets my password to the new


password

N/A

7/5/2010

26

The system tells me it has reset my password

7/5/2010

1
2

Click on the "reset password" link in th


email

Enter my password (including confirm)

Password reset link timed out


The system tells me that the password reset has Y
expired and that I need to get another user
details reminder.

1
2
3

There is no matching account

There are multiple matching accounts

There is a link to the Forgotten User Details page

The system does not send an email


The system displays exactly the same message
as if it had sent me an email

N/A
Y

7/5/2010
7/5/2010

The system sends an email to the specified email Y


address

7/5/2010

The email tells me how many accounts are


registered to the same address

7/5/2010

The email includes a link to reset all passwords


at once

7/5/2010

The email lists details for all accounts (as per


Main Flow)

7/5/2010

The email puts "Account 1", "Account 2" etc.


above each set of account details

7/5/2010

The email includes a link to reset the password


on each individual account

7/5/2010

The system opens the "Reset Password" page in


a new browser window

7/5/2010

10

The system validates that less than an hour has


passed since the email was sent

7/5/2010

11

For each account to be reset, the system


displays my org name, org code and user id

7/5/2010

12

The system asks me for my password and to


confirm my password

7/5/2010

13

The system displays details of the password rules Y

7/5/2010

15

The system validates my password (as per


current)

N/A

7/5/2010

16

The system resets my password (on all accounts) N/A


to the new password

7/5/2010

17

The system tells me it has reset my password

7/5/2010

The system validates that I am able to register


online (no change)

N/A

The system displays step 3 and tells me i can


register online (no change)

N/A

The page includes a warning that I need to have


access to my email account to complete
registration. (see prototype for wording)

6/30/2010

The system sends an email to the supplied email Y


address

6/30/2010

The email content is as per the prototype


(register_7.html)

6/30/2010

The email contains a URL for the user to click

6/30/2010

9
10

The URL is unique and not guessable


N/A
The system displays "Registration Step 7 - Email Y
Validation"

6/30/2010
6/30/2010

The system validates that less than an hour has


passed since the email was sent

6/30/2010

14

11
12

12a

There is not an option to assign widget owners

CMC: Note this is only PPR report on


other organisations. Should still be
able to see it for own organisation

CMC

Main

CMC

CMC

Improve email validation


within the registration
process by sending an
email to the user and
forcing them to
acknowledge it

6/30/2010 N/A

7/5/2010

General User

PPRs and GHJ overvioew reports are not available N


to me

Pass

7/5/2010

23

Validate Email Address

CMC

17

S188

CMC

6/30/2010 N/A

16

7b

6/30/2010 N/A

There is an option to edit the audit details

15

7a

As per main flow (simplified interface check


N
applies to created user org type, not my own org
type)

For each assessment (current and past), there a


row in the "Headlines" table indicating whether
each assessment has been audited

18a

The Organisation Auditor role is not assigned to


the user

Pass
GT - This is displayed but the user has Pass
to browse back to the user admin page

3
4
5
6

2
3

S204

CMC

19

3a

CMC

6/30/2010 N/A

The widget answer is read only

Request to view reports

16
17
18

1a

6/30/2010 N/A

Log on as an Information Mapping User


or Information Mapping Admin (but not
org admin)

2
3

7
8
9
10
11
12
13
14
15

16a

The "Organisation Auditor" role is not displayed

Request to view reports

1a

System displays new user details including the


fact that they have the new role

Click on the "reset password on all


accounts" link in the email

Enter my password (including confirm)

Request to register an account, and


work through registration steps 1 and 2

At Registration Step 6, request to create


an PQR App account

Click the link in the email


N/A

13

The system creates the user account and sends N


account and password details in separate emails
(as per current).

6/30/2010

14

The system displays "Registration Step 8 N


Account Created" (NB ignore prototype which has
changed to due to story S211)

6/30/2010

An hour has passed since the email was


sent

N/A

N/A

N/A

N/A

Medium

Raised

S201

Publish Knowledge Base


Enhancements

Sys Admin

Be able to republish the


knowledge base without
wiping out links with
widgets

Main

1a

1b

3
4
5

Request to try again

In Meerkat, request to publish widgets

6/30/2010

There is an option to try again

6/30/2010

The system displays Registration Step 1

6/30/2010

The system does not publish the knowledge base N

N/A

N/A

Pass

The system publishes the widgets to the


database only (as per current), including
additions and uplifts to widgets

N/A

N/A

Pass

The system does not publish the widgetknowledge base links

N/A

N/A

Pass

The system does not publish any PDFs (and


therefore does not publish the PDF file names to
the database)

N/A

N/A

Pass

6
1

Enter my own password


during registration

Main

S192

Approve Bulk Email

XYZ ABC User

See roughly how many


users bulk emails will be
sent to

Main

Approve a bulk email to be Main


sent

Closed

TH retected still failed

19/07 TH retested still failed

Pass

N/A

Pass

The system publishes or re-publishes the widget- N


knowledge base links - this is a complete
replacement, so the old set of links is first
removed

N/A

N/A

Pass

The system republishes the full set of PDFs,


booklets and ZIPs for the current widget version

N/A

N/A

Pass

The system publishes or republishes the PDF and N


ZIP filenames to the database so that the
download links all work OK

N/A

N/A

Pass

The system republishes the full set of widgets


XLSs for the current widget version

N/A

N/A

Pass

Started RATty, didn't import data into


staging tables, ran XLS publish, RATty
crashed with no error message

Medium

Closed

Pass

Started RATty, did import data, didn't


publish data, ran XLS publish, got the
following error: "Publish failed & Rolled
Back with: Object cannot be cast from
DBNull to other types

High

Closed

Tried to publish XLS based on full RATty High


DB (not just a subset). Got the following
error: "A an item with the same key has
already been added"

Closed

1
2

Request to publish the widget PDFs

Request to publish the widgets XLSs

The system publishes or republishes the XLS


filenames to the database so that the download
links all work OK

N/A

N/A

Request to register an account, and


work through steps 1, 2 and 3
The system displays Registration Step 4
There is an option to enter my password
There is an option to confirm my password
The valid password rules are displayed

Y
Y
Y
Y

7/22/2010
7/22/2010
7/22/2010
7/22/2010

Enter user details


The system validates that I have entered a
password

7/22/2010

The system validates the password against the


PQRT password validation rules

7/22/2010

The system validates that I have confirmed my


password and that it matches the password I
entered

7/22/2010

10
11

The system displays Registration Step 5

7/22/2010

The system displays Regsitration Step 8


Content is as per prototype
The system sends me an email containing my
account details (but not my password) - content
as per registration_8.html

Y
Y
Y

7/22/2010
7/22/2010
7/22/2010

For each unsent email, the system tells me the


Y
approximate number of users the email will be
sent to, based on current user numbers and roles

7/22/2010

For each sent email, the system tells me how


Y
many users it was successfully sent to (captured
at the time of sending)

7/22/2010

For each sent email, if there were any email


failures, the system tells me how many users it
failed to send to (captured at the time of
sending)

7/22/2010

All emails that are not sent (and not approved)


are marked as "Draft" (state name change from
"Pending")

7/22/2010

System validates that I have the "Bulk Email


Approver" role (this is a role that can only be
assigned by the sys admin)

7/22/2010

There is an option to approve the email

7/22/2010

System saves my changes


System approves the email
System displays the bulk email list
The email is marked as approved
There is an option to view the email and an
option to delete the email (but not to edit it)

N/A
Y
Y
Y
Y

7/22/2010
7/22/2010
7/22/2010
7/22/2010
7/22/2010

The email is read only


There is an option to unapprove the email

Y
Y

7/22/2010
7/22/2010

The system sends all approved emails that are


on or past their send date

7/22/2010

The system does not send any draft emails

Work through registration to the point


where I have validated my email address

Request to view the list of bulk emails

View the bulk email list

3
4

5
6
7
8
9
10
11
12

13
14
15
16
17

16a

Published req data then published req High


PDFs. In web app, went to req list page
and got a system error "Item has
already been added. Key in dictionary:
'101' Key being added: '101'" screenshot sent to Tom

N/A

N/A

12
13
14

View Number of
XYZ ABC User
Recipeients for Bulk Emails

Closed

N/A

2
3
4
5
6
7

S193

High

The system publishes the knowledge base (as


per current)

Pass

Pass

General User

System error as sent to Tom

The system does not publish any XL sheets

Enter Own Password in


Registration

Closed

Request to publish the knowledge base

S211

Published new req't 102 to acute, went Medium


into web app, viewed req't and KB links
were there - they should not have been.

1c

The system tells me that my registration token


has expired (see prototype for wording)

18
1
2
3
4

Request to view a Draft bulk email

Make some changes to the email


Request to approve the email

View the email again

Wait overnight

7/22/2010

System unapproves the email (changes it back to Y


draft)

7/22/2010

System displays the bulk email list


The email is marked as draft

7/22/2010
7/22/2010

Request to unapprove the email

Y
Y

Actor Name
General User
Anonymous User
Logged In User
Organisation User

Description
Any user, whether logged in or not
Any user who is not logged in
Any user who is logged in
User responsible for basic operations within their organisation
e.g. entering widget responses

Organisation Reviewer User responsible for reviewing widget responses for their
organisation
Organisation
Administrator

User responsible for performing admin tasks for their


organisation

Organisation Auditor

User responsible to auditing assessments for a specific


organisation

XYZ ABC User

User within XYZ ABC responsible for performing various crossorganisation admin tasks

Sys Admin

System administrator

Story Point Count Summary


Increment Story Points Man Days Velocity
v8.0
v8.0
v8.0
v8.0
v8.0
v8.0
v8.0
v8.0

(i1)
(i2)
(i3)
(i4)
(i5)
(i6)
(i7)
(i8)

Total

30.75
47.00
58.00
48.00
50.50
37.00
22.50
13.00

29
60
59
70
59.5
37
69.5
37

1.06
0.78
0.98
0.69
0.85
1.00
0.32
0.35

306.75

421

0.73

Increment Total Story Total Man


Name
Points In
Days
Scope
v8.0 (i1)

30.75

29

Date

Estimated Total
Actual
Velocity
Story
Velocity
Points
Delivered
1.06

30.75

1.06

Week 1

Week 2

Story Points

Week 3

35
30
25
20
15
10
5
0

1/25/2010
1/26/2010
1/27/2010
1/28/2010
1/29/2010
2/1/2010
2/2/2010
2/3/2010
2/4/2010
2/5/2010
2/8/2010
2/9/2010
2/10/2010
2/11/2010
2/12/2010

Man Days Man Days


(Today)
(Cumulative)

1
1
1
1
1
0
0
3
3
3
3
3
3
3
3

1
2
3
4
5
5
5
8
11
14
17
20
23
26
29

10
5
0

Story Points Story Points


Story Points
(Est
(Actual Today) (Actual
Cumulative)
Cumulative)
1.06
2.12
3.18
4.24
5.30
5.30
5.30
8.48
11.66
14.84
18.03
21.21
24.39
27.57
30.75

0
2
3.75
0.5
2
0
0
0
5
0
2
0
5
2.5
8

0
2
5.75
6.25
8.25
8.25
8.25
8.25
13.25
13.25
15.25
15.25
20.25
22.75
30.75

Estimat
ed

0
0
0
0
0
0
0
0
0
0
2
2
0.5
0.25
2
0.5
0.5
0.25
0.25
0

Increment Total Story Total Man


Name
Points In
Days
Scope
v8.0 (i2)

47

60

Date

Estimated Total
Actual
Velocity
Story
Velocity
Points
Delivered
0.78

47

0.78

Week 1

Week 2

Week 3

Story Points

Week 4

50
45
40
35
30
25
20
15
10
5
0

2/15/2010
2/16/2010
2/17/2010
2/18/2010
2/19/2010
2/22/2010
2/23/2010
2/24/2010
2/25/2010
2/26/2010
3/1/2010
3/2/2010
3/3/2010
3/4/2010
3/5/2010
3/8/2010

Man Days Man Days


(Today)
(Cumulative)

0
2
4
4
4
5
5
5
5
5
4
4
4
4
4
1

0
2
6
10
14
19
24
29
34
39
43
47
51
55
59
60

15
10
5
0

Story Points Story Points


Story Points
(Est
(Actual Today) (Actual
Cumulative)
Cumulative)
0.00
1.57
4.70
7.83
10.97
14.88
18.80
22.72
26.63
30.55
33.68
36.82
39.95
43.08
46.22
47.00

0
0
0.5
2
0
0.5
7
6
9
0
2
2
0
8
6
4

0
0
0.5
2.5
2.5
3
10
16
25
25
27
29
29
37
43
47

Estimat
ed

ed

Increment Total Story Total Man


Name
Points In
Days
Scope
v8.0 (i3)

58

59
aim for

Date

Estimated Total
Actual
Velocity
Story
Velocity
Points
Delivered
0.98
0.8
47.2

58

0.98

Week 1

Week 2

Week 3

Story Points

Week 4

70
60
50
40
30
20
10

3/8/2010
3/9/2010
3/10/2010
3/11/2010
3/12/2010
3/15/2010
3/16/2010
3/17/2010
3/18/2010
3/19/2010
3/22/2010
3/23/2010
3/24/2010
3/25/2010
3/26/2010
3/29/2010
3/30/2010

Man Days Man Days


(Today)
(Cumulative)

4
3
3
3
3
6
5
5
5
4
4
5
4
4
0
0
1

4
7
10
13
16
22
27
32
37
41
45
50
54
58
58
58
59

40
30
20
10
0

Story Points Story Points


Story Points
(Est
(Actual Today) (Actual
Cumulative)
Cumulative)
3.93
6.88
9.83
12.78
15.73
21.63
26.54
31.46
36.37
40.31
44.24
49.15
53.08
57.02
57.02
57.02
58.00

0
0
0
0
0
0
5.5
6
3
8
0
17.5
2
1
3
0
12

0
0
0
0
0
0
5.5
11.5
14.5
22.5
22.5
40
42
43
46
46
58

Estimat
ed

Chris

Richard

1
1
1
1
1
1
1
1
1

Tom

0
1
1
1
1
1
1
1
1
1
1
1
1
1

Des

1
1
1
1
1
1
1
1
1
1
1
1
1
1

Niall

2
1
1
1
1
2
1
1
1
1
1
1

1
1
1
1

1
1
1

Estimat
ed

Increment Total Story Total Man


Name
Points In
Days
Scope
v8.0 (i4)

48

70
aim for

Date

Estimated Total
Actual
Velocity
Story
Velocity
Points
Delivered
0.69
0.75
52.5

48

0.69

Week 1

Week 2

Week 3

Story Points

Week 4

60
50
40
30
20
10

3/29/2010
3/30/2010
3/31/2010
4/1/2010
4/2/2010
4/5/2010
4/6/2010
4/7/2010
4/8/2010
4/9/2010
4/12/2010
4/13/2010
4/14/2010
4/15/2010
4/16/2010
4/19/2010
4/20/2010
4/21/2010
4/22/2010

Man Days Man Days


(Today)
(Cumulative)

0
3
4
4
0
0
5
5
5
7
5
5
5
5
7
5
3
1.5
0.5

0
3
7
11
11
11
16
21
26
33
38
43
48
53
60
65
68
69.5
70

30
20
10
0

Story Points Story Points


Story Points
(Est
(Actual Today) (Actual
Cumulative)
Cumulative)
0.00
2.06
4.80
7.54
7.54
7.54
10.97
14.40
17.83
22.63
26.06
29.49
32.91
36.34
41.14
44.57
46.63
47.66
48.00

0
0.5
1
3
0
0
0
2
0
1.5
0
5
3
2
12
3
6
6
3

0
0.5
1.5
4.5
4.5
4.5
4.5
6.5
6.5
8
8
13
16
18
30
33
39
45
48

Colu
mn L

Chris

Richard

0
1
1
1
0
0
1
1
1
1
1
1
1
1
1
1
0
0
0

Tom

0
1
1
1
0
0
1
1
1
2
1
1
1
1
2
1
0
0
0

Des

0
0
1
1
0
0
1
1
1
1
1
1
1
1
1
1
1
1
0.5

Niall

0
1
1
1
0
0
1
1
1
2
1
1
1
1
2
1
1
0
0

0
0
0
0
0
0
1
1
1
1
1
1
1
1
1
1
1
0.5
0

Colu
mn L

Increment Total Story Total Man


Name
Points In
Days
Scope
v8.0 (i5)

50.5

59.5
aim for

Date

Estimated Total
Actual
Velocity
Story
Velocity
Points
Delivered
0.85
0.75
44.625

50.5

0.85

Week 1

Week 2

Week 3

Week 4

Story Points

Week 5

60
50
40
30
20

4/19/2010
4/20/2010
4/21/2010
4/22/2010
4/23/2010
4/26/2010
4/27/2010
4/28/2010
4/29/2010
4/30/2010
5/3/2010
5/4/2010
5/5/2010
5/6/2010
5/7/2010
5/10/2010
5/11/2010
5/12/2010
5/13/2010
5/14/2010
5/17/2010
5/18/2010

Man Days Man Days


(Today)
(Cumulative)

0
2
3.5
4.5
4.5
3
2.5
3.5
4
5
0
2
2.5
3
4
3
3
3
3
2.5
0
1

0
2
5.5
10
14.5
17.5
20
23.5
27.5
32.5
32.5
34.5
37
40
44
47
50
53
56
58.5
58.5
59.5

Story

50
40
30
20
10
0

Story Points Story Points


Story Points
(Est
(Actual Today) (Actual
Cumulative)
Cumulative)
0.00
1.70
4.67
8.49
12.31
14.85
16.97
19.95
23.34
27.58
27.58
29.28
31.40
33.95
37.34
39.89
42.44
44.98
47.53
49.65
49.65
50.50

0
0
0
1
4
1
5.5
1
4
4.5
0
0
4.5
0
2
5
0
3
5
8.5
0
1.5

0
0
0
1
5
6
11.5
12.5
16.5
21
21
21
25.5
25.5
27.5
32.5
32.5
35.5
40.5
49
49
50.5

Colu
mn L

Chris

Richard

0
1
1
1
0.5
1
0.5
1
1
1
0
0
0
0
0
1
1
1
1
1
0
1

0
1
1
1
1.5
1
1
1
1
2
0
0
0
0
0
0
0
0
0
0
0
0

Tom

Des

0
0
0
0.5
0.5
1
1
1
1
1
0
1
1
1
1
0
0
0
0
0
0
0

Niall

0
0
1
1
1.5
0
0
0
0
0
0
1
1
1
2
1
1
1
1
1
0
0

0
0
0.5
1
0.5
0
0
0.5
1
1
0
0
0.5
1
1
1
1
1
1
0.5
0
0

Colu
mn L

Increment Total Story Total Man


Name
Points In
Days
Scope
v8.0 (i6)

37

37
aim for

Date

Estimated Total
Actual
Velocity
Story
Velocity
Points
Delivered
1.00
0.75
27.75

37

1.00

Week 1

Week 2

Story Points

Week 3

40
35
30
25
20
15
10
5
0

5/17/2010
5/18/2010
5/19/2010
5/20/2010
5/21/2010
5/24/2010
5/25/2010
5/26/2010
5/27/2010
5/28/2010
5/31/2010
6/1/2010
6/2/2010
6/3/2010
6/4/2010

Man Days Man Days


(Today)
(Cumulative)

0
2
3
3
2
2
3
3
3
4
0
2
4
3
3

0
2
5
8
10
12
15
18
21
25
25
27
31
34
37

10
5
0

Story Points Story Points


Story Points
(Est
(Actual Today) (Actual
Cumulative)
Cumulative)
0.00
2.00
5.00
8.00
10.00
12.00
15.00
18.00
21.00
25.00
25.00
27.00
31.00
34.00
37.00

0
0.5
1
0
2
0
2
2
7
5
0
5
5
0
7.5

0
0.5
1.5
1.5
3.5
3.5
5.5
7.5
14.5
19.5
19.5
24.5
29.5
29.5
37

Colu
mn L

Chris

Richard

0
0
1
1
0
0
1
1
1
1
0
1
1
1
1

Tom

0
1
1
1
1
1
1
1
1
1
0
1
1
1
1

Des

0
0
0
0
0
0
0
0
0
0
0
0
1
0
0

Niall

0
1
1
1
1
1
1
1
1
2
0
0
1
1
1

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

Increment Total Story Total Man


Name
Points In
Days
Scope
v8.0 (i7)

22.5

69.5
aim for

Date

Estimated Total
Actual
Velocity
Story
Velocity
Points
Delivered
0.32
0.75
52.125

22.5

0.32

Week 1

Week 2

Story Points

Week 3

25

20

15

10

6/7/2010
6/8/2010
6/9/2010
6/10/2010
6/11/2010
6/14/2010
6/15/2010
6/16/2010
6/17/2010
6/18/2010
6/21/2010
6/22/2010
6/23/2010
6/24/2010
6/25/2010

Man Days Man Days


(Today)
(Cumulative)

2
2.5
5
5
5
5
5
5
5
5
5
5
5
5
5

2
4.5
9.5
14.5
19.5
24.5
29.5
34.5
39.5
44.5
49.5
54.5
59.5
64.5
69.5

Story Points Story Points


Story Points
(Est
(Actual Today) (Actual
Cumulative)
Cumulative)
0.65
1.46
3.08
4.69
6.31
7.93
9.55
11.17
12.79
14.41
16.03
17.64
19.26
20.88
22.50

0
0
0
2
1
0
1.5
0
2
1.5
0
1
8
0.5
5

0
0
0
2
3
3
4.5
4.5
6.5
8
8
9
17
17.5
22.5

Colu
mn L

Chris

Richard

0
0.5
1
1
1
1
1
1
1
0
1
1
1
1
1

0
0.5
1
1
1
1
1
1
1
2
1
1
1
1
1

Tom

Des

1
0.5
1
1
1
1
1
1
1
1
1
1
1
1
1

Niall

1
0.5
1
1
1
1
1
1
1
1
1
1
1
1
1

0
0.5
1
1
1
1
1
1
1
1
1
1
1
1
1

Increment Total Story Total Man


Name
Points In
Days
Scope
v8.0 (i8)

15

37
aim for

Date

Estimated Total
Actual
Velocity
Story
Velocity
Points
Delivered
0.41
0.75
27.75

13

0.35

Week 1

Week 2

Week 3

Story Points

Week 4

16
14
12
10
8
6
4
2
0

6/28/2010
6/29/2010
6/30/2010
7/1/2010
7/2/2010
7/5/2010
7/6/2010
7/7/2010
7/8/2010
7/9/2010
7/12/2010
7/13/2010
7/14/2010
7/15/2010
7/16/2010
7/19/2010
7/20/2010
7/21/2010

Man Days Man Days


(Today)
(Cumulative)

1
4
4
3
2
2
2
2
2
0
2
2
2
2
2
1
2
2

1
5
9
12
14
16
18
20
22
22
24
26
28
30
32
33
35
37

8
6
4
2
0

Story Points Story Points


Story Points
(Est
(Actual Today) (Actual
Cumulative)
Cumulative)
0.41
2.03
3.65
4.86
5.68
6.49
7.30
8.11
8.92
8.92
9.73
10.54
11.35
12.16
12.97
13.38
14.19
15.00

0
0
1
1
0
5
0
0
0
0
0
0
0
0
0
0
0
6

0
0
1
2
2
7
7
7
7
7
7
7
7
7
7
7
7
13

Colu
mn L

Chris

Richard

0
1
1
1
1
1
1
1
1
0
1
1
1
1
1
1
1
1

Tom

0
1
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0

Des

0
1
1
1
1
1
1
1
1
0
1
1
1
1
1
0
1
1

Niall

1
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

Colu
mn L

Você também pode gostar