Você está na página 1de 20

MOBILE TEST

PLAN OUTLINE
A s you may have already guessed, mobile is here to stay.
Not only is it here to stay, it will become more and more
becomes even more important.

Because of this and due to popular demand, we've updated our


prevalent in our daily lives as the Internet of Things (IoT) and
Wearables interface with mobile to give us access to and control mobile test plan, now in Version 4 as an outline because the
more than we could ever imagine. Most IoT and wearable intention is to provide a flexible guideline for you to pick and
devices cannot stand alone, but must connect to a mobile choose those sections or components that apply most to your
smartphone, and therefore, the quality of mobile applications mobile application and context.

In Section 1...
We've depicted test categories in a mobile application:

• COLUMN 1 depicting the general test category.

• COLUMN 2 represents a testing area within the test category.

• COLUMN 3 shows general use cases that you can use as a foundation for more detailed use cases,

In Section 2...
We've listed out checkpoints for all apps preloaded on mobile:

• COLUMN 1 shows the functional breakdown for preloaded apps or utilities and functions on a mobile phone.

• COLUMN 2 has an explanation or description as necessary.

SECTION ONE

TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

INSTALLATION Install app via link (i.e. iTunes) CRITICAL


1. App can be conveyed from hyperlink.

2. App can be successfully installed and no major software


components are missing.

MEDIUM
3. Same app or old version can be detected if app exists.

LOW
4. Splash screen design is desired.

XBOSOFT.COM 1 CONTACT US AT SERVICES@XBOSOFT.COM


1
TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

INSTALLATION Install app via download internet CRITICAL


link (i.e. Web app store) 1. App can be conveyed from hyperlink.

MEDIUM
2. App can be successfully installed and no major software
components are missing.

3. Same app or old version can be detected if app exists.

LOW
4. Splash screen design is desired.

EXPLORATORY Launch application in target language CRITICAL


TESTING 1. Text are translated to target language instead of incorrectly
translated to another language.

2. The target audience can interact with all primary controls with
the anticipated input anatomy.

HIGH
3. Optional functionality can be interacted with anticipated
input anatomy.

MEDIUM
4. The primary functionality can be interacted with related input
anatomy as might be encountered with special needs persons.

LOW
5. The primary functionality can be interacted with using
alternate input methods such as voice, visual interpretation tools.

Ensure that application starts up CRITICAL


properly on launch 1. The app launches in the sequence and manner as expected
by end user.

HIGH
2. Performance on legacy hardware is acceptable.

MEDIUM
3. Any 3rd party applications that launch this app (i.e. from
browser or social networking), can access and launch as expected.

LOW
4. Friendly and desired use of splash screen.

Check that orientation is correct CRITICAL


on launch 1. Launch flow can go to correct locations.

2. The app functionality works according to design when


interacting with external applications such as contacts,
email, Settings data.

XBOSOFT.COM 2 CONTACT US AT SERVICES@XBOSOFT.COM


1
TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

EXPLORATORY Check for application stability CRITICAL


TESTING 1. App can run under low battery power.

2. The app can be recovered from a force quit scenario.

HIGH
3. App data can be restored to a usable state after power
removal, reboot and relaunch.

MEDIUM
4. App can run under recharged power.

5. App data can be recovered from a force quit scenario.

6. App can be recovered properly after sleep.

7. Performance is maintained when in low battery status.

Launch and close 5-10 times or more CRITICAL


1. App can be launched and closed without error.

2. App works as expected.

Install app in different location CRITICAL


other than default 1. App can be installed in the specified locations.

Download an update LOW


1. Update can be downloaded and installed successfully.

2. Original data (i.e. pwd) can be inherited by new app version.

Check graphics appearing in: LOW


1. Using high resolution graphics for retina display.
a) Splash/Title/Logo/
Loading Screen

b) Main Menu and all its


subsidiary menus

c) Help/Instructions Screen(s)

d) About screen

e) Application Pause Menu


and all its subsidiary menus
(if present)

Phone should indicate via HIGH


notifications of updating or other 1. User can set if receive the push from the app; if receive, user
information from the app can receive notification of app.

XBOSOFT.COM 3 CONTACT US AT SERVICES@XBOSOFT.COM


TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

EXPLORATORY App can accurately use CRITICAL


TESTING geolocation information 1. Accuracy of 3G, 4G, LTE or WiFi to find correct location.
from the phone
MEDIUM
2. Location information can be read by app.

Uninstallation CRITICAL
1. App can be Uninstalled smoothly.

LOW
2. Uninstallation app > search, scan for remnant data -
No sensitive data left.

Install when disk is full CRITICAL


1. This scenario should not cause data loss.

MEDIUM
2. Friendly notification indicates to user 'installation cannot
be executed'.

SPELLING ERRORS The application must be free of CRITICAL


spelling errors 1. All major headings, section and other primary text is
spelled correctly.

HIGH
2. All secondary areas of text such as annotations, etc.
spelled correctly.

MEDIUM
3. Standard conventions used for abbreviations.

A spelling error is defined as a strict CRITICAL


misspelling of a word (no grammar or 1. All major verbiage is grammatically correct.
punctuation rules will be applied).
Missing diacriticals and accents (e.g. HIGH
acutes, cedillas, umlauts etc.) will not 2. All secondary verbiage is grammatically correct.
be reported as spelling errors

TECHNICAL The text in the application must be CRITICAL


TEXT ERRORS clear and readable 1. Translation will not cause end user to misunderstand
meaning of the text.

2. All text can be read by someone with typical 20-20 vision


at a distance of 18 inches.

LOW
3. Current translation is correct and understandable by the end
user. Target text can have improvement suggestions.

XBOSOFT.COM 4 CONTACT US AT SERVICES@XBOSOFT.COM


TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

TECHNICAL The application must be free of CRITICAL


TEXT ERRORS technical text display issues such 1. Text displays gracefully without truncation/overlapping.
as: Text cut off / Text overlapping

APPLICATION The application should never CRITICAL


RESPONSE leave the user in a position where 1. Application works gracefully without crash.
the state of the application is
unknown or appears to be
unresponsive (i.e. may have
locked up)

SPEED & The application works in the device CRITICAL


PERFORMANCE it was targeted for. It is usable on the 1. App speed is steady and optimal for user usage.
device. The speed of the application
is acceptable to the purpose of the HIGH
application and must not alter the 2. App can work at low connection speeds or show friendly
user experience by being warning to user for 'low connection speed'.
uncontrollable

UNEXPECTED The application must be able to CRITICAL


BEHAVIOR handle unexpected user behavior, for 1. App will pop notification message or voice to indicate user's
example erroneous actions and improper behavior instead of crash.
multiple key presses
HIGH
2. Error reports sent properly.

MEDIUM
3. Prompt for customer rating.

CONFLICT/ An incoming call/video call CRITICAL


INTERRUPTS while using app 1. App is functioning correctly as other apps are trying to interact
with it's functionality.

2. Incoming app will not cause data loss or get stuck on current app.

An incoming SMS while using app CRITICAL


1. App functionality is working according to design when
interacting with external applications such as calling, email, SMS,
Printing, etc.

• Pause and launch music/movie player 1. App is functioning correctly as other apps are trying to interact
• Pause and launch camera with it's functionality.
2. Incoming app will not cause data loss or get stuck on current app.
• Pause (or not pause) and launch
another app

Low battery when using app LOW


1. Should maintain performance during low battery state.
2. If battery level cannot support app functionality, app will
notify user.

XBOSOFT.COM 5 CONTACT US AT SERVICES@XBOSOFT.COM


1
TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

CONFLICT/ Plug or unplug USB when LOW


INTERRUPTS using app 1. USB plugging/unplugging will not disturb application process.
2. USB can be plugged or unplugged smoothly when using app.

Change USB connection CRITICAL


when using app 1. USB connection can be changed among 'Mass storage mode',
'Charge-only mode' or 'camera mode' (depends on mobile
type, NA for iOS).

HIGH
2. Picture or portrait etc. info could be recovered from
inaccessible status in 'Mass storage mode'.

Close/Lock screen and open CRITICAL


when using app 1. Automatically close/Lock screen will not cause data loss of
current app.

HIGH
2. User can Close/Lock and open screen smoothly when using app.

Close/Shutdown mobile CRITICAL


before quit app 1. The app can be recovered from a force quit.

HIGH
2. App data can be recovered from a force quit.

LOW
3. Sensitive info like password will be erased after force quit.

Minimize the app to status bar LOW


and launch it 1. App can be minimized to status bar or launched smoothly.

Switch to another app, then launch 1. User can switch to another app smoothly.
this app from status bar again 2. App can be resumed (or just relaunched) when it is switched back.

Force close the app and re-launch it. CRITICAL


1. The App can be recovered from a force quit.

HIGH
2. App data can be recovered.

MEDIUM
3. Sensitive info (i.e. pwd) will be erased when relaunch
APP force quit.

LOW
4. Saved data will not be lost due to force close.

Lose network connection CRITICAL


during usage 1. App will not crash when there is sudden loss of connection.

XBOSOFT.COM 6 CONTACT US AT SERVICES@XBOSOFT.COM


1
TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

CONFLICT/ Lose network connection CRITICAL


INTERRUPTS when using, and return 1. App process will slow down or pause when lose network.
without time out
2. App process can be resumed automatically when connection
returns without time out.

LOW
3. Saved data will not be lost from connection loss.

Lose network connection when CRITICAL


using, and return with time out 1. App process will slow down or pause when lose network
connection.

2. Friendly warning should pop up to indicate 'network


connection time out' .

3. App can be resumed by refresh after connection return


with time out.

LOW
4. Saved data will not be lost from connection loss.

STORAGE Disk usage CRITICAL


1. Disk usage dynamically reflects the disk storage status.

2. Disk usage should have chart and number to indicate


current usage status - 'pictures, videos', 'downloads',
'miscellaneous files', 'available space'.

3. Phone can alter/delete related files (pictures, videos,


downloads) by clicking storage data.

Memory usage CRITICAL


1. Memory usage dynamically reflects the mobile memory
storage status.

2. Disk usage should have graphical chart and number to


indicate current usage status - 'available space', 'total space'.

Run app for long time CRITICAL


continuously and check 1. Memory usage will change dynamically along
memory usage/leakage with app running.

Use when disk is full CRITICAL


1. Disk is full will not cause saved/existing data loss.

LOW
2. Friendly warning message will pop up to indicate disk is full.

Save/Load process when in use CRITICAL


1. Page can be saved/load smoothly when app is in use.

XBOSOFT.COM 7 CONTACT US AT SERVICES@XBOSOFT.COM


1
TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

STORAGE Synchronize with computer CRITICAL


(if applicable) 1. User can set multi accounts (icloud, Skype, Facebook, etc.)
on mobile to synch with computer.

MEDIUM
2. Data can be synched between app and online account.

3. Data will be updated/deleted in mobile/computer


when to do so in computer/mobile.

LOW
4. Saved data will not be lost if connection is not
available suddenly.

The application must indicate CRITICAL


whether data will be permanently 1. The remnant data will be read by app when reinstall
deleted or offer easy reversal of app again after deleting.
the deletion
HIGH
2. User can choose if clean remnant data after deleting.

MEDIUM
3. All sensitive data should be deleted when delete app.

Ensure updates do not LOW


corrupt current saved data 1. Saved data can be read by app again after upgrading.

MEDIUM
2. Login persists when upgrading app to a newer version.

Transfer files between internal 1. Not for iOS.


storage and expanded storage

SIGNAL AND Using with 3G signal CRITICAL


NETWORK 1. '3G' label is shown on the GPRS signal when using with 3G.
PERFORMANCE
Using with 4G signal CRITICAL
1. '4G' label is shown on the GPRS signal when using with 4G.

Using with LTE signal CRITICAL


1. 'LTE' label is shown on the GPRS signal when using with LTE.

Using in signal handover 1. Check the app’s behavior as expected during


environment (e.g. handover network handover.
in 2G & 3G & 4G)

Using with WIFI signal MEDIUM


1. Mobile can connect with network and then upload/download
file through WIFI signal.

2. App speed will be affected by WIFI signal.

XBOSOFT.COM 8 CONTACT US AT SERVICES@XBOSOFT.COM


1
TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

SIGNAL AND Verify Bluetooth transfer and CRITICAL


NETWORK connections (if applicable) 1. Mobile can edit 'device name' and set name 'visible/invisible'
PERFORMANCE in Bluetooth settings.

2. Mobile can pair with other Bluetooth device by searching


'device name' or matching 'match code'.

3. Mobile can transfer files with different device in valid distance.

LOW
4. Friendly notification 'can not find device', 'wrong match code'.

Use with intermittent signal MEDIUM


1. Intermittent signal will not cause data loss of app.

Using under weak/no signal (such CRITICAL


as in high speed car, basement) 1. App performs the primary function end to end when in motion.

HIGH
2. All app screens can be navigated while in motion.

MEDIUM
3. App performs well instead of crash in elevator.

LOW
4. App performs well instead of crash through tunnel.

Using when switching between 1. Network related app.


WLAN and mobile network

Check GPRS data usage HIGH


1. User can enable/disable GPRS data in Settings.

LOW
2. User can view how data is used for all applications.

3. User can set limit or warning value for GPRS data usage.

Application that uses network HIGH


capabilities must be able to 1. Friendly warning message should pop up when connection
handle situations where the is not allowed.
network connection is
not allowed 2. App still performs well without connection.

Application that uses network HIGH


capabilities must be able to 1. App process will slow down or pause when lose network connection.
handle delays and any loss
of connection 2. Friendly warning should pop up to indicate 'network connection
time out' .

3. App can be resumed by refresh after connection return with time out.

XBOSOFT.COM 9 CONTACT US AT SERVICES@XBOSOFT.COM


1
TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

SIGNAL AND Application that uses network LOW


NETWORK capabilities must be able to use 1. App will not use network bandwidth after closing app.
PERFORMANCE the connection correctly and
correctly close it after using it

USER Check all Function keys on mobile CRITICAL


INTERFACE for both touch screen and 1. App can recognize typical user interaction with fingers.
keyboard
HIGH
2. Tap and key should be sensitive to user's touch.

MEDIUM
3. Path of least resistance for common actions. 2-3 touches away.

Check UI consistency CRITICAL


1. All usages of app name and other branding are used
consistently throughout the app.

HIGH
2. Minimal number of colors are used in an appealing array.

LOW
3. Consistent use of fonts.

From very small to tablet size LOW


screens, check UI for incorrect 1. UI should adapt smoothly without freezing and crash.
handling of components

When zooming in or out, check LOW


UI for incorrect handling of 1. UI should adapt smoothly without freezing and crash.
components

Check each input methods: both CRITICAL


touch screen and keyboard 1. User can interact with all primary controls with the anticipated
input behavior.

HIGH
2. Optional functionality is intiated with anticipated input
behavior.

MEDIUM
3. Primary functionality can be initiated with related input
behavior as might be encountered with special needs persons.

LOW
4. Primary functionality can be initiated with using alternate
input methods such as voice, visual interpretation tools.

5. Phone numbers can be dialed using touch conventions.

XBOSOFT.COM 10 CONTACT US AT SERVICES@XBOSOFT.COM


TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

USER Check each input methods: both CRITICAL


INTERFACE touch screen and keyboard 1. User can interact with all primary controls with the anticipated
input anatomy.

HIGH
2. Optional functionality is interacted with anticipated input
anatomy.

MEDIUM
3. Primary functionality can be interacted with related input
anatomy as might be encountered with special needs persons.

LOW
4. Primary functionality can be interacted with using alternate
input methods such as voice, visual interpretation tools.

5. Phone numbers can be dialed using touch conventions.

Check 4/5 finger gesture CRITICAL


scrolling if available 1. Mobile can recognize different kinds of scrolling gesture.

MEDIUM
2. Primary functionality at edge of user's thumb.

Check swiping consistency CRITICAL


and awareness 1. Operate gesture for app is common with common gesture.
Like minimize, maximize, etc.

Check that Game Center feature CRITICAL


functions if available 1. App can read link/info from Game Center app.
2. App can share/send info to Game Center app.

LOW
3. Sensitive data won't be lost by sharing/interaction with Game Center.

Check that Facebook feature CRITICAL


functions if available 1. App can read link/info from Facebook app.
2. App can share/send info to Facebook app.

LOW
3. Sensitive data won't be lost by sharing/interaction with Facebook.

Check that Twitter feature CRITICAL


functions if available 1. App can read link/info from Twitter app.
2. App can share/send info to Twitter app.

LOW
3. Sensitive data won't be lost by sharing/interaction with Twitter.

Check that the e-mail functions CRITICAL


if available 1. App can alter to e-mail app to send e-mails.

XBOSOFT.COM 11 CONTACT US AT SERVICES@XBOSOFT.COM


1
TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

COMPATIBILITY Run on different OS HIGH


1. App can provide minimum OS Support on different OS.

2. App can support optimal OS performance.

Run on different devices HIGH


1. App functionality is consistent on different devices.

Change mobile's time/ HIGH


time zone/date 1. User can set mobile's time/time zone/date manually.

2. User can synch mobile's time/time zone/date with the


network.

Check after update OS/firmware MEDIUM


1. Saved user data will not be lost after OS/firmware update.

2. Original data can be read by updates.

Switch to different languages CRITICAL


1. All text can be switched to target language without mistakes.

LOW
2. Display style should follow target language style guide.

Update the app version MEDIUM


1. Saved user data will not be lost after app update.

LOW
2. Login information other than PW persists when upgrading
app to a newer version.

Run a similar app simultaneously 1. Check if the app still works and there is no conflict for resources.

OTHER Find-ability/Usability for all items CRITICAL


1. All text can be read by someone with 20/20 vision at a
distance of 18 inches.

2. The text is distinguished from the background image.

3. Items works well.

Response time for each critical


tasks (performance)

File format support MEDIUM


1. App can handle with Large Files or provide friendly warning to user.

LOW
2. App can handle many files in sequence when required.

XBOSOFT.COM 12 CONTACT US AT SERVICES@XBOSOFT.COM


1
TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

OTHER Error prevention and detection MEDIUM


1. App can provide friendly notification message or sound for
user's mistaken operation.

The application must be able MEDIUM


to handle the cases where the 1. App can notify user related 'Personal Information
connection to the PIM Management' (messages, contacts, pictures) is not readable.
applications is not allowed
LOW
2. App works well after failure to read PIM applications
(Messages, Contacts, Pictures).

When connections are used, CRITICAL


encryption is used for sending / 1. When using password with network, password will
receiving sensitive data be encrypted.

Cross App Interaction - Outgoing CRITICAL

Exiting CRITICAL

App is testable CRITICAL

ITEMS TO CHECK THAT ARE THE SAME


FOR DESKTOP AND MOBILE

LOGIN/LOGOUT Login with correct/wrong password MEDIUM


1. User is required to input other authentification after correct
password if required.

2. User is warned 'invalid password' after input wrong


password.

Login with other ways MEDIUM


1. If user links phone number with phone, user can login
via SMS.

LOW
1. For a specific device, such as an iPhone X, user can log on
through optical scanning.

2. User may login through Voiceprint.

Login on multiple devices MEDIUM


1. User login through enter password.

2. User may login through scan QR code.

XBOSOFT.COM 13 CONTACT US AT SERVICES@XBOSOFT.COM


1
ITEMS TO CHECK THAT ARE THE SAME
FOR DESKTOP AND MOBILE

LOGIN/LOGOUT Logout LOW


1. Password will be erased after logout if user didn’t choose
‘remember password’ option.

2. Password will stay in password field after logout if user


chooses ‘remember password’ option.

Change password MEDIUM


1. User can change password by clicking ‘forget password’ link
before login. User will set new password through 3rd party or
email application.

2. User can change password in application settings after login.


User can set new password by inputting original password.

TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

LOGIN/LOGOUT Password display (Encryption) MEDIUM


1. Password will be encrypted by choosing 'invisible' for
password display.

2. Password will not be encrypted by choosing 'visible' for


password display.

Security validation MEDIUM


1. App will send security validation if detects high risk behavior.

2. User can get security information through registered email or


other means.

Logout and Login with CRITICAL


multiple accounts 1. User can create more than one account on mobile device.

HIGH
2. Data will not be mixed up with multiple accounts.

LOW
3. User can switch accounts smoothly.

WEBSITE Launch by different browsers CRITICAL


if needed 1. App can be launched by different browsers.

LOW
2. UI and function will be the same for apps from different browsers.

XBOSOFT.COM 14 CONTACT US AT SERVICES@XBOSOFT.COM


1
TEST CATEGORY TEST AREA GENERIC USE/TEST CASES

WEBSITE Check the look time and load time MEDIUM


1. Time to load first characters or images (look time) and load
time (time to load entire page) should be equivalent between
mobile and web page, and congruent with user expecations
based on amount of content displayed.

Check consistency between MEDIUM


mobile site and regular website 1. Context should be consistent between mobile site
and regular website.

Launch different version CRITICAL


of browsers 1. App can be launched by different browser versions.

LOW
2. UI and function will be the same for apps from different
browser versions.

TEXT ENTRY Switch different input methods CRITICAL


1. App works gracefully when switching different input methods.

Check association for each HIGH


input method 1. Input method can suggest proper words/phrase according to
user's input.

SECTION TWO

FUNCTIONAL AREA COMMENTS

ACCESSORY INTEROPERATION i.e. Bluetooth headset:


1. Manage accessories info in Settings (Name, Description, on-off).
2. Accessory performance in poor connection situation (low signal, far distance).
3. Interaction with other app (Calling, voice Messaging, FM Radio).
4. Compare common controls with other similiar accessaries.

ALBUM/PHOTO APP

BATTERY & CHARGING

BROWSER

BLUETOOTH

CALCULATOR

XBOSOFT.COM 15 CONTACT US AT SERVICES@XBOSOFT.COM


1
FUNCTIONAL AREA COMMENTS

CALL HISTORY

CAMCORDER

CLOCK/ALARM

CONTACTS

DRM 1. <Digital Rights Management> Audio and Video files.

EMAIL

FM RADIO

GPS

INPUT METHOD

MASTER RESET

MESSAGING (SMS/MMS)

MULTIMEDIA

SEARCH

SENSORS

SETTINGS

SOUND RECORDER

STANDBY

STK 1. <SIM Tool Kit>.

STREAMING/REALTIME PROTOCOLS

TELEPHONY

USB

VOICE INPUT & OUTPUT

WALLPAPER

WIDGETS

XBOSOFT.COM 16 CONTACT US AT SERVICES@XBOSOFT.COM


1
FUNCTIONAL AREA COMMENTS

WI-FI

SECURITY

MTP 1. <Media Transfer Protocol>.

FILE EXPLORER

VOICE DIALER

LOCALIZATION

INTERACTION

USER SCENARIO

3RD PARTY APP 1. App can be installed/uninstalled.

XBOSOFT.COM 17 CONTACT US AT SERVICES@XBOSOFT.COM


1
ABOUT XBOSOFT
As an experienced software testing and QA company, our team of nearly 100 has hundreds of years of cumulative work experience
serving clients, from Fortune 500 to small ISV’s, in North America, Europe, and Asia. Through long term multi-year relationships with
our clients, we’ve developed deep technical expertise in software quality assurance, covering web, mobile, embedded and desktop
apps, and spanning compliance-heavy industries, such as finance and healthcare.

XBOSoft’s software quality processes are designed to provide confidence every step of the way. We ensure that your software not
only performs optimally, but keeps your users coming back.

CONTACT XBOSOFT PHONE: +1 703 995 9896 EMAIL: services@xbosoft.com

XBOSOFT.COM 17 CONTACT US AT SERVICES@XBOSOFT.COM

Você também pode gostar