Test Scenario | ||
What platforms should this product work on? | ||
What is the app supposed to do? | ||
What happens if I do this? | ||
Where to Start testing | ||
What information exists? Specifications? Project conversations? User documentation? Knowledgeable team members? Could the support forum or an online company forum be of help? Is there a log of existing bugs? | ||
What OS, platform and device should this app work on and be tested on? | ||
What kind of data is processed by the application (i.e. personal, credit cards, etc.)? | ||
Does the application integrate with external applications (APIs, data sources)? | ||
Does the app work with certain mobile browsers? | ||
What do existing customers say about the product? | ||
How much time is available for testing? | ||
What priorities and risks are there? | ||
Who is experiencing pain, and why? | ||
How are releases or updates made? | ||
The Creativity Of Testers | ||
Novice user, | ||
Experienced user, | ||
Fan, | ||
Hacker, | ||
Competitor. | ||
behavior and workflows | ||
Go back when they are not supposed to, | ||
Are impatient and hit keys multiple times, | ||
Enter incorrect data, | ||
Can’t figure out how to do something, | ||
Might not have the required setup, | ||
Might assume they know what they are doing (neglecting to read instructions, for example). | ||
Questions | ||
Does it do what it says on the tin? | ||
Does the app perform the tasks it was designed to do? | ||
Does the app perform tasks that it wasn’t designed to do? | ||
How does the app perform when being used consistently or under a load? Is it sluggish? Does it crash? Does it update? Does it give feedback? | ||
Do crash reports give clues about the app? | ||
How can one navigate creatively, logically or negatively around the app? | ||
Does the user trust your brand? | ||
How secure is the user’s data? | ||
Is it possible to break or hack the app? | ||
What happens when you push the app to its limits? | ||
Does the app ask to turn on related services? (e.g. GPS, Wifi)? What if the user does? Or doesn’t? | ||
Where does the app redirect me? To the website? From website to app? Does it cause problems? | ||
Is communication and marketing consistent with the app’s function, design and content? | ||
What is the sign-up process like? Can it be done on the app? On a website? | ||
Does sign-up integrate with other services such as Facebook and Twitter? | ||
Where’s All The Data?- Scenarios | ||
The mobile device is full of data. | ||
The tester removes all of the data. | ||
The tester deletes the app. What happens to the data? | ||
The tester deletes then reinstalls the app. | ||
Too much or too little content causes the design or layout to change. | ||
Working with different times and time zones. | ||
Data does not sync. | ||
Syncing is interrupted. | ||
Data updates affect other services (such as websites and cloud services). | ||
Data is processed rapidly or in large amounts. | ||
Invalid data is used. | ||
test the limits of data | ||
Test the limits of user input, | ||
Play around with duplicate data, | ||
Test on brand new clean phone, | ||
Test on an old phone, | ||
Pre-populate the app with different types of data, | ||
Consider crowd-sourcing the testing, | ||
Automate some tests, | ||
Stress the app with some unexpected data to see how it copes, | ||
Analyze how information and data affects the user experience, | ||
Always question whether what they see is correct, | ||
Creating Errors And Messages | ||
Is the UI for errors acceptable? | ||
Are error messages accessible? | ||
Are error messages consistent? | ||
Are they helpful? | ||
Is the content appropriate? | ||
Do errors adhere to good practices and standards? | ||
Are the error messages security-conscious? | ||
Are logs and crashes accessible to user and developer? | ||
Have all errors been produced in testing? | ||
What state is the user left in after an error message? | ||
Have no errors appeared when they should have? | ||
Platform-Specific Considerations | ||
Does it follow the design guidelines for that particular platform? | ||
How does the design compare with designs by competitors and in the industry? | ||
Does the product work with peripherals? | ||
Does the touchscreen support gestures (tap, double-tap, touch and hold, drag, shake, pinch, flick, swipe)? | ||
Is the app accessible? | ||
What happens when you change the orientation of the device? | ||
Does it make use of mapping and GPS? | ||
Is there a user guide? | ||
Is the email workflow user-friendly? | ||
Does the app work smoothly when sharing through social networks? Does it integrate with other social apps or websites? | ||
Does the app behave properly when the user is multitasking and switching between apps? | ||
Does the app update with a time stamp when the user pulls to refresh? | ||
What are the app’s default settings? Have they been adjusted? | ||
Does audio make a difference? | ||
Connectivity Issues And Interruption | ||
Moving about? | ||
With Wi-Fi connectivity? | ||
Without Wi-Fi? | ||
On 3G? | ||
With intermittent connectivity? | ||
Set to airplane mode? | ||
When a phone call comes in? | ||
While receiving a text message? | ||
When receiving an app notification? | ||
With low or no battery life? | ||
When the app forces an update? | ||
When receiving a voicemail? | ||
Does the app provide adequate feedback? | ||
Does data get transmitted knowingly? | ||
Does it grind to a halt and then crash? | ||
What happens when the app is open? | ||
What happens midway through a task? | ||
Is it possible to lose your work? | ||
Can you ignore a notification? What happens? | ||
Can you respond to a notification? What happens? | ||
Is any (error) messaging appropriate when something goes wrong? | ||
What happens if your log-in expires or times out? | ||
Maintaining The App | ||
When things are changing constantly and quickly, how does it affect your app? Ask yourself: | ||
Can I download the app? | ||
Can I download and install an update? | ||
Does the app still work after updating? | ||
Can I update the app when multiple updates are waiting? | ||
What happens if the OS is updated? | ||
What happens if the OS is not updated? | ||
Does the app automatically sync downloading to other devices via iTunes? | ||
Is it worth automating some tasks or tests? | ||
Does the app communicate with Web services? How would this make a difference? |
Saturday, November 2, 2013
Mobile Application testing Scenarios
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment