Getting Started with Mobile Apps Testing

1. Basics of Software Testing:-

Whether you are an experienced or a fresher in this field, knowledge of Software Testing basics
is essential in any kind of testing you perform. !en if you are starting your carrier as a
Mobile Apps Tester, you need to know all the software testing principles, Software Testing
Techni"ues, Types of Software Testing, #b$ecti!e of Testing and other basics in Software
Testing. There are many sites and resources a!ailable on internet, which can guide you
about the same. %f you are $ust starting your carrier in this field, don&t bother to
accumulate all the complicated theories of software testing in your mind at once. Go step'
by'step. %t is strongly recommended to undergo some good training program in software
testing which can gi!e you some practical experience of testing. (lease a!oid mugging
complicated testing theories.
2. Basics of Telecom:-
As you ha!e decided to work in Mobile )omain, knowing the Telecom basics will always gi!e you
an added ad!antage. Mobile Apps Testing is not $ust about testing of mobile product or
application. *ou will surely get an ad!antage if you are aware of other things in this domain
which re!ol!es around Mobile products testing. +G, ,G, -)MA, G(.S, GSM, /S-S), S%M,
SMS, WA( are some basic things of telecom that you should be aware of. *ou can check
out some more details about the same here.
3. Awareness about Mobile OS/Platforms:-
There are many Mobile #S0(latforms present in the market. Android, i#S1 i(hone2, 3lackberry
#S1.%M2, 4+M, Symbian, (alm, Windows phone, Samsung 3ada , 5okia Meego and so on.
%t is !ery important to ha!e knowledge about these Mobile #S0(latforms as a Mobile Apps
Tester. Awareness about the capabilities and limitations of these platforms gi!e you
confidence to differentiate application bug with platform0#S limitations. *ou may find some
more details about Mobile #perating Systems.
.!et familiar wit" #our own Mobile P"one:-
% am sure many of you must not e!en be completely aware of which Mobile /andset model you
are using, what is the #S in it and what is the software !ersion your phone is ha!ing. %f
you are a beginner, $ust start exploring your own cell phone. 4ust open up and try using
internet on your Smartphone. 6se Wi'7i, G(.S. -heck out how you can format or perform
7actory reset on your de!ice 13e careful2.-heck what is the %M% number of your phone.
Try to upgrade #S !ersion of your Android de!ice. xperiment with different settings and
user permissions on your phone. %n short, be familiar with all the features and functions
of your mobile handset and it will surely help you to dig out more scenarios while testing
any mobile app or any mobile /andset you are gi!en to test .
$. !et aware of Testing in Mobile %omain:-
When we talk about testing in Mobile domain, it is not only confined to Mobile Apps, but also
includes mobile handset and mobile website testing.
)ownloadable Mobile Application Testing8 9 Some applications come pre'installed in mobile
handset while some mobile applications are downloadable from different mobile application
stores1Apple App store, Android Market, Get$ar, 5okia #!i Store, 3lackberry App world
etc.2. Apart from con!entional 7unctional and 6% testing, you may need to test your
application against the submission criteria and guidelines pro!ided by these Application
stores. As said earlier, tester&s role here should not be only functional testing of mobile app,
but also to make sure your application adheres to the guidelines pro!ided by these mobile
app stores.
Mobile /andset Testing8'Similar to #rgani:ations that de!elop third party downloadable mobile
applications, there are many companies that de!elop complete mobile handset. A mobile
;A here may need to test nati!e applications or features that are a!ailable in the phone.
SMS, MMS, <oice -all, MMS, (honebook, -alculator, 3luetooth and other mobile features. %t
also includes Multimedia 1-amera, <ideo, Media player, ringtones2 and Mobile (rotocol
stack testing.
Mobile Website Testing 1WA( Sites28'6nlike downloadable mobile applications, mobile websites
can be accessed !ia browser. 5o download in!ol!ed. Testing of Mobile WA( sites has its
own challenges. (roper na!igation, good user interfaces 1design2, security, performance
and mobile browser compatibility are important areas.
&. !et Aware of T#'es of Mobile A''s Testing:-
Similar to general Software Testing, Mobile Software Testing also includes8'
6ser %nterface Testing 1-olor scheme, Menu styles, -onsistency of 6% o!er !arious )e!ices2
7unctional Testing 1Testing core functionality of Mobile App as per specification2
(erformance = Stress Testing >3eha!ior of Mobile Application in ?ow resources1Memory0Space2,
3eha!ior of mobile website when many mobile user simultaneously access mobile website2@
6sability Testing 1Testing of usability aspects of Mobile Apps2
Apart from abo!e mentioned testing types, some key testing types may include the following.
Testing for (om'atibilit#:-Testing the compatibility of your application with nati!e de!ice
features 1i.e. To make sure your application is not hampering nati!e de!ice functionality2
(ertification (om'liance Testing:'7or downloadable mobile applications, there are !arious
Third party Mobile ;uality -ertification program for !arious platforms. True 3rew
Testing1for 3.W Apps2, 4a!a <erified program 1for 4+M apps2, Symbian Signed
Test -riteria 1for Symbian Apps2 are some examples. Apart from regular functional
testing, you may need to test your application against the test cases0Testing criteria
pro!ided by these certification processes. /owe!er, it depends on your client, whether they
want to certify their application or not.
Submission !ui)elines (om'liance Testing:
The application needs to adhere to the specified submission guidelines to publish it in any
mobile application store. 7ailure to meet these guidelines may result in re$ection of your
app on mobile application stores. 7or example failure to comply with application
Submission guidelines for Apple App Store may result in re$ection of your app in Apple
app store.
*nterru'tion Testing 1<oice -alls, SMS, -harger, ?ow memory 5otification2 while application
is running.
Mon+e# Testing: 9 -ontinual key pad entries !ia tools to test application stability with !arious
key press e!ents.
?ow 5etwork05o 5etwork case Testing8 9 Application beha!ior when there is no network
co!erage or ?ow network strength.
A . Go through the Sample Test -ases for Mobile Application8'
7or newbie in Mobile Testing, it is always ad!isable to go through some sample test cases for
Mobile Apps. Going through the test cases for any mobile application, gi!es a complete
insight of the kind of testing conducted for Mobile Application. *ou may ask your seniors to
pro!ide you some Test Suites for any mobile pro$ect your organi:ation completed earlier.
/owe!er, you can still go through some general Test -ases for Mobile application here.
B. xplore the -apabilities of Simulator8'
Simulators always play big role when there are no mobile de!ices a!ailable for testing. Though
)e!ice testing is always preferred as it represents more likely end user scenarios, the
importance of simulators cannot be ignored. %n order to ha!e effecti!e testing o!er
Simulator, %t is recommended to explore all the capabilities of Simulator.
C . Take /elp from .emote )e!ice Access Ser!ice'
)ue to a large number of de!ices a!ailable in the market, it is not feasible to buy a new de!ice
e!ery time. At the same time Simulators are not completely reliable enough to launch a
mobile app based on testing conducted only on simulators. .)A 1.emote de!ice ser!ices2
can be a good solution to deal with these challenges. The remote de!ice access ser!ices
enable access to a li!e de!ice o!er the %nternet. As a Mobile Apps Tester, you should be
aware of such ser!ices and should suggest your managers about the capabilities of such
Ser!ices.
Some A,ailable -%A Ser,ices are:
)e!ice Anywhere 1(aid2
(erfecto Mobile 1(aid2
5okia .)A 17ree, 7or Symbian (hones2
Ad!antages of .)A8
*ou don&t need to purchase actual de!ice.
6ser can select different -arriers e.g. <eri:on, T'Mobile, AT = T.
.)As are more reliable than simulators as they are real de!ices.
Some .)A Ser!ice like )e!ice Anywhere also has automation capabilities.
)isad!antages of .)A8
Since you access de!ices remotely it takes time for any action or key e!ent.
Sometimes the needed de!ice is not a!ailable due to prior reser!ations.
/igher Ser!ice -ost
1. . /0'lore Tools an) 1tilities:-
There are many software tools and utilities a!ailable in the market which may help you in testing
of your Mobile Application effecti!ely. Some of these tools are a!ailable in S)Ds itself.
/owe!er you may still dig out the internet for such tools on !arious platforms.
Tools to check 3attery -onsumption while your app is running. .g. 5okia nergy (rofiler.
Tools0Software to capture screenshot8 9 There are many tools a!ailable for !arious mobile
platforms to capture screenshot from de!ice itself. .g Screenshot tool for Symbian
SEF )e!ices.
Tools to Generate dummy files to test beha!ior of mobile app at ?ow 7S. e.g. Maxfilecnt utility
from ;6A?-#MM for 3.W mobile apps,7ill )e!ice Memory ?ite for Android apps.
Tools to Generate .andom key e!ents. e.g. Monkey tool1Android2, 3.W Grinder13.W2,
/opper Test Tool 1Windows Mobile2
Tools to -apture ?ogs. .g. Apphance for Android.
11. /0'lore Automation Tools for Mobile:-
Along with Manual Mobile Testing, be ready to explore your potential in Mobile Automation
Testing as well. Mobile Testing is a new field and many automation tools are coming in to
market gradually. %f you get any opportunity to work on any mobile automation tool, it is
well and good. 3ut if you don&t get such opportunity, it is better to explore on your own.
)on&t wait for the time when you will get an opportunity to work on Mobile Automation
Tool. 3elie!e me, sooner or later you will definitely face a "uestion from your %nter!iewer'
G/a!e you worked on any Mobile automation tool H I
/ere are some automation tools a!ailable for Mobile Apps Testing8'
Test-omplete
M'ux
Test;uest -ountdown
Test ;uest (ro
.obotium
<5-
Sikuli
)e!iceanywhere
7oneMonkey 1i(hone2
ggplant 1i(hone2
Testi(hone1 7or i(hone Mobile Web2
%3MJ .ationalJ (erformance Tester 1.(T2
,( Mobile
xpertest
M%T 1A Mobile content testing and !alidation tool for Mobile Web app2
GMobile ;A KoneI collaborates with GTea'time with TestersI
After my announcement of collaboration between 6T% and M;K for pro!iding feedback on
6T% documents, let me declare yet another candid sync up between our !ery own Mobile
;A Kone and an %nternational Monthly on software Testing i.e. Tea'time with Testers.
*ou all are already aware of our work as M;K, let me tell you more about Tea'time with
Testers 1for those who don&t know yet2 . GTea'time with TestersI is an outcome of efforts
taken by its ditor and -o'7ounder Mr.?alitkumar 3hamare accompanied by
Mr.(ratikkumar (atel who happens to be another key person and -o'founder of this
brilliant !enture.
The reason % decided to go ahead with GTea'time with TestersI is the true passion they ha!e for
software testing which is completely selfless.Their !ery first edition was launched in
7ebruary +FLL and to my surprise, with launch of its Mth issue 14une +FLL issue2 Tea'
time with Testers has reached up to MA -ountries in the world. %sn&t that a mind
blowing H
This maga:ine has become talk of the Global Testing -ommunity for its "uality, content, design,
li!eliness and many other original ideas which are solely focused on benefit of e!ery
tester across the corner.
%n e!ery single issue of Tea'time with Testers, you&ll reali:e that it has e!erything that one
Tester may need.
Articles from Testers across the globe and thereby ensuring the integrity of testers which is
!ery much needed.
Thought pro!oking articles along with articles which teach us the craft of Testing.
I3logger of the MonthI and GSmart Tester of the MonthI awards to encourage young and fresh
Testers to let them thri!e in Global Testing -ommunity.
Testing (u::les, Tickle your ;A 3one sections are really mind blowing and one can&t $ust
go ahead without lea!ing a smile
Mr.?alit approached me and asked $oin the wagon and guide their readers in separate column
dedicated to GMobile Application TestingI. When % asked, GWhy Mobile AppsHI the answer
gi!en by him made me confident about their foresight and that !ery moment % decided to
take their offer.
Am happy to announce myself as an Assistant ditor of GTea'time with TesterI where % will be
writing my thoughts around GMobile Application TestingI. % look forward to see Tea'
time with Testers and Mobile ;A Kone flourishing together by our honest and sincere
efforts and of course with the !ery much needed support from you all.
.easons Why Mobile Apps 5eed Testing
7or any mobile app de!eloper hoping to produce a top "uality mobile application, app testing
is an essential part of the app de!elopment process. /ere are se!eral reasons for getting
your application tested by a mobile app testing professional before its consumer release8
-heck the 3asic 6ser xperience
After designing and de!eloping a mobile app you will need it to be tested by a group of eager
mobile users. This simply re"uires the application to be test run in it&s simplest form 9 fully
using the app for it&s intended purpose. 6sers at this testing stage should be asked to gi!e
feedback on the complete user experience and record any glitches they disco!er.
Screenshots can be extremely useful at this point, and if the app in "uestion is i(hone
based there is no excuse for making the most of the screen capture function.
Test 5a!igation
Whilst basic user testing may bring awareness to na!igation problems, computer based app
testing is the most accurate way of checking full app na!igation. This process will check all
menu functions are correctly working and that both internal and external links are
accurate.
Test System and 5egati!e 6sage
3y performing app tests, a de!eloper can accurately determine how your application will function
in !arious conditions. Testing the apps reactions to system changes such as low memory or
low battery as well as putting the application up against negati!e challenges such as
malicious attacks.
-heck for /idden )efects
%f all is well with the general user experience of your app, there could still be hidden issues that
could cause sporadic performance or later problems. These defects are found through both
software and hardware tests and are only completely detectable through professional
ser!ices.
-heck -onnecti!ity
Many i(hone apps rely on internet connecti!ity in some form or another after original download
1e!en if $ust for updates2. Monitoring how a mobile app functions in conditions of low
internet connecti!ity or mobile signal is a !ery important stage in mobile app testing and
will ensure that any problems formed during app de!elopment can be corrected before
release.
Test Audio 7unctionality
Another area which needs to be tested is the apps ability to interact with !arious audio settings
on different handsets. App details including audio and !ibrate feedback 1when a sound or
bu:: plays on a touch2 also need to be thoroughly checked to eliminate any future glitches.