06 Chapter 5
06 Chapter 5
CHAPTER 5
PILOT STUDY
1. INTRODUCTION
The pilot study of the current research was the first step of the practical application of
the Gestalt play therapy emotional intelligence programme for primary school
children. It is also the last step of the first grouping of steps of an intervention
research study (De Vos, 2002:409-418) namely, “Early development and pilot
testing”. The three groupings of steps are presented visually in Chapter 1, Figure 1.6
Research procedure. This chapter covers a theoretical background of the definition
and value of pilot studies. It also covers the goal of the pilot study – what the
researcher expects from a pilot study. The researcher then discusses the application of
the pilot study in the current research. The outcomes of the pilot study will also be
discussed shortly, because these have a very direct influence on the actual research
itself.
The researcher will first define a pilot study and state the value thereof following the
introduction to clarify what a pilot study really is and why it is needed in the research
process.
Tight, 1996:121), trying out all research techniques and methods, which the
researcher have in mind to see how well they will work in practice. If necessary it can
then still be adapted and modified accordingly. (Blaxter, Hughes & Tight, 1996:121)
The pilot study in the current research can be defined as mainly a try-out of research
techniques and methods, but also of questionnaires and interviews. The researcher
compiled an emotional intelligence programme and applied this to a pilot group of
primary school children. During this process, the researcher also tested a short open-
ended questionnaire on the cultures of the families of the children, questionnaires on
their learning styles for the parents, a behaviour style instrument / questionnaire on
the children in the pilot group and feedback reports on these to the parents. The pilot
study of the current research can therefore be defined as both a feasibility study as
well as a pre-testing of instruments, questionnaires and interviews.
The value of first piloting the whole research process is discussed in the next section,
because if a pilot study is of too little value, the researcher can waste time, energy and
money.
The researcher first discussed the value of a pilot study as stated by different authors
and then the applicability to the current study in the following paragraphs. After
stating the value of such a study, the researcher compiled the goal of a pilot study for
the current research project.
Blaxter, et al. (1996:122) states that “You may think that you know well enough what
you are doing, but the value of pilot research cannot be overestimated. Things never
work quite the way you envisage, even if you have done them many times before, and
they have a nasty habit of turning out very differently than you expected”. It is thus
very clear to the researcher, that the pilot study in the current research was essential to
258
prevent the waste of time, energy and money. The value is also emphasised by the
points listed below.
Other advantages of pilot studies include the following as listed in Nursing Standard
(2002:33,34):
It can give advance warning about where the main research project can fail
It indicates where research protocols might not be followed
The pilot study can also identify practical problems of the research procedure
It indicates whether proposed methods or instruments are inappropriate or too
complicated
Some of the advantage points listed above are relevant to the pilot study of the current
research project. The pilot study in the current research process was very specifically
used to identify practical problems in the process, sessions and methods used. The
research itself has as a goal the applicability of Gestalt play therapy techniques to
enhance the emotional intelligence of primary school children in a cultural sensitive
way. The pilot study could thus indicate whether the proposed methods and / or
instruments are appropriate. The pilot study could thus also give advance warning of
possibilities where certain types of techniques or the study as a whole could fail.
The pilot study can therefore be of value for testing the feasibility of both research
instruments or data collection instruments like questionnaires, interview schedules, or
other testing instruments and also of the research process itself. The following section
combined the statements of the value of pilot studies in a goal of pilot studies in
general as well as for the current research project.
260
The researcher sees the goal of a pilot study in general as related to the aim of the
research project of which it forms part. The general goal of a pilot study is to provide
information, which can contribute to the success of the research project as a whole.
The latter is supported by the following quotes concerning the value and goal of pilot
studies: “to see if the beast will fly” (De Vos, 2002:410), “reassessment without tears”
(Blaxter, Hughes & Tight, 1996:121), and “Do not take the risk. Pilot test first.” (Van
Teijlingen & Hundley, 2001:2). The general goal thus seems to safe some time, effort
and money, which can be lost if a major research study fails because of unforeseen
attributes. The goal is thus to test the study on small scale first to sort out all the
possible problems that might lead to failure of the research procedure. It might
minimise the risk of failure.
In the current study the goal of the pilot study consists of two parts. The first was to
find as many as possible practical arrangements that might have a negative influence
on the success of the research procedure. The other included sorting out all
practicalities related to measurement instruments as well as the applicability of these
instruments to the potential outcomes of the study.
The procedure of the pilot study in the current research project is discussed in the
following paragraphs.
The pilot study of the current research follows the design phase, which is the research
strategy as stated in Chapter 1, 8. RESEARCH DESIGN / STRATEGY. After the
strategy is in place and the procedural elements of the intervention are determined (as
far as possible), the early development and pilot testing (De Vos, 2002:409) could
follow. The researcher stated in Chapter 1, 8.2 Specifying procedural elements of the
intervention, that certain procedural elements in the current study could only be
developed while the research procedure itself was already in process. Some
261
procedural elements were therefore identified during the process of the pilot study. It
is part of the research procedure as stated in Chapter 1, 9. RESEARCH
PROCEDURE. The research procedure is divided in three main sections, namely:
Early development and pilot testing
Evaluation and advanced development
Dissemination
The pilot study is part of the first phase of the research procedure, following the
literature study. De Vos (2002:410) states that the pilot study usually takes place in a
setting which is convenient for the researcher and that resembles the one used for the
intervention. Tthe research procedure of the pilot study in this research project
therefore greatly resembles the true study. The following is a diagrammatic
representation of the research procedure of the pilot study.
9 6 Apply
4.2 Application of programme to
9 7 Collect and analyse pilot group. Notes of practical
difficulties, use of techniques,
9 8 Finalise findings and
use of questionnaires and
9 9 Finalise research feedback.
The researcher used the same selection criteria for the pilot study as for the final
intervention. The criteria used specifically for the pilot study is discussed very shortly
in the following paragraphs. Some criteria were added to the final selection criteria as
a result of the outcomes of the pilot study. The final selection criteria are discussed in
more detail in Chapter 6, 5.2 Selection of the group members.
The following are the main selection criteria used for the members for the group of
the pilot study:
The use of the results of a specific pre-test to determine the need for
enhancement of emotional intelligence
Gender
Age
Cultural groups
Maintaining an ethical approach to the group members and their care takers
The researcher therefore found the results from this standardised cognitive assessment
system very valuable as a selection tool. The findings from this assessment were
discussed with the children’s caretakers, who confirmed the need for improved
emotional intelligence. Children of whom the caretakers did not confirm this need
were not included in the intervention.
4.1.2 Gender
The aim of this research is to identify Gestalt play therapy techniques to enhance the
emotional intelligence of primary school children within their cultural context
(Chapter 1, 4.1). This intervention should thus be sensitive to the cultures of the group
members – the children’s cultural contexts are essential to the outcomes of the
intervention of this research study. The researcher therefore attempted to include
children from different cultural groups as well as different gender types in the groups.
Groups were not homogenous concerning gender. According to Hofstede (2005:1)
certain cultures experience a higher degree of gender differentiation and inequity
between genders than others. In cultures with a lower degree of gender differentiation
and inequity, females are equal to males in all aspects of the society and vice virsa.
The researcher is thus of the opinion that different genders are accepted and treated in
different ways in different cultural contexts. It thus seemed necessary to include
children from different gender types in the pilot study (as well as in the main
intervention) to increase the need for cultural sensitivity in the intervention.
4.1.3 Age
The aim of this study is to focus on primary school children, thus children in their
middle school age developmental phase. According to a variety of authors this phase
range from seven years to about twelve years (compare Le Roux and De Klerk,
2003:23; Mwamwenda, 1996:353). The children in the pilot group’s ages did not vary
much, although two of the children were younger (eight and nine years) and two were
a little older (ten and eleven years). The researcher had thorough contact with these
children before they were included in the sessions. This contact included individual
play therapy, educational help and other activities related to the institutions where
they were situated. This group of children’s functioning on emotional level was
relatively the same, although they differed in age. The researcher trusted the
information concerning the children’s development and needs gained by contact
264
together with pure factual information like chronological age. This group were
functioning on nearly the same level and could join together in a group.
In order to keep this part of the intervention as ethical as possible and therefore
prevent negative and emotionally damaging experiences to the children, the
researcher applied the following pre-cautions:
The researcher did therefore not charge any fees for time and material used to
present the pilot study, because this was used to determine the success of the
final programme. The group members were thus exposed to situations, which
might not be as effective as those in the finalised research intervention.
According to the researcher, the extent to which she gave herself (including
effort, energy and enthusiasm) is already a very important way to increase
personal contact and a sense of importance experienced by the group
members.
After the selection process of the group members was completed, the intervention
programme could commence. The process of this part of the intervention is discussed
in the following section.
The intervention as applied to the pilot group is discussed here in summary form. The
final intervention is discussed in Chapter 6 in more detail. The researcher will use this
section specifically to give an overview of the intervention as applied to the pilot
group. The outcomes and meaning of this for the final intervention is discussed in
5. OUTCOMES AND APPLICATION TO FINAL PROGRAMME OF THE
RESEARCH STUDY, following the last part of this section.
The intervention programme is based on the Schoeman model for Gestalt play
therapy. The sessions thus took the form of a typical Schoeman model Gestalt play
therapy session as far as possible. (Schoeman, 2004b:118-119) This form is already
discussed in Chapter 4, 5.3.2 Group Process. As stated in Chapter 4, 6.
CONCLUSION, the programme is a combination of Gestalt therapy and group
therapy – it makes use of play therapy techniques and it is set in a group therapy
environment, which is culturally sensitive.
The steps of the Schoeman model as applied to the programme of the pilot group will
be repeated in the diagram below, which indicates the programme content of the pilot
study.
268
Sensory awareness,
projection,
owning the projection,
alternatives,
empowerment of the child to be able
to apply alternatives,
conclusion and self-nurturing.
A very short summary of the content of each one of the sessions as listed in Figure
5.2: Framework of the programme content of the pilot study, is given in the following
sub sections:
The group contact sessions of the pilot programme was terminated after the last
session. The pilot programme was only completed after the researcher mailed a report
to all the caretakers containing information about the content of the programme,
programme goals, and whether the post-test and observations of the researcher
proofed the intervention to be successful or not. The processes of the children were
repeated in this feedback report so caretakers could have a better understanding of the
child as a whole. The researcher also invited caretakers to further discussions should
they have any queries or a need for more information. If needed the researcher also
added information to this report to use for extra help, like notes on lifestyle changes
for children with concentration problems.
The results from the notes taken after each contact session were used to adapt the
programme to be more effective in reaching the aim of this study – Gestalt play
therapy techniques to increase the emotional intelligence of primary school children
273
in a culturally sensitive way. The next section thus covers the information gained
from the pilot study and how it can be applied to the final intervention programme.
The first part of the discussion of this section covers the information gained from the
pilot study. Hereafter the researcher indicated how the final programme was adapted
accordingly. The researcher also compiled all the information in a diagram for a quick
overview of the outcomes and adaptations to the final programme.
The researcher divided the outcomes of the pilot study in two categories, namely
practical considerations and assessment instruments and questionnaires. This relates
to the goal of a pilot study as discussed in 3.2 The Goal of a Pilot Study. The
information gained through the pilot study is discussed in the following paragraphs
and was applied to the final intervention programme.
in the literature study concerning the time limit for group therapy were thus
ignored, but proofed to be very valid in practice (Chapter 4, 5.2.3.2 Frequency
and length of therapy sessions). The children could not benefit much from the
sessions because they could not finish projections and there was no time for
discussions and thus owning of the projections.
The following is an extract of the process notes taken by the researcher,
indicating the above-mentioned problem:
SESSION 1
OBSERVATIONS
General / organisational
Time is very short – needs 90 minutes
SESSION 2
OBSERVATIONS
General / organisational
Time is very short – needs 90 minutes – did not complete process / DISC exercise.
Has to continue next time.
SESSION 3
OBSERVATIONS
General / organisational
Still an hour of time, but not that hurried. Could focus a little on the children’s
needs.
1.4.5 Language and culture, language is a means through which cultural norms
and values are communicated and thus closely related to the child’s culture.
There was thus a need to incorporate different languages, but not in one group.
In one group it inhibited communication and effective building of
relationships, especially between the researcher and the group members.
The following is an extract of the process notes taken by the researcher,
indicating the above-mentioned problem. Letters of the alphabet indicate
children’s names, for the sake of confidentiality, here and in all similar
extracts.
SESSION 1
OBSERVATIONS
General / organisational
Difficult to accommodate English and Afrikaans children in one group – try to focus on
one language medium.
SESSION 2
OBSERVATIONS
General / organisational
Difficult to accommodate English and Afrikaans children in one group – try to focus on
one language medium, but today it went a little smoother, as A could understand most
of the BOTS stories in Afrikaans.
SESSION 3
OBSERVATIONS
General / organisational
Handled English and Afrikaans mixed group by speaking mostly Afrikaans.
Questions from A were answered in English, because she could understand
Afrikaans, but does not feel comfortable speaking it.
SESSION 2
OBSERVATIONS
General / organisational
…Children coming late is a problem – it is time consuming and they are neglected –
they don’t get the full benefit of the exercise.
SESSION 3
OBSERVATIONS
General / organisational
Children did not come late, but D did not turn up. He is now behind on the
DISC exercise.
of the aim of this research and should not be missed because emotional growth
is part of Gestalt play therapy techniques (Chapter 4, 2. GESTALT PLAY
THERAPY, 2.1 Introduction).
The following is an extract of the process notes taken by the researcher,
indicating the above-mentioned problem.
SESSION 2
OBSERVATIONS
General / organisational
…Children coming late is a problem – it is time consuming and they are neglected –
they don’t get the full benefit of the exercise. I rushed through the session to fit all
activities, but felt as if I had lost contact with the children.
SESSION 3
OBSERVATIONS
General / organisational
The therapist was so hooked on getting the message over and doing all the exercises,
that she did not handle the emotional needs of two of the children in the session – H
had a need to deal with his feelings of hate towards his father and A was falling
asleep all the time – they were sending messages and it was only recognised
and not addressed.
SESSION 7
OBSERVATIONS
General / organisational
The activities still were too many to fit into 90 minutes. It is better to include a sensory
awareness exercise and one other experiment or exercise leading to an experiment. If
needed the session can stop at the sensory awareness exercise and an experiment
can be taken from there.
The main goal is to improve the children’s awareness of themselves. It is also
important that this environment should be a building place for the self-image. Children
should feel better about themselves after the sessions. The latter is still missing.
relate to the children’s true feelings or needs. The children wanted to do and
experience things. They did not want to listen to explanations.
The following is an extract of the process notes taken by the researcher,
indicating the above-mentioned problem.
SESSION 6
OBSERVATIONS
General / organisational
… The children found the explanations boring. I used a story and imaginary mental
experience of the story. They did not really realise the message that it is really what
we think, which causes what we feel. They were more interested in drawing the
feeling faces with the whiteboard markers on the whiteboard / laminated poster. They
should thus learn through exciting doing exercises.
SESSION 7
OBSERVATIONS
General / organisational
… The session is more action oriented, so the children needed to explore and apply.
This worked and insight was better.
SESSION 8
OBSERVATIONS
General / organisational
As this group especially is very action oriented – doers – I did not attempt to do a long
discussion on what makes a good friend. I designed a board game,…
SESSION 9
OBSERVATIONS
General / organisational
The friendship puzzle game was repeated. The adapted question cards were used to
move faster and discuss more. The discussions bored the children. Only the one who
was busy with the question was entertained. The others listened when they tried to
give the right answer if the one who was busy answering made a mistake.
Discussions on the answers got boring to the others. We moved too slowly again, as
some made mistakes. Activity and interest levels should be kept very high.
SESSION 8
OBSERVATIONS
General / organisational
… I designed a board game, which looked perfect in theory, but many practical
difficulties appeared…They moved too slow through the game and got bored – we
also ran out of time before they even covered half of the board. After this we played
the snap game, which went too fast. The questions for the board game need revision,
so children need to talk and discuss friendship issues a little more and move more
spaces per question. The snap game will then use loose friends / make
friends questions.
SESSION 2
OBSERVATIONS
Culture
Culture at home: The culture at home may have an influence on the feelings of safety
and / or belonging in the group. It also has an influence on how the child handles
time, schedules and other obligations like returning the necessary forms.
Exploring this in a session seems necessary.
SESSION 2
OBSERVATIONS
General / organisational
Time is very short – needs 90 minutes – did not complete process / DISC exercise.
Has to continue next time.
SESSION 8
FRIENDSHIP PUZZLE GAME
General / organisational
It seems as if building friendships is a big need for this group. I read a story about a
bully and from the discussion on the story I found that these children don’t know what
to do to make friends. As this group especially is very action oriented – doers – I did
not attempt to do a long discussion on what makes a good friend.
... For this group it is important to repeat this lesson because the games did not work
out very practically and they still did not have much insight in good friendships.
5.1.2.2 Information letter and feedback report on DISC analysis and learning style
questionnaire
The caretakers did not complain about the clarity of the information letters or
learning style reports. All group members returned their learning style
questionnaires fully completed. Concerning information letters, the researcher
started to send little strips with the next date and time of sessions as well as a
summary of the current session with the children after each session. This
helped a lot to make sure that children turn up at the correct times and on the
correct dates, especially after a session was skipped because of a public
holiday.
The researcher found that a feedback report after the third or forth session
containing information about the children’s behaviour and learning styles
might have been interesting, but it took too much unnecessary time and effort
283
from a therapist. This information was repeated in the final report at the end of
the whole programme. It might thus be acceptable to send a feedback report at
the beginning of the programme, but it is not necessary. The information was
duplicated in the final report.
The following adaptations concerning the outcomes of the pilot study were applied to
the research groups who participated in the final intervention programme:
increased time limit. The researcher changed the time from one hour to 90 minutes in
the middle of the pilot study.
5.2.2 Language
The researcher decided to use two research groups for the final intervention, one
English and one Afrikaans. The latter two languages are regularly used as
communication languages in Namibia. The people who visit the researcher’s practice
are thus fluent in at least one of these two languages. Language confusion and
inhibited communication and relationship building could therefore be minimised by
dividing the research group in an Afrikaans and English group. Each one of these two
groups still consisted of a variety of ethnic cultures.
5.2.7 Culture
The researcher needed more information about the children’s cultural experiences at
home for a better understanding of them and their fields.
The researcher therefore decided to add an additional session after the first awareness
sessions, which made use of the DISC analysis. This session was used to understand
the children’s interpretation of their family culture. Together with this session the
children received an information letter for their caretakers, explaining the importance
of the culture-oriented session. An open-ended questionnaire was included. The
caretakers were asked to complete the questionnaire and return it with the child at the
following session. The completion of the questionnaire was voluntary.
5.2.8 More sessions than planned for – flexibility to adapt the programme
It seemed important to the researcher to be in confluence with the children – to work
within a structure but not allowing the structure to be the main director of what is
happening in the groups. The needs of the group members needed to be the main
director of what was happening in the sessions. The researcher already applied this
flexibility in the pilot study. It was necessary to try this out to find whether the
proposed time limit should be kept at all cost. As discussed earlier in this paragraph,
the researcher still found it necessary to be flexible in the number of sessions included
in the programme. In order to make this adaptation of the programme more acceptable
to caretakers, the researcher did the following: She kept the parents informed of the
flow of the programme by sending notes on when the sessions would repeat and when
the number of total sessions would increase.
286
5.2.11 Post-test
The post-test was conducted in group-format in the final intervention programme
again. Time constraints were a big consideration. Individual testing was not always
possible, because of the time limits of both the caretakers of the children as well as
the researcher as therapist. It was also necessary to consider the impact of the quality
of observations of the children’s behaviour in a group assessment situation. Although
these considerations seemed negative towards a group test, the researcher decided on
a group test to observe the children in the more demanding atmosphere of the group
situation rather than an individual test. The time constraints were also a very salient
factor in this choice.
The researcher only added dividers between the children to secure honesty in
answering the questions in the research groups.
The following is a diagram to summarise the difficulties experienced in the pilot study
and the applications of these outcomes to the final intervention programme.
287
The value of the pilot study is, according to the researcher, proven in the number of
adaptations done on the final programme. The researcher found the pilot study of
value for both the practical application of the programme as well as for the
assessments, questionnaires and interviews done. The most important value though
was personal. The researcher could identify possible difficulties related to her process,
which had a negative influence on the application of Gestalt play therapy techniques.
This was therefore also a process of personal growth towards a more Gestalt oriented
way of being.
The value of a pilot study was clear at the end of the final intervention programme
when the researcher could be able to identify more factors that could possibly have
had a negative influence on the quality of the programme. In this case the final
intervention programme acted as a pilot study for further research. The researcher
found that two aspects of the programme were neglected in the final intervention
because of a lack of time. The first one is the life book, which was created and used as
homework assignments. The importance of spending time on the book each week was
not emphasised enough. The researcher mentioned the life book each week, but did
not spend enough time on this to utilise its full value. This could be a very valuable
source of self-awareness and opportunities for group members to get to know each
other. The second factor is the flow diagram of the programme, which was neglected
in both the pilot study as well as the final intervention programme. The group
members’ comprehension of the whole programme and how the sessions fit into the
whole could be increased with this diagram. This was thus a possible useful tool,
which was not utilised in the final intervention programme.
The pilot study therefore had a very definite contribution to the success of the final
programme, its possibilities for further research, and also to the researcher’s growth as
a person and as a user of the intervention programme.
289
6. CONCLUSION
This chapter covered the definition, value and application of a pilot study. The current
research study is a combined quantitative-qualitative study. The pilot study was of
value for both the quantitative as well as qualitative nature of this research project.
This chapter therefore proofed the great value of a pilot study.
The next chapter covers the adapted, final intervention programme. The application of
the programme, to what extent the research question has been answered, and whether
the goal and objectives were reached is covered in this following chapter.