0% found this document useful (0 votes)
61 views8 pages

Want

This document discusses key aspects of effective sport science reporting and implementation. It outlines three important steps: 1) Collecting and understanding the right data, using metrics that are valid, reliable, and relevant to training prescription. 2) Offering attractive and informative reports through improved data visualization techniques. 3) Having strong communication skills to efficiently deliver reports to coaches and athletes. The document emphasizes moving beyond traditional null-hypothesis significance testing towards magnitude-based inferences to provide practical interpretations of data that are meaningful for performance.

Uploaded by

Nils Verborg
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
61 views8 pages

Want

This document discusses key aspects of effective sport science reporting and implementation. It outlines three important steps: 1) Collecting and understanding the right data, using metrics that are valid, reliable, and relevant to training prescription. 2) Offering attractive and informative reports through improved data visualization techniques. 3) Having strong communication skills to efficiently deliver reports to coaches and athletes. The document emphasizes moving beyond traditional null-hypothesis significance testing towards magnitude-based inferences to provide practical interpretations of data that are meaningful for performance.

Uploaded by

Nils Verborg
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 8

TREATMENT

WANT TO SEE MY
REPORT, COACH?
SPORT SCIENCE REPORTING IN
THE REAL WORLD
– Written by Martin Buchheit, France

On the 9 March 2013, Sir Alex Ferguson athletes understand, accept and use sport can be useful to answer the questions
delivered in the Irish Times probably one science is highly variable and unpredictable. that are actually asked by coaches
of the most encouraging ever message for The path leading to effective sport science and players. Second, working with
sport scientists in football: “Sports science, support is a is a long and winding road, with relatively small numbers of athletes
without question, is the biggest and most frequent stops and constant redirections within a team setting as well as being
important change in my lifetime. It has required. Historically, many mistakes have unable to effectively control for many
moved the game onto another level that been made while we learned about the variables makes interpretation difficult
maybe we never dreamt of all those years veracity and usefulness of our data and the with traditional analytical approaches
ago. Sports Science has brought a whole best ways to report and implement sports such as Null Hypothesis Significance
new dimension to the game”. While science in the elite sports setting. Among Testing (NHST, which includes ‘p values’
such statements are gold for universities the different components of effective sport and ‘t-tests’ for example). Over the last
advertising sport sciences courses all over science support, the three most important decade or so, however, great strides
the world and for young students willing steps are likely the following: have been made in understanding
to embrace their carrier in elite clubs, the 1. Having an appropriate understanding and reporting the effects we have
actual value of sport science may not and analysis of the data; i.e. using the on our athletes and more valid and
always be rated as high in some elite clubs right metrics and statistics. The first relevant approaches exist which are
or federations1. Having an impact on the consideration is the choice of the best much easier to clinically interpret2. The
training programme, as a sport scientist, is variables, i.e. those can be trusted in modern practitioner working oblivious
anything but easy1. The way coaches and terms of validity and relativity and that to these useful variables and analytical

36
Table 1

Limitations of NHST Advantages of MBI

P values and in turn, study conclusions, are sample- MBI can be applied to assess changes in individuals. While
size dependent (the greater the n, the lower the P), individual score changes can be assessed in various ways (e.g.
irrespective of the size of the effect. The drop-out Z-scores6, standard difference score7), MBI additionally allows us
of a few athletes, or the lucky involvement of two to assess the likelihood of these changes to be true for any given
more subjects can induce a 180° change in a study athlete, once the typical error of the test of interest and the SWC are
conclusion5 (Table 2). known8,9 (Figure 2).
MBI allows authors to be honest with their sample size and better
acknowledge trivial effects. While a P>0.05 is often interpreted
Significance doesn’t inform on magnitude of effects, as a lack of an effect/difference, it is actually impossible to be
yet magnitude is what matters the most10. With a confident that this is the right interpretation of the data analysis
large enough sample size, even very small, trivial or (sample size issue, type II error resulting from low statistical
non-practical effects can appear significant (P<0.05). power). The beauty of MBI is that it allows us to distinguish
In practice, with 200 athletes showing a 0.01% between clear (confidence limits within the SWC) and unclear
improvement in performance, NHST would suggest (confidence limits overlapping the SWC) trivial effects (Figure 1).
that a nutritional supplement works, while the effects This can’t be achieved by NHST. An unclear effect/difference is
may in fact be negligible. Coaches and athletes are not to be interpreted as lack of an effect, but suggests the need to
first interested in knowing what kind of performance increase sample size to improve precision.
benefits may be expected from the supplement (i.e. MBI improves data visualisation. MBI principles should be applied
how much, the actual magnitude), and how likely to graphical reports produced by sport scientists, where shaded
this magnitude is to be of practical importance (i.e. trivial areas and confidence limits (or typical errors for individual
likelihood of the effect to be greater than the SWC). data) are presented systematically to acknowledge the fact that
not all changes are worthwhile and that some uncertainty always
remains (Figures 1, 2 and 3).
Table 1: Reasons why academics and practitioners should abandon null-hypothesis significance testing (NHST) and embrace magnitude-
based inferences (MBI) (adapted from Buchheit, 20164). SWC=smallest worthwhile change.

approaches could be considered incom- The following sections will detail each of this information3. While validity/reliability
petent, in my opinion, whereas a these three components. studies are important in the search of the
practitioner aware of these approaches best variables, their practical usefulness
but clinging to the past borders on COLLECTING AND UNDERSTANDING THE should also not be overlooked, i.e. their
disingenuous. (RIGHT) DATA ability to be used to impact on the training
2. Offering attractive and informative The first important step to build a programme. This relates to ‘interesting
reports via improved data presentation/ successful sport science system is to choose vs important’ types of data. For example,
visualisation. Effectiveness in this step and work with the right data3. With the measurement of maximal oxygen uptake
depends likely more on artistic skills and exponential rise in (micro) technology, vs maximal aerobic speed; only the latter
a creative mind than proper scientific collecting data from athletes has never can be used for training prescription.
knowledge and this is often overlooked been so easy. For every training session it is Statistics are probably one of the most
in sport sciences programme. Day-to- relatively easy to fully characterise both the important aspects of sport science when
day trials and errors are likely key in the external (e.g. tracking systems, encoders, it comes to using data to make decisions.
search of the optimal data visualisation force plates) and the internal load (e.g. heart Unfortunately, the statistical proficiency
strategies. rate, muscle oxygenation, sweat rate) placed of most practitioners in the field is often
3. Having appropriate communication on each athlete. However, technology per se insufficient to maximise the use of their
skills and personal attitude to efficiently might not be the solution; the foundations data and in turn, impact meaningfully on
deliver these data and reports to coaches of successful sport science support are training programmes. One of the main
and athletes. This step is without doubt probably laid on the pitch first, when reasons for practitioners’ lack of ‘statistical
the most important of the process; practitioners select the type of data that efficiency’ is that statistical lectures at
there is however no training offered at may help them to answer the questions that university have, to date, exclusively sung the
universities for this. Nothing replaces coaches and athletes have actually asked, in praises of NHST, which is:
experience, high personal standards the way they collect these data, how they • Not appropriate to answer the types
and humility at this stage, which is understand the limitations of each variable of questions that arise from the field:
generally developed over time. and how they analyse, report and utilise all as detailed in Table 1, the magnitude

STRAIGHT SCIENCE TARGETED TOPIC 37


TREATMENT

Table 2

Type of data Example of data Method to derive the SWC Common SWC value

Individual athlete 1/3 of the performance coefficient of ~1% (0.1 s) for 100 m sprint time
Track and field events
performance variation ~3% (5 mins) for marathon
~2.5% (1 cm) for CMJ height
1) 1/5 of between-athlete SD
~1.3% (0.2 km/h) % for MAS
2) performance clues e.g. based on
Physical performance CMJ, sprint times, empirical observations of direct
in team sports MAS performance benefits, such as a
~1% (0.03 s) for 20 m sprint time
distance of 20-50 cm that one soccer
player needs to be ahead of the
opponent to win a ball
Highly athlete-dependent
Physiological data The choice of the SD fraction/
Factions/multiples of the within-
with no direct link to Heart rate variability multiple depends on the expected
athlete SD
performance sensitivity (the greater the SWC, the
more conservative the decisions)
Physiological data The actual change in this variable
with relationship Submaximal HR that relates to the smallest important 1% for submaximal HR
with performance change in performance
Still debated
Physical activity that Distance covered 1) 0.2 x between-athlete SD until new
Likely depends on both tracking
has no direct impact during matches in evidence is shown
variables and intensity zones15
on performance team sports 2) Interpretation of the magnitude left
to the practitioners (Figure 3)
Table 2: Suggested methods to derive the smallest worthwhile change4. For an exhaustive list of SWCs for different performance measures see
the work of Hopkins9 and Buchheit16,17. Change/differences of 1x, 3x, 6x and 10x SWC can be considered as small, moderate, large and very
large, respectively4. SWC=smallest worthwhile change, CMJ=countermovement jump, MAS=maximal aerobic speed, SD=standard deviation.

of an effect is what matters the most MBI is based on two simple concepts: Recommendations to calculate the SWC
to practitioners – P values don’t inform 1. Changes/differences in any variable are are provided in Table 2.
this4. systematically compared to a typical 2. Instead of a classic ‘yes or no’ type
• Not appropriate to assess individuals, threshold representative of a smallest response (NHST), the probabilities for
which is the core of elite athlete important or meaningful change (later these changes/differences to be ‘real’
monitoring. In fact, conventional to be termed the smallest worthwhile (greater than the SWC) are reported.
statistics allow analysis of population- change, SWC12). a. More precisely: chances are reported
based responses only (Table 1)4. a. Why? Not all changes are worthwhile/ both quantitatively (e.g. 75/25/0 for
As a valid alternative to NHST, clear meaningful. It is the magnitude of the percentage chances of greater/similar/
analytical advances can be reached change/difference that matters first: smaller magnitude than the SWC) and
using magnitude-based inferences (MBI, ‘is the change larger/greater than the qualitatively (e.g. possibly, likely, very
Table 1). This ‘new’ statistical approach, SWC? If yes, how many times greater?’ likely – Figures 1 and 2, and Table 3).
driven largely by Will G. Hopkins’ efforts In this context, change/differences of b. How? These percentage chances and
over the past 15 years, has changed my life, 1x, 3x, 6x and 10x SWC can be considered associated qualitative interpretations
both as an academic and practitioner in as small, moderate, large and very large, are generally set a priori (e.g. <1%, almost
elite sport11. I personally hope that MBI is respectively4. certainly not; 1 to 5%, very unlikely; 5 to
influential with other scientists, as it has b. How? The most appropriate method to 25%, probably not; 25 to 75%, possible; 75
been to me. While the debate will likely define it is however variable-dependent, to 95%, likely; 95 to 99, very likely; >99%,
continue, MBI is today a well-established which forces researchers to adopt a almost certain)
analytical approach in sports science and conscious process when analysing their c. Practically: these percentage chances
in other fields, particularly clinical medicine data. “NHST is easy, but misleading. can be obtained with only a few copy and
where practical/clinical significance often MBI is hard, but honest” (W.G. paste manoeuvres using a specifically-
takes priority over statistical significance4. Hopkins, personal communication)4. designed spreadsheet freely available

38
Figure 1: Example of possible
decisions when interpreting
Case 5 Unclear changes using magnitude-
based inferences. Note the
clear vs unclear cases (based
Case 4 Possible increase
on confidence limits, in
relation to the shaded trivial
Case 3 Likely increase area), which is firstly, the
beauty of magnitude-based
inferences and, secondly, not
Case 2 Unclear possible via null hypothesis
significance testing. Note
also how, for clear effects,
Case 1 Clearly trivial the likelihood of changes
increases as the confidence
limits shrink. Reprinted with
permission from McCormack
-3 -2 -1 0 1 2 3 4 5 6
et al5.
Change (%)
95

*** Figure 2: Individual changes


90 in submaximal heart rate in
a professional soccer player
**
when running at 12 km/h
Large
throughout two competitive
85 seasons (% of maximal
Exercise heart rate (%)

Moderate heart rate). The shaded area


represents trivial changes
Small
(1%)3. The error bars
80 represent the typical error
of measurement (3%)3. The
number of * indicate the
Small
likelihood for the changes
75 to be substantial, with **
Moderate referring to likely changes,
and *** very likely changes.
The magnitudes of the
** Large
70 ** changes are set as multiples
** ** of the smallest worthwhile
**** change (SWC); i.e. 1-3x
(small), 3-6x (moderate) and
65 large >6x SWC. Adapted from
0 200 400 600 800 McCormack et al5.
Days

online13,14. Final decisions can then be applied, the greatest challenge for sport b. Extra decimals and ‘noise’ removed for
translated into plain language when scientists is to find the most efficient type clarity (Table 3).
chatting with coaches: ‘This attacker of data visualisation and reporting to get c. All text written horizontally for
has very likely increased his sprinting their message across. Several considerations readability (Figure 3b).
speed. The magnitude of improvement to optimise tables, graphs and content d. Labels added to graphs so that exact
should be enough for him to win a few presentation are discussed below and values can be seen too (graph for
more balls during matches.’ illustrated in Table 3 and Figure 3. patterns, numbers for details, if
1. Reports should be as simple and as required) (Figure 3b).
PRESENTING THE DATA informative as possible (‘simple but e. Meaningful changes or differences
Similar to the aphorism that all roads lead powerful’): highlighted to be seen at a glance
to (and therefore from) Rome, the same data a. Limited to a few ‘important’ variables (Figure 2) – with different possible
and results set can be presented in many (those that can be used to answer the levels of data analysis. Microsoft
ways (Figure 3). Once the relevant questions questions that coaches and athletes Excel’s conditional formatting de-
have been identified, the best variables have have actually asked and can have an picting MBI is a useful example
been selected and the appropriate statistics impact on the programme). (Table 2).

STRAIGHT SCIENCE TARGETED TOPIC 39


TREATMENT

Table 3

f. Including error bars where possible to


acknowledge uncertainty (typical error Pre (cm) Post (cm) Pre (cm) Post (cm)
of the measurement and confidence
intervals for individual and average Player 1 42 44 Player 1 42 44
values, respectively) (Figure 2 and 3).
g. Using advanced visualisation tools such Player 2 45 45 Player 2 45 45
as Tableau or Microsoft BI. Although
these require some training, they Player 3 47 48 Player 3 47 48
may be helpful to create aesthetically
Player 4 50 49 Player 4 50 49
pleasing and advanced reports that may
be more likely to catch coaches’ and
Player 5 56 58 Player 5 56 58
athletes’ attention.
2. Format of the message should match
Player 6 51 53 Player 6 51 53
with coach and athlete expectations,
preferences and habits (which is linked Player 7 47 50 Player 7 47 50
to the search of the best delivery path,
see below): Player 8 50 50 Player 8 50 50
a. Visual vs verbal information.
b. Paper vs digital reports. Player 9 52 50 Player 9 52 50
c. Quantitative vs qualitative interpre-
tation. Player 10 49 49 Player 10 49 49
d. Tables vs graphs (and types of graphs,
e.g. bars vs radars etc.) Player 11 55 57 Player 11 55 57

DELIVERING THE DATA Player 12 51 53 Player 12 51 53


This last section is definitively less
Player 13 Player 13 54 56
scientific than the previous two: it rather
reflects personal views based on experiences
Player 14 Player 14 46 46
and discussions with peers in the ‘industry’.
These ideas were recently summarised in
Avg 49.6 50.5 49.6 50.6
an editorial for the International Journal
of Sports Physiology and Performance1. SD 4.0 4.2 4.0 4.3
While delivering the data is only one of
the three steps highlighted in the present Standardised diff. 0.22 (small effect) 0.22 (small effect)
paper, it may be the most important. If
sport scientists can’t communicate with P value -
0.06 – No effect 0.03 – Beneficial
the coach, if they can’t create interest and interpretation
interactions with the coaches and players, % for beneficial/
then they obviously won’t manage the get trivial/ 56/44/0 – Possibly 59/41/0 – Possibly
the message through (i.e. deliver) and their harmful effect- beneficial beneficial
fancy reports with high quality stats will interpretation
end up in the bin. The authors conclude:
Table 3: Effect of a nutritional supplement on jumping ability,
“Masters’ degrees and PhD qualifications
which is used to illustrate the misleading nature of p values. In the
often are of little benefit in the quest of
present case, the inclusion of two more subjects (player 13 and 14),
creating such a collaborative and productive which doesn’t even affect the group mean and standard deviation,
environment. Understanding the specific induces a 180° change in the study conclusion using null hypothesis
codes of a sport or a very specific community significance testing (not beneficial vs beneficial). In contrast, both
of athletes takes many years. Having the the small magnitude of the effect (standardised changes >0.218, i.e.
respect and trust from high-profile athletes pre-post/pooled SD) and the overall data interpretation (inferences,
is often more a matter of personality and % of chances for the supplement to have a beneficial effect)
behaviour than scientific knowledge and remain unchanged; they show the effectiveness of the nutritional
skills. As described by the fantastic Dave supplement, irrespective of the sample size.
Martin, we, sport scientists (monkeys) and
coaches and athletes (felines and big cats)
don’t belong to the same species. We have

40
0 0

Player 1
Player 2
Player 3
Player 4
Player 5
Player 6
Player 7
Player 8
Player 9
Player 10
Player 11
Player 12
Player 13
Player 14
Player 15
Player 1
Player 2
Player 3
Player 4
Player 5
Player 6
Player 7
Player 8
Player 9
Player 10
Player 11
Player 12
Player 13
Player 14
Player 15
a b
12000

Player 15 7864 Player 15 7864


10000
Player 14 Player 14 10729
10729
Player 13 10433 Player 13 10433

Player 12 Player 12 9994


Total distance (m)

9994
8000 Player 11 9673
Player 11 9673
Player 10 110947 Player 10 110947
Player 9 10235 Player 9 10235
6000
Player 8 10649
Player 8 10649
Player 7 10704 Player 7 10704
Player
40006 11890 Player 6 11890
Player 5 8030 Player 5 8030
Player 4 12034
Player 4 12034
2000
Player 3 11569
Player 3 11569
Player 2 9891 Player 2 9891
Player 1 11560
Player 1 11560
0
0 2000 4000 6000 8000 10000 12000 14000
Player 1
Player 2
Player 3
Player 4
Player 5
Player 6
Player 7
Player 8
Player 9
Player 10
Player 11
Player 12
Player 13
Player 14
Player 15
0 2000 4000 6000 8000 10000 12000 14000

Total distance (m) Total distance (m)

c different expectations, behave differently


Player 15 7864
Average distance with 90% CI (m) Difference vs 90% CI (m) Average distance
and tendwith to CI (m)our decisions Difference
90%make based vs 90%
Player 14 10729
Player 13 Game of interest 10433 on evidence and facts, while they rely on
Game of interest
Player 12 feelings and experience. Creating these
Player 15 7864 9994 -317
Player 15 7864 -317
Player 11
Player 14 10729 links, building10729
Player 14 these bridges requires time
9673
Player 10 110947 Player+191
13
Player 13
Player 9
10433 and effort. Since the 10433
majority of coaches, +1

Player 12
10235 Player 12 9994 +11
Player 8
9994
10649 supporting
+118
Player 119673
staff and athletes often don’t
Player 11 9673
Player 7
Player 10 110947
10704 know what to expect from
Player 10 scientific support
110947
Player 96 Player 9 +1648
Player 10235
11890
at the club, it is 10235
only by sitting right next
Player 85
Player 8030
-362Player 8 10649 -362
Player 74
10649
12034 to them during training
Player 7 sessions and team
10704
Player 10704
Player 63
Player 11569
11890 debriefs, by sharing meals 11890
Player 6 +1206 and coffees,
Player 52 Player 5
Player 8030
9891
-782 being with them in the 'trenches' that-782
8030 sport
Player 41
Player 11560 Player 4 +1582 12034
12034
scientists can appreciate 11569
Player 3 +1612 what coaches
Player 3 11569
Player 2 0 2000 4000 9891
6000 8000 10000 12000 14000 and athletes
-304 Player 2 9891 may find useful and which -304

Player 1 11560 Player 1


information they rely on 11560
+151 to make their +1
Total distance (m)
decisions1.” Leaving a report on a desk or a
7000 8000 9000 10000 11000 12000 13000 7000 8000 9000 10000 11000 12000 13000
bench in not impactful; it is the conversation
Total distance (m) that Total
makes distance (m) meaningful and that
the data
can only occur once a relationship has been
Figure 3: Illustration of various levels of data visualisation using
developed. Also, while having a strong
distance covered during soccer matches as an example. Compared
with (a), (b) is likely easier to read since all text is displayed character is often compulsory to survive in
horizontally andAverage
more informative:
distance with distance
90% CI labels
(m) are provided on the
Difference vs 90% CI (m) most places, open mindedness, humility
side each the bars Gamefor of
more precision, error bars (typical error of the
interest
and a form of kindness are probably some
measurement, 1%) are added to reflect uncertainty of measurement of the most important personality traits to
Player 15 7864
and the shaded area represents team average ± standard deviation, -317
develop to make an impact in this world.
Player 14 10729
which helps
Player 13
to visualise between-player differences.
10433
(c) highlights +191 With these personal and social engagement
within-player
Player 12 differences for a given match
9994of interest (red cross, +118 skills in mind, it is not surprising that the
players’
Player 11top technical performance/impact
9673 on match result as rated majority of the most renowned researchers,
Player
by 10 vs individual historical data (circle, with
coaches) 11094790% CI).
Playerthe
9 most appropriate method to derive 10235 +1648 sports scientists and performance managers
Since a smallest worthwhile
Player 8 10649 -362 to date have, in parallel to their academic
change is still debated for such data (Table 2), the magnitude of the
Player 7 10704 journeys, exposed themselves deeply to
difference
Player 6 is provided in the actual unit (distance covered in meters
11890 +1206
that is outside
Player 5 the
803090% confidence interval (90% CI, right part -782 of the the elite sport culture, either directly (as
Player 4
graph), 12034
and its interpretation is left to the practitioner. The take-home +1582 athletes) or indirectly (as coaches)1. Only
Player 3 11569 +1612
those may have the ability to properly
message
Player 2
from the graph is that there is no clear association between-304
9891
overall
Playermatch
1 outcome and total distance covered. CI=confidence 11560 +151 deliver data reports and influence decisions
intervals. accordingly.
7000 8000 9000 10000 11000 12000 13000
Total distance (m) STRAIGHT SCIENCE TARGETED TOPIC 41
TREATMENT

Table 4

Changes + Excel
Rounded % HRmax Changes + Excel Changes + Excel
conditional
HR + Excel + Excel conditional conditional
Date Raw HR Rounded HR formatting
conditional conditional formatting (when formatting (when
(based on
formatting formatting >SWC) > SWC+TE)
inferences)

05/08/2014 151.470 151 151 81 2% 2% +2%

19/08/2014 146.884 147 147 79 -1% -1% -1%

25/08/2014 145.104 145 145 78 -1% -1% -2%

08/09/2014 138.808 139 139 74 -5% -5% -5%**

03/10/2014 142.120 142 142 76 -3% -3% -3%

15/10/2014 145.652 146 146 78 -1% -1% -2%

28/10/2014 136.481 136 136 73 -6% -6% -7%**

18/11/2014 143.462 143 143 77 -2% -2% -3%

03/01/2015 142.777 143 143 76 -3% -3% -3%

23/01/2015 140.724 141 141 75 -4% -4% -4%

17/03/2015 148.116 148 148 79 0% 0% +0%

13/05/2015 134.154 134 134 72 -7% -7% -8%***

14/10/2015 145.104 145 145 78 -1% -1% -2%

11/12/2015 140.314 140 140 75 -4% -4% -4%**

11/01/2016 140.861 141 141 75 -4% -4% -4%

24/02/2016 149.621 150 150 80 1% 1% +1%

12/04/2016 143.990 144 144 77 -2% -2% -2%

04/07/2016 162.690 163 163 87 8% 8% +8%***

17/07/2016 157.080 157 157 84 5% 5% +4%**

08/08/2016 136.510 137 137 73 -6% -6% -6%**

Table 4: Example of various levels of data reporting using changes in submaximal heart rate responses to
a standardised submaximal run. The level of clarity and usefulness increases from left to right. Individual
changes in submaximal heart rate in a professional soccer player when running at 12 km/h throughout
two competitive seasons (% of maximal heart rate). Adapted from Buchheit, 20164. SWC=smallest
worthwhile change (1%)19, TE=typical error of measurement (3%)19. A change that is >SWC+TE has a
75% likelihood to be true4. The number of * indicates the likelihood for the changes to be substantial,
with ** referring to likely changes, and *** to very likely changes, using a specifically designed
spreadsheet freely available on the internet12. Data in the far right column are displayed in Figure 2.

42
CONCLUSION Null hypothesis
significance testing is
The value and importance of sport
science varies greatly between elite clubs
and federations. Among the different
components of effective sport science
support, the three most important elements easy, but misleading.
Magnitude-based
are likely the following:
1. Appropriate understanding and
analysis of the data; i.e. using the most
important and useful metrics only and
using magnitude-based inferences inferences are hard,
but honest
as statistics. In fact, traditional null
hypothesis significance testing (P
values) is neither appropriate to answer
the types of questions that arise from
the field (i.e. assess magnitude of
effects and examine small sample sizes)
nor to assess changes in individual information for program design. Strength 15. Buchheit M, Allen A, Poon TK, Modonutti
performances. Cond J 2013; 35:7-14. M, Gregson W, Di Salvo V. Integrating
7. Pettitt RW. The standard difference score: different tracking systems in football:
2. Attractive and informative reports
a new statistic for evaluating strength multiple camera semi-automatic system,
via improved data presentation/
and conditioning programs. J Strength local position measurement and GPS
visualisation (‘simple but powerful’).
Cond Res 2010; 24:287-291. technologies. J Sports Sci 2014; 32:1844-
3. Appropriate communication skills
1857.
and personality traits that help to 8. Al Haddad H, Simpson BM, Buchheit M.
deliver data and reports to coaches and Monitoring changes in jump and sprint 16. Buchheit M, Morgan W, Wallace J, Bode
athletes. Developing such an individual performance: best or average values? Int M, Poulos N. Physiological, psychometric,
profile requires time, effort and most J Sports Physiol Perform 2015; 10:931-934. and performance effects of the Christmas
break in Australian football. Int J Sports
importantly, humility. 9. Hopkins WG. How to interpret changes in Physiol Perform 2015; 10:120-123.
an athletic performance test. Sportscience
2004; 8:1-7. 17. Haugen T, Buchheit M. Sprint running
performance monitoring: methodological
10. Cohen J. Things I have learned (so far). Am and practical considerations. Sports Med
Psychol 1994; 45:1304-1312. 2016; 46:641-656.
References 11. Buchheit M. Any Comments? 18. Hopkins WG, Marshall SW, Batterham
1. Buchheit M. Chasing the 0.2. Int J Sports 2013. Available from: www. AM, Hanin J. Progressive statistics for
Physiol Perform 2016; 11:417-418. herearemycomments.wordpress.com/. studies in sports medicine and exercise
[Accessed 16 March 2016]. science. Med Sci Sports Exerc 2009; 41:3-13.
2. Batterham AM, Hopkins WG. Making
meaningful inferences about 12. Hopkins WG. Statistical vs clinical or 19. Buchheit M. Monitoring training status
magnitudes. Int J Sports Physiol Perform practical significance [Powerpoint with HR measures: do all roads lead to
2006; 1:50-57. presentation]. Sportscience 2002; 6. Rome? Front Physiol 2014; 27:73.
Available from: www.sportsci.org/
3. Buchheit M, Simpson B. Player tracking
jour/0201/Statistical_vs_clinical.ppt
technology: half-full or half-empty glass?
. Int J Sports Physiol Perform 2016 [In 13. Hopkins WG. Precision of the estimate of
press]. a subject's true value [Excel spreadsheet].
In: Internet Society for Sport Science.
4. Buchheit M. The numbers will love you
Sportscience 2000. Available from:
back in return – I promise. Int J Sports
w w w. s p o r t s c i . o r g / r e s o ur c e / s t at s /
Physiol Perform 2016; 11:551-554.
xprecisionsubject.xls2000 [Accessed
5. McCormack J, Vandermeer B, Allan November 2016].
GM. How confidence intervals become Martin Buchheit Ph.D.
14. Hopkins WG. A spreadsheet for deriving
confusion intervals. BMC Med Res
a confidence interval, mechanistic Head of Performance
Methodol 2013; 13:134.
inference and clinical inference from
Paris Saint Germain Football Club
6. McGuigan MR, Cormack SJ, Gill ND. a P value. Sportscience 2007; 11:16-20.
Strength and power profiling of athletes: Available from: www.sportsci.org/2007/ Paris, France
selecting tests and how to use the wghinf.htm [Accessed November 2016]. Contact: [email protected]

STRAIGHT SCIENCE TARGETED TOPIC 43

You might also like