Th

u
17 rsda
2.1 y,
6.2 Ap
54 ril
.9
by 21, 2
He 022
nd
IP
m d Mo from
f r o e ha IP
22 oham me
2 0 d
1, M
r i l 2 end
p
a y, A 9 by H
rsd .254.
u
Th 2.16
17
Commenting
Th
u
17 rsda
2.1 y,
6.2 Ap
54 ril
.9
by 21, 2 Best Practices
He 022
nd
Mo from m
IP
ha IP o
fr med
me 2 2 a
d
1 , 20 Moh
l 2 nd
A pri y He
, b
r s day 54.9
u 2
Th 2.16.
17

TELUS International confidential 1

 Th
u
17 rsda
2.1 y,
6.2 Ap
54 ril
1. Why leave comments? .9
by 21, 2
He 022
nd
IP
m d Mo from
f r o e ha IP
2. What makes a good
1, 2 0 22 oham
M
me
d
r i l 2 end
p
y, A 9 by H
u
a
rsd .254.
Th 2.16
comment?
17
Th
u
17 rsda
3. Examples of good Agenda
2.1 y,
6.2 Ap
54 ril
.9 comments.
by 21, 2
He 022
nd
Mo from m
IP
ha IP o
fr med
4. Examples of bad
me
d
1 ,
2 2
20 Moh
a
l 2 nd
A pri y He
, b
comments. r s day 54.9
u 2
Th 2.16.
17

TELUS International confidential

 Commenting: Best Practices

Th
u
17 rsda
Comments should be included in any
2.1 y,
6.2 Ap
54 ril
of
. the following situations.
.9
by 21, 2
He 022
nd
IP
m d Mo from
f r o e ha IP
22 oham me
2 0 d
p r i
1,
l 2 end
M
• A Relevance rating below
a y, A 9 by H
rsd .254. Excellent.
“Comments are mandatory for any rating
u
Th 2.16
17
below
Th
Excellent for Relevance or below • Data Accuracy (e.g.
urs
17 Correct/Perfect for Data Accuracy”
2.1 day,
6.2 Ap
Name/Address/Pin) which is not
54 ril
.(Guidelines Section 1.3.6.).
9 b 21,
y 2He 022
nd
rated Correct or Perfect.
Mo from IP
ha IP
me • Anything else unusual 2 2 fr merelating
o m
a
d
d 0 oh
1, 2 d M
to the result. Apri y Hen
l 2
, b
r s day 54.9
u 2
Th 2.16.
17

TELUS International confidential 3

 Why leave comments?

Th
u
17 rsda
2.1 y,
Data analysts use your comments to understand your rating choices when
6.2 Ap
54 ril
.9
by 21, 2
evaluating yourIPtasks. By leaving meaningful comments, you enable them to He 022
nd
Mo from
m
fro med ha IP
efficiently:1, 202 Moha
2 me
d
2 d
p ril Hen
A y
s day, 4.9 b
ur 25
• Process this data
Th 2.16.
17
• TFind
hu
rs
potential issues
17
2.1 day,
6.2 Ap
54 ril
.9
by 21, 2
He 022
nd
Mo from m
IP
ha IP o
fr med
me 2 2 a
When high quality comments are included, you rating accuracy can be verified much
d
1 ,
l 2 nd
20 Moh
pri y He
more efficiently! r s
, A
day 54.9
b
u 2
Th 2.16.
17

TELUS International confidential 4

 What makes a good comment?

T
Your comment should explain the reasoning behind your rating172h.choice.
urs
d
16 ay, A
Without looking at
.25 pr
the task in any great detail, your rating should be easily understood 4.9 after
by 21, 2 reading your
il
He 022
comment! ro m
I P
d
nd
Mo from
h I
f e am P
2 0 22 oham ed
1, M
r i l 2 end
You should also include any research resources and links that are relevant for the task and
a y
p
, A 9 by H
u rsd .254.
support your rating. Without adding the correct information and the source it came from, a
Th 2.16
17
reviewer
Th
u
will have to redo all your research.
17 rs
2.1 day,
6.2 Ap
54 ril
.9
by 21, 2
At the same time, your comments should be concise and to the point. Don't waste your
He 022
nd
Mo from IP
time writing long comments - Only include relevant information!
ha IP
me 22
o m
fr med
a
d 0 oh
2 1, 2 d M
l n
A pri y He
,
ay 9 b
All your comments have to be in English! The person analyzing your tasks may not
u rsd .254.
Th 2.16
necessarily speak your local language. 17

TELUS International confidential 5

 Possible Elements of a Good Comment

Th
u
Some noteworthy attributes that point towards a high quality comment 17 rsda
2.1 y,
Title
include: Title 6.2 Ap
54 ril
.9
by 21, 2
He 022
nd
IP
m d Mo from
o
• References to the specific user intent and location intent.
f r e ha IP

% %
22 oham me
2 0 d
1, M
l 2 end
y
p r i
, A 9 by H
Remember to
• Explanations for issues with the user intent or distance/prominence.
u
Th 2.16
a
rsd .254. always use a
17
URL shortener
• Text
Th
17The inclusion of data corrections
urs here
2. day
and links to the sources of these
Text here such as bit.ly or
16 , A
corrections.
.25 pr
aximus.4.9 il 2 aximus. tinyurl.com!
by 1,
He 2022
nd
Mo from IP
• Any locale-specifc knowledge that impacted the final rating.
ha IP
me 2 2
o m
fr med
a
d
1 , 20 Moh
l 2 nd
A pri y He
• Examples/quotes from the guidelines supporting the analyst's ratings. u r s
,
day 54.9
2
b
Th 2.16.
17

TELUS International confidential 6

 Examples of Good Comments

"User is looking for a specific apartment complex - http://saladoatwalnutcreek.com/.

Th
urs
This is a
17
random intersection in a different city and not relevant to intent." 2.1 day,
6.2 Ap
4.9 il 2 5 r
Explanation: The user intent is not obvious from the query and therefore specifically
by 1, 2
He 022
stated in the
nd
comment. The comment
m
IP also explains why the result is unhelpful. Mo from
ro ed f h I am P
2 0 22 oham ed
1, M
r i l 2 end
p
a y, A 9 by H
rsd .254.
"This pharmacy is located inside the intended Walmart. Rated Bad because the result doesn't satisfy
u
Th 2.16
17
the user's intent based on its containment relation with the intended POI alone according to section
Th
5.1.8.
17 rsof
u
2. day
the guidelines."
1
6.2 Ap ,
Explanation:
54 ril The comment explains the rationale behind the rating choice by explaining the demotion
.9
by 21, 2
that has been He applied.
0
nd 22 f P
Mo rom I
ha IP
me f rom ed
m
d , 2 022 oha
21 d M
p ril Hen
d a y, A .9 by
"This is a random business result that partially matches query but is not related to the quiered chain
4
urs 25
of stores "Target". Thus not relevant to intent." Th 2.16.
17
Explanation: The comment states the user intent and explains why it is not met by the result, which
happens to randomly match parts of the query.

TELUS International confidential 7

 Examples of Good Comments

Th
u
17 rsda
2.1 y,
6.2 Ap
"Across the road from the correct building, should be 40.153721, 74.698486. 54 ril
.9
by 21, 2
He 022
https://tinyurl.com/ybcrtuyt"
m
IP nd
Mo from
r o
ed ha IP
Explanation: The 0 2 2 f comment
h am states the correct Pin location and why it's incorrect. It also me includes the
, 2 o d
1 d M
sources and l 2 a nURL
pri He
shortener is used for the link.
A y
s day, 4.9 b
ur 25
Th 2.16.
17
Th
u
17 rsda
2.1 y,
"Correct postal code is 96813 according to the official website https://bit.ly/2MYpEGT"
6.2 Ap
54 ril
.9
Explanation: by 21The
He 2022 comment states the correct data and where it was confirmed. A URL shortener was
,
nd
used for the link. Mo from m
IP
ha IP o
fr med
me 2 2 a
d
1 , 20 Moh
l 2 nd
A pri y He
, b
r s day 54.9
u 2
Th 2.16.
17

TELUS International confidential 8

 Examples of Unhelpful Comments

Th
u
"Pin is approximate" 17 rsda
2.1 y,
6.2 Ap
Explanation: This comment is unhelpful as it only restates the rating that was 54 submitted.
r
.9 il 21 There is no
by ,2
He 022
explanation WHY the IP pin rating is Approximate and where the pin should be dropped nd instead.
Mo from
ro m d ha IP
0 2 2 f hame me
, 2 o d
1 d M
"The user intent is a Motel."
A
l 2
pri y He
n
, b
Explanation:
r s day 54.9 The comment correctly states the user intent, but it doesn't explain why the result is not
u 2
Th 2.16.
satisfying
17 this user intent.
Th
u
17 rsda
2.1 y,
"Perm closed."
6.2 Ap
54 ril
.9
Explanation: by 21This
He 2022 comment is missing the source from where the information is taken. Also,
,
nd
abbreviations should Mo from be avoided, unless they are very commonly used. m
IP
ha IP r o d f e
me 22 oham
d 2 0
1, M
r i l 2 end
"Das Resultat ist mehr als 20km vom User entfernt und es gibt viele nähere Resultate." a
p
y, A .9 by
H
d 4
Explanation: The comment is in German, which Is not helpful for the dataurs 6.25
Th 2analysts
.1 who don't speak this
1 7
language. All comments must be written in English.

TELUS International confidential 9

 Examples of Unhelpful Comments

Th
urs
"The query appears most likely to be a category search for a business 17 type
2.1 day, called internet café. The
6 Ap
result is an internet café, as asked for in the query, but it is extremely far.25from 4.9 ril 2 the fresh viewport and
by 1, 2
He 022
the user. The fresh m
IPviewport is over Funabashi city, where also the user is located. nd In Funabashi
Mo from
fro ed ha IP
city, there are, 20many 22 oham intent cafés, so the user would not want to travle so far to the result. me
d Three
1 d M
examples p il 2 einternet
rfor n cafés in Funabashi city are: http://mangakissa24.com - http://www.media-
, A y H
a y 9 b
u rsd .254.
café.ne.jp/tenpo/funabashi/ - https://www.facebook.com/netsumochiba"
Th 16 2.
17
Explanation: This comment is unnecessarily long. Internet cafés are extremely popular in Japan, which
is why
Th we don't need to specify some of the many examples that would fit the query. A more concise
u
17 rsda
2.1 y,
comment 6.2 Awould
54 pril
be "Query is for an internet café. Result is such business, but extremely far away while
.9 2
many results by 1,exist
H 202 within the viewport".
end 2
Mo from m
IP
ha IP o
fr med
me 2 2 a
"Street number is 22500 https://www.tripadvisor.com/Restaurant_Review-g35489-d4614768-
d
1 ,
l 2 nd
20 Moh
pri y He
Reviews-Pizza_Hut-Idaho.html#RESTAURANT_DETAILS" , A
day 54.9
b
r s
Explanation: Apart from the fact that this is not an official source and u
can't
Th 2.16be .2 used alone for data
17
verification, a URL shortener should always be used

TELUS International confidential 10

 Thank You! Th
u
17 rsda
2.1 y,
6.2 Ap
54 ril
.9
by 21, 2
He 022
nd
IP
m d Mo from
f r o e ha IP
22 oham me
2 0 d
1, M
r i l 2 end
p
a y, A 9 by H
u rsd .254.
Th 2.16
17
Th
u
17 rsda
2.1 y,
6.2 Ap
54 ril
.9
by 21, 2
He 022
nd
Mo from m
IP
ha IP o
fr med
me 2 2 a
d
1 , 20 Moh
l 2 nd
A pri y He
, b
r s day 54.9
u 2
Th 2.16.
17

TELUS International confidential 11