Send to Device Rating Tasks

Instructions / Getting Started

Version 3.8 – June 1, 2020

Introduction 1

Part 1: For Android Raters 2

1.0 Option 1: Using the Rater Hub Android App for Users with Android 4.2 and Higher 2
1.1 Agree to Become a Tester before Downloading the App 2
1.2 Downloading and Installing the App from the Play Store 3
1.3 Task Notification Settings 6
1.4 Using Send to Device with the Android App 8
1.5 Open All Links on Device with the Android App 9
2.0 Option 2: Using a Mobile Browser on Android 11

Part 2: For iPhone Raters 13

3.0 Option 1: Using the Rater Hub iPhone App for Users with iOS 10.0 and Higher 13
3.1 Downloading and Installing the App from Raterhub.com 13
3.2 Authorizing Google as a Trusted Enterprise Developer 15
3.3 Task Notification Settings 17
3.4 Using Send to Device with the iPhone App 19
3.5 Open All Links on Device with the iPhone App 20
3.6 Opening Links in Chrome vs. Safari 22
4.0 Option 2: Using a Mobile Browser on iOS 23

Part 3: For All Other Raters 25

5.0 Using a Mobile Browser on Other Device Types 25

Part 4: FAQs 26
6.0 FAQs: Downloading the Rater Hub Android App 26
7.0 FAQs: Downloading the Rater Hub iPhone App 27
8.0 FAQs: Using Send to Device Tasks 28

Introduction
Some URLs look very different on a mobile phone than they do on desktop computers. ​Send to Device​ tasks make it
easier for you to evaluate mobile webpages by using a combination of your mobile phone and desktop. These tasks allow
you to acquire, rate, and submit tasks on your desktop while viewing the result block links on your mobile phone.

We recommend using the Rater Hub app if you have an Android phone or iPhone. After the one-time setup described in
Option 1 below, the landing page will automatically open on your mobile phone when you click the result block URL from
your desktop after you’ve opened the app. If you’re not using the Rater Hub app or do not have an Android phone or an
iPhone, you'll need to create a Rater Hub bookmark and click to open it for every result block landing page.

Once you have set everything up, please be prepared to use your phone when rating ​Send to Device​ tasks by having it
nearby and fully charged. When you are rating, please keep in mind that there are many different phones and versions,
so your experience rating using the mobile app may be different than another rater’s experience using the app.

Proprietary and Confidential – Copyright 2020 1

Part 1: For Android Raters
1.0 Option 1: Using the Rater Hub Android App for Users with Android 4.2 and Higher
If you already have the Rater Hub app installed on your phone, please skip to ​section 1.3​.

Note:​ ​If you are an exam candidate with an Android phone, ​you will not be able to download the Rater Hub Android app.
In order to complete the exam, you need to use your mobile browser to open the pages on your phone—see ​section 2.0
called "Option 2: Using a Mobile Browser on Android" for detailed instructions.

1.1 Agree to Become a Tester before Downloading the App

Note:​ You will ​not​ be able to find the Rater Hub app by searching in the Google Play Store.

In order to install the app, you must first agree to become a tester of the app. You will need to be accepted into the rating
program in order to become a tester, so please contact your employer/company if you have not already received
confirmation. If you’ve recently been added to the program, ​please wait up to 2 hours for your membership to sync
before you are able to download the Rater Hub app. Some tips:

In order to sync the membership, your Google Groups setting must be enabled to allow group managers to directly add
you to their groups. If you are having permission issues downloading the app, please check your settings
(​https://groups.google.com/forum/#!usersettings/general​) before contacting your employer/company for help.

Then, access ​this link​ on your desktop computer, making sure you are logged in to the Google account associated with
your Rater Hub account. Once you see the following page, select the “BECOME A TESTER” button.

After you have agreed to become a tester, you will see this message confirming you can now download the app:

Proprietary and Confidential – Copyright 2020 2

1.2 Downloading and Installing the App from the Play Store

You can now download the app on your phone from the Google Play Store, using the account that is associated with your
Rater Hub account. We recommend being connected to the Internet via WiFi during this process.

On your phone, scan the QR Code below or access this link:

https://play.google.com/store/apps/details?id=com.raterhub.mera

Note:​ If you get an error message that says "Item not found", try to change accounts in the Google Play app to the
account that you use for your Rater Hub account. Or, if it has been more than 2 hours since you joined the rating
program, please contact your employer/company. Check the FAQs in ​section 6.0​ if you are still having issues.

Then, select the “Install” button and then select the "Accept" button.

To open the app, select the "Open" button.

Proprietary and Confidential – Copyright 2020 3

If you have multiple accounts associated with your Android phone, choose the one that is associated with your Rater Hub
account:

If you are opening the Rater Hub app for the first time, you will be asked to confirm that the app can be used on your
phone. Make sure to select the "OK" button:

Proprietary and Confidential – Copyright 2020 4

Next, you will be asked to decide whether you agree to allow the Rater Hub app to share the installed version number of a
few specific apps with Google:

Please select "Yes" or "No" according to your personal preference. Selecting "Yes" will make you eligible to receive tasks
that require a specific minimum version of these apps, such as a Maps-related task that requires you to have the latest
version of the Google Maps app installed. Please contact your employer/company if you have any questions.

After making an initial choice, you'll also be able to modify this setting at any time. To do so, select "App settings" from
the app's menu options, then adjust the "Installed App Version" toggle switch beneath "Sharing Settings":

And that’s it! You’re now ready to start using the Rater Hub Android app.

Proprietary and Confidential – Copyright 2020 5

1.3 Task Notification Settings

The Rater Hub app allows you to receive notifications when new tasks are available. You can enable/disable task
notifications by selecting "App settings" from the app’s menu options, then adjusting the "Task Notifications" toggle switch
at the top.

You can also specify the following options:

● Notification​ ​Start Time​ and ​End Time

○ The default start time is 8:00 AM and the default end time is 5:00 PM.
○ Must be at least 1 hour apart if task notifications are enabled.
● Time Zone​ used to determine notification times
○ The default is the automatically detected time zone setting on your phone.
● Task Types​ you want to be notified about: ​Desktop tasks​, ​Rater Hub App tasks, Dynamic tasks
○ Notifications for Desktop tasks and Dynamic tasks will be OFF by default. You can enable them by sliding the
toggle switch next to either or both task types to ON.
○ Dynamic tasks are a special task type which are often time-sensitive and created for you "on the fly". The
notification will inform you whether the task should be acquired on your phone or your desktop computer.
○ In addition, dynamic tasks are only available to raters who participate in personalized rating tasks. If you have
questions about the personalized rating program, please contact your employer/company.
● Notification Interval, ​to specify the amount of time to wait between each type of notification
○ The default interval is 3 hours.
○ Dynamic tasks aren't controlled by this setting—you will be notified each time a new dynamic task is available.
● Minimum Tasks to Notify, ​to specify the number of tasks that must be available before you are notified
○ The default minimum is 5 tasks.
○ Dynamic tasks aren't controlled by this setting—you will be notified each time a new dynamic task is available.
● Sound​ and ​Vibrate​ options, including a choice of ringtone for sound

A few additional notes:

● Tapping on notifications will open the Rater Hub app on your phone. If you only have Desktop tasks available,
you will need to go to​ ​www.raterhub.com/​ on your desktop computer in order to start rating tasks.
● If not tapped or dismissed, notifications will automatically disappear within 1 hour.
● You can disable all task notifications any time by sliding the "Task Notifications" toggle switch at the top to OFF.

Proprietary and Confidential – Copyright 2020 6

Proprietary and Confidential – Copyright 2020 7
1.4 Using Send to Device with the Android App

This section applies to raters who are using Android 4.2 or higher and have the Rater Hub Android app installed.

To open links on your device:

1. Open the Rater Hub app on your phone. When you are in the task on your desktop, click on a result block link.
Chrome will automatically open the corresponding landing page on your device.
2. Evaluate the page on your device according to the task instructions, then input your ratings and comments in the
task on your desktop.
3. Repeat steps 1-2 for each result block.

Note​: If you click on a link when your phone's screen is locked or the app is not open, you will see a notification on your
device. You can open the result by clicking the notification link:

Additional note for raters with multiple devices:​ ​If you have the Rater Hub app installed on more than one phone,
Send to Device links will be opened on your most recent device. You can see which device will be used by going to your
settings page on raterhub.com (​https://www.raterhub.com/evaluation/rater/settings​):

To activate a specific Android phone for Send to Device tasks, open the Rater Hub app on that device, tap the hamburger
icon (☰) to open the app's menu options, then select "Activate send to device":

Check the FAQs in ​section 8.0​ if you are having any issues.
Proprietary and Confidential – Copyright 2020 8
1.5 Open All Links on Device with the Android App

This section applies to raters who are using Android devices and have the Rater Hub app installed. We also recommend
that you install the Chrome browser app when using this feature.

Some Send to Device tasks may have a link that says "Open All Links" at the top of the task:

Clicking "Open All Links" allows you to open the landing pages for the entire set of search result blocks in certain tasks.

To open all links on your device:

1. Open the Rater Hub app on your phone. When you are in the task on your desktop, click "Open All Links" at the
top of the task.
2. A special "task companion" page will open on your device. This page will show the Query and Locale, followed by
the URLs for all result blocks on both sides of the task (Left: L1, L2, etc., Right: R1, R2, etc.). Additionally, the
Query is automatically copied to the clipboard on your phone, so that it can later be pasted and used for "Find in
page" search on landing pages if needed.

Proprietary and Confidential – Copyright 2020 9

 ​ he result blocks appear as rows of links that correspond to what you see in the task on your desktop.
Note:​ T

Square icons are used for "duped" result blocks that appear on both
sides of the task.

Circle icons are used for result blocks that only appear on one side of
the task.

Special Content Result Blocks (SCRBs) often include multiple

clickable links or interactive features, so they are not shown in the task
companion page. SCRBs will be indicated as "N/A - Refer to Desktop"
and are not clickable.

Result blocks where ratings aren't required are indicated with a grey
background. These results are clickable, so you can tap on them
when you feel like they will help you understand the query or inform
your ratings.

3. Evaluate the page on your device according to the task instructions.

a. Tap the row for each result block to view the landing page on your device.
b. Use the back button on your phone (or tap the ✕ icon in the top left if available) to return to the task
companion page and select a different result block.
c. Links for landing pages you've already viewed will turn purple on the task companion page.
d. For SCRBs, try to interact with the result block on your desktop by clicking on links, buttons, features, etc.
inside the block. Interactive features will open on your device when available. ​Otherwise, please
assume that interactive result blocks will function as intended for real users, as usual.

4. As you evaluate each page on your device, input your ratings and comments in the task on your desktop.

Proprietary and Confidential – Copyright 2020 10

2.0 Option 2: Using a Mobile Browser on Android
If you are not using the Rater Hub Android app, you can view URLs on your device by first clicking a result block URL on
your desktop, then going to the URL “​www.raterhub.com/url​” in your mobile browser.

Our recommended workflow is to create a bookmark to the link (​www.raterhub.com/url​) in the Chrome browser, then
create a shortcut on your home screen to that bookmark. Please follow these steps before attempting to complete any
tasks.

To create a bookmark and shortcut:

1. Follow the instructions​ ​here​ to add the URL “​www.raterhub.com/url​” as a bookmark in Chrome on your mobile
phone. You will use this same URL to open each result block in the desktop task on your mobile phone.

2. Open the widgets menu on your device. Depending on your OS version, you can do this by long-pressing an
empty space on your home screen, or by selecting the widgets option from the app menu.

Proprietary and Confidential – Copyright 2020 11

 3. Drag the Bookmark widget to your home screen.
4. Choose the Rater Hub bookmark you created in Step 1.

To open links on your device:

After you have set up the shortcut on your device’s home screen, follow these instructions to open each result block
landing page one at a time on your mobile phone.

1. When you are in the task on your desktop, click a result block link. You will see a notification asking you to open
the raterhub.com/url link on your mobile phone that says "Link has been sent to your registered device". If it didn't
open, confirm that your phone’s screen is unlocked. Or visit the following on your mobile browser instead:
www.raterhub.com/url
2. On your device, go to your home screen and select the Rater Hub bookmark you created earlier. The URL will
redirect to the landing page that you clicked on your desktop.

3. Evaluate the page on your device according to the task instructions, then input your ratings and comments in the
task on your desktop.
4. Repeat steps 1-3 for each result block.

Check the FAQs in ​section 8.0​ if you are having any issues.

u=qhjnjlll

Proprietary and Confidential – Copyright 2020 12

Part 2: For iPhone Raters
3.0 Option 1: Using the Rater Hub iPhone App for Users with iOS 10.0 and Higher
If you already have the Rater Hub app installed on your iPhone, please skip to ​section 3.3​.

Note:​ ​If you are an exam candidate with an iPhone, ​you will not be able to download the Rater Hub iPhone app. In order
to complete the exam, you need to use your mobile browser to open the pages on your phone—see ​section 4.0​ called
"Option 2: Using a Mobile Browser on iOS" for detailed instructions.

3.1 Downloading and Installing the App from Raterhub.com

Note:​ You will ​not​ be able to find the Rater Hub app by searching in the Apple App store.

In order to download and install the app, you must first be accepted into the rating program. Please contact your
employer/company if you have not already received confirmation.

In addition, we recommend being connected to the Internet via WiFi before starting the download process.

In the mobile browser on your iPhone, visit ​www.raterhub.com​ and sign in using the Google account associated with your
Rater Hub account:

Proprietary and Confidential – Copyright 2020 13

Then, click the "Download iOS app" link near the top to access the download page:

Next, click the "Download Rater Hub App" button to download the app on your device:

Note:​ The Rater Hub App requires iOS version 10.0 or higher. If your iPhone has an earlier OS version, you will
not be able to download the app from this page.

After the app finishes downloading, you will be prompted to install it. Click "Install" to start the installation on your device:

After the installation completes, the "Rater Hub" app icon will appear on your home screen:

Proprietary and Confidential – Copyright 2020 14

3.2 Authorizing Google as a Trusted Enterprise Developer

After downloading and installing the Rater Hub app, you will need to authorize Google as an enterprise developer before
you can use it on your iPhone.

To authorize Google as an enterprise developer on your device:

1. Open the ​Settings​ app on your iPhone, then navigate to ​General​ > ​Device Management​ (or ​Profiles & Device
Management​ on some phones).
2. You should see a profile for ​Google LLC (Ent)​ listed as an Enterprise App developer:

3. Select this profile, then tap ​Trust "Google LLC (Ent)"​ to authorize Google as a trusted developer on your device.

4. Tap the "Trust" button to confirm your choice:

To learn more about custom enterprise apps on iOS, please refer to the Apple Support page ​here​.

Proprietary and Confidential – Copyright 2020 15

Finally, when you open the Rater Hub app for the first time, you will be asked to decide whether you would like to allow
the app to send you notifications:

(Note:​ W
​ e recommend selecting "OK" so that the app will send notifications for Send to Device tasks, which are
explained further in s​ ection 3.4.​ You will be able to change this option in Settings any time.)

You will then be prompted to sign in to your account:

(Note: If you have multiple accounts on your iPhone, make sure to choose the one that is associated with your
Rater Hub account.)

And that’s it! You’re now ready to start using the Rater Hub iPhone app.

Proprietary and Confidential – Copyright 2020 16

3.3 Task Notification Settings

The Rater Hub app allows you to receive notifications when new tasks are available. You can enable/disable task
notifications by selecting "App settings" from the app’s menu options, then adjusting the "Task Notifications" toggle switch
near the top.

You can also specify the following options:

● Notification​ ​Start Time​ and ​End Time

○ The default start time is 8:00 AM and the default end time is 5:00 PM.
○ Must be at least 1 hour apart if task notifications are enabled.
● Time Zone​ used to determine notification times
○ The default is the automatically detected time zone setting on your phone.
● Task Types​ you want to be notified about: ​Desktop Tasks​, ​Rater Hub App Tasks, Dynamic tasks
○ Notifications for Desktop tasks and Dynamic tasks will be OFF by default. You can enable them by sliding the
toggle switch next to either or both task types to ON.
○ Dynamic tasks are a special task type which are often time-sensitive and created for you "on the fly". The
notification will inform you whether the task should be acquired on your phone or your desktop computer.
○ In addition, dynamic tasks are only available to raters who participate in personalized rating tasks. If you have
questions about the personalized rating program, please contact your employer/company.
● Notification Interval, ​to specify the amount of time to wait between each type of notification
○ The default interval is 3 hours.
○ Dynamic tasks aren't controlled by this setting—you will be notified each time a new dynamic task is available.
● Minimum Tasks to Notify, ​to specify the number of tasks that must be available before you are notified
○ The default minimum is 5 tasks.
○ Dynamic tasks aren't controlled by this setting—you will be notified each time a new dynamic task is available.
● Sound​ options, including the style of notification you want to receive (e.g., Banners, Alerts, etc.)

A few additional notes:

● Tapping on notifications will open the Rater Hub app. If you only have Desktop tasks available, you will need to
go to​ ​www.raterhub.com/​ on your desktop computer in order to start rating tasks.
● You can disable all task notifications any time by sliding the "Task Notifications" toggle switch at the top to OFF.

Proprietary and Confidential – Copyright 2020 17

Proprietary and Confidential – Copyright 2020 18
3.4 Using Send to Device with the iPhone App

This section applies to raters who are using iOS 10.0 or higher and have the Rater Hub iPhone app installed.

To open links on your device:

1. Open the Rater Hub app on your iPhone.

2. When you are in the task on your desktop, click a result block link. Your chosen browser (Safari or Chrome; see
section 3.6​ for more about this option) will automatically open the corresponding landing page, or you will receive
a notification allowing you to open the link on your device.
3. Evaluate the page on your device according to the task instructions, then input your ratings and comments in the
task on your desktop.
4. Repeat steps 2-3 for each result block.

Note:​ If you click on a link when your phone's screen is locked, or when the app is not currently open and active in the
foreground, you will see a notification on your device. You can open the result by clicking the notification link:

Additional note for raters with multiple devices:​ ​If you have the Rater Hub app installed on more than one phone,
Send to Device links will be opened on your most recent device. You can see which device will be used by going to your
settings page on raterhub.com (​https://www.raterhub.com/evaluation/rater/settings​):

To activate a specific iPhone for Send to Device tasks, open the Rater Hub app on that device, tap the hamburger icon
(☰) to open the app's menu options, then select "Activate send to device":

Check the FAQs in ​section 8.0​ if you are having any issues.

Proprietary and Confidential – Copyright 2020 19

3.5 Open All Links on Device with the iPhone App

This section applies to raters who are using iOS 10.0 or higher and have the Rater Hub app installed.

Some Send to Device tasks may have a link that says "Open All Links" at the top of the task:

Clicking "Open All Links" allows you to open the landing pages for the entire set of search result blocks in certain tasks.

To open all links on your device:

1. Open the Rater Hub app on your phone. When you are in the task on your desktop, click "Open All Links" at the
top of the task.
2. A special "task companion" page will open on your device. This page will show the Query and Locale, followed by
the URLs for all result blocks on both sides of the task (Left: L1, L2, etc., Right: R1, R2, etc.) Additionally, the
Query is automatically copied to the clipboard on your phone, so that it can later be pasted and used for "Find on
page" search on landing pages if needed.

Proprietary and Confidential – Copyright 2020 20

 ​ he result blocks appear as rows of links that correspond to what you see in the task on your desktop.
Note:​ T

Row titles with both left and right side numbers indicate "duped" result
blocks that appear on both sides of the task.

Row titles with only a left or right side number indicate result blocks that
only appear on one side of the task.

Special Content Result Blocks (SCRBs) often include multiple clickable

links or interactive features, so they are not shown in the task companion
page. SCRBs will be indicated as "N/A - Refer to Desktop" and are not
clickable.

Result blocks where ratings aren't required are indicated with a grey
background. These results are clickable, so you can tap on them when
you feel like they will help you understand the query or inform your ratings.

3. Evaluate the page on your device according to the task instructions.

a. Tap the row for each result block to view the landing page on your device.
Note: ​If you have selected the option to open links in Chrome, the landing page will open in Chrome
instead of within the app. See ​section 3.6​ for more information on this setting.
b. Tap "Done" when you've finished viewing a landing page to return to the task companion page and select
a different result block.
c. Links for landing pages you've already viewed will turn purple on the task companion page.
d. For SCRBs, try to interact with the result block on your desktop by clicking on links, buttons, features, etc.
inside the block. Interactive features will open on your device when available. ​Otherwise, please
assume that interactive result blocks will function as intended for real users, as usual.

4. As you evaluate each page on your device, input your ratings and comments in the task on your desktop.

Proprietary and Confidential – Copyright 2020 21

3.6 Opening Links in Chrome vs. Safari

The Rater Hub iPhone app allows you to open Send to Device links in Chrome instead of Safari. You can enable/disable
this option by selecting "App settings" from the app’s menu options, then adjusting the “Open Links In Chrome” toggle
switch at the top:

Note:​ Using this option requires that you install the Chrome app from the Apple App Store.

Here are some things to keep in mind to inform your choice:

● If you enable this option to use Chrome:​ Once a link is opened in the Chrome app, the Rater Hub app will no
longer be in the foreground. This means you’ll need to click "Done" in the top left to go back to Rater Hub in order
to make it active again before clicking the next landing page link. Otherwise, you will receive a notification for the
next link instead of having the link open automatically.
● If you leave this option disabled to use Safari: ​All Send to Device links will be opened within the Rater Hub
app itself, and thus will open automatically as long as the app remains in the foreground. (For this reason, many
raters may prefer this choice.)

Proprietary and Confidential – Copyright 2020 22

4.0 Option 2: Using a Mobile Browser on iOS
If you are not using the Rater Hub iPhone app, you can view URLs on your device by first clicking a result block URL on
your desktop, then going to the URL “​www.raterhub.com/url​” in your mobile browser.

We recommend that you use Safari for your Rater Hub account so that you can create a bookmark widget on your home
screen. This is especially helpful if you have multiple accounts on your phone, so that you can use another browser for
your other account(s).

To create a bookmark and shortcut:

1. Open up Safari and go to​ ​www.raterhub.com/url​. If this is your first time going to that URL, you will see the
following message. At the bottom of the screen, click on the icon of an arrow and a square.

2. You will be given several options. Click the “Add to Home Screen” icon.

Proprietary and Confidential – Copyright 2020 23

 3. Next, you will be able to rename the icon. You may want to call this bookmark "Raterhub URL" to make it easily
identifiable.

4. After renaming the icon, click the “Add” link and the icon will now be on your home screen.

To open links on your device:

After you have set up the bookmark on your device’s home screen, follow these instructions to open each result block
landing page one at a time on your mobile phone.

1. When you are in the task on your desktop, click a result block link. You will see a notification asking you to open
the raterhub.com/url link on your mobile phone.
2. On your device, go to your home screen and select the Rater Hub bookmark you created earlier. The URL will
redirect to the landing page that you clicked on your desktop.
3. Evaluate the page on your device according to the task instructions, then input your ratings and comments in the
task on your desktop.
4. Repeat steps 1-3 for each result block.

Check the FAQs in ​section 8.0​ if you are having any issues.

Proprietary and Confidential – Copyright 2020 24

Part 3: For All Other Raters
5.0 Using a Mobile Browser on Other Device Types
If you’re using a non-Android/non-iOS device (for example, Windows phone raters), please follow the instructions below to
set up a bookmark and complete tasks. Please follow these steps before attempting to complete any tasks.

Creating a Bookmark and Opening Links on Device:

1. Add the URL "​www.raterhub.com/url​" as a bookmark in your preferred mobile browser on your phone. You will
use this same URL to open each result block in the desktop task on your mobile phone. You may want to call this
bookmark "Raterhub URL" to make it easily identifiable.
2. When you are in a task on your desktop, click a result block link. You will see a notification asking you to open the
raterhub.com/url link on your mobile phone.
3. Go to the bookmark you created called "Raterhub URL" (from Step 1) and evaluate the page on your device
according to the task instructions, then input your ratings and comments in the task on your desktop.
4. Repeat steps 2-3 for each result block.

Proprietary and Confidential – Copyright 2020 25

Part 4: FAQs
6.0 FAQs: Downloading the Rater Hub Android App
General troubleshooting tips: ​First, contact your employer/company to confirm that you are a member of the correct
rating program. If you’ve recently joined the program, please wait up to 2 hours for your membership to sync before you
are able to download the Rater Hub app.

Question 1: Why am I getting one of these error messages when I try to become a tester so I can get the app?
● Error message 1: "We're sorry, the requested URL was not found on this server."
● Error message 2: "Sorry - nothing to see here. There may be several reasons: The app you’re looking for doesn't
exist or the app developer is not currently running a test or you are not eligible to participate in the testing
program. If you received the link to this page from someone, we recommend you contact them for more
information."

Answer​:​ ​First, contact your employer/company to confirm that you are a member of the correct rating program. If you’ve
recently joined the program, please wait up to 2 hours for your membership to sync before you are able to download the
Rater Hub app. Also, make sure that you are using the account that is associated with your Rater Hub account. If you
have multiple accounts set up on your phone, that may also be causing the issue—see Question 2.

Question 2: I’m having account issues because I have multiple accounts on my phone, so I can’t download the
app. Help!

Answer​: Open an​ ​incognito window​ in Chrome and try again. If you have ever had accounts on your phone other than
the one associated with your Rater Hub account, there may be lingering authentication pieces that are causing issues.

Question 3: The app crashes and I can’t open it. What should I do?

Answer​: If the app crashes, please make sure to click the “Report” button so that the crash is logged and can be
investigated—you can see what this looks like in the ​first screenshot​ ​on this page​. Otherwise, try to uninstall and then
re-install the app.

Question 4: Will there be updates to the Android app?

Answer​: Yes. We will occasionally update the app to include bug fixes and/or feature improvements. If you have
checked the “Auto-update” option for this app in the Google Play Store, the app will update automatically when updates
are available. Otherwise, you will have to open the Google Play Store app and manually select the “Update” option. In the
future, you may be prompted to update the app before you can access any tasks, if the version you have is too old.

Question 5: I’m not able to update to the latest version of the Rater Hub app.

Answer​:​ ​New versions of the app may take up to 24 hours to become available in the Google Play Store. If you are
expecting an update but still haven’t received it in 24 hours, please contact your employer/company to confirm that you
are in the correct rating program. If you recently joined (or left and rejoined), you may not be able to update to new
versions of the app.​ In this case, please ​wait up to 2 hours for your membership to sync and to see the option to update.

Question 6: I clicked the "Sign out" button, which closed the app. But, when I open the app again, I’m still
signed in. What’s going on?

Answer​: This will happen if you only have one account associated with your phone. However, if you have more than one
account on your phone, signing out and then opening the app again will prompt you to re-select the correct account
associated with your Rater Hub account.

Proprietary and Confidential – Copyright 2020 26

7.0 FAQs: Downloading the Rater Hub iPhone App
Question 1: When I try to open the app, I receive an error saying that Google is not a trusted developer. What
should I do?

Answer:​ You need to authorize Google as an enterprise developer before you can use the app on your iPhone. Please
follow the instructions in ​section 3.2​ above.

Question 2: When I sign in to the app, I receive a popup message notifying me that Rater Hub wants to use
"google.com" to sign in. What should I do?

Answer:​ If you are using iOS 11.0 or higher, you will see the following message each time you sign in to the app:

If you tap "Continue", you will then be able to sign in to your Google account on the next screen. This allows the Rater
Hub app to authenticate you using the Google account associated with your Rater Hub account. Then, you can proceed
to use the app for rating tasks as usual.

Question 3: I’m having account issues because I have multiple accounts on my phone, so I can’t download the
app. Help!

Answer:​ When you go to ​www.raterhub.com​ on your iPhone to download the app, make sure you are logged in to the
Google account associated with your Rater Hub account. If you have ever had accounts on your phone other than the
one associated with your Rater Hub account, there may be lingering authentication pieces that are causing issues. You
may need to clear the cache from your mobile browser.

Question 4: Will there be updates to the iPhone app?

Answer​: Yes. We will occasionally update the app to include bug fixes and/or feature improvements. Your
employer/company will notify you when new versions of the app become available. In addition, a notification will be
shown within the app if a new version is available, along with a link to download the new version. Automatic updates are
not possible for this app on iOS devices, so you will need to go to ​www.raterhub.com​ on your iPhone to download and
install the new version, following the same instructions as in ​section 3.1​ above.

Question 5: Feature [xyz] doesn't work in the iPhone app. Is there something wrong with my device?

Answer: ​Some features may be available in the Android app but not in the iPhone app, or vice versa. While we hope to
keep the Android and iOS apps as similar as possible over time, you may notice subtle differences in UI and functionality.
Please refer to ​section 1.0​ (Android) or ​section 3.0​ (iOS) for more information on features available in each OS.

Proprietary and Confidential – Copyright 2020 27

8.0 FAQs: Using Send to Device Tasks
Question 1: When I go to raterhub.com on my mobile device, it says there are no tasks available. Why?

Answer​:​ ​For Send to Device tasks, you need to acquire the task on your desktop, then you can click the result block links
to view the landing pages on your mobile device. If you’ve acquired the task on your desktop, make sure to click the
result block links before trying to open the result on your mobile device.

Question 2: Why am I seeing this error when I load the​ www.raterhub.com/url​ in my browser?
● Error message: “Send to Device. This is the url that will automatically redirect to a page sent via the "send to
device" feature. In the future, this link will automatically redirect to your last selected link rather than show you
these instructions. For your convenience, we recommend that you bookmark this page or add it to the home
screen on your mobile device. Please refer to the instructions here for more info.”

Answer​:​ ​You are seeing this error because you have not clicked on a result link. After you acquire the task on your
desktop, make sure to click the result block link before trying to access this URL.

Question 3: Why can’t I get the pages to load on my tablet?

Answer​: You must use your phone, not tablet, to complete these tasks.

Question 4: I’m trying to open the links in my mobile browser but I still can’t get it to work. Help!

Answer​:​ ​If you have multiple accounts set up on your phone, this may be causing issues. If you have an Android phone
or an iPhone, we recommend you download and use the Rater Hub app. If you are using the browser method described
in ​section 2.0​ (Android) or ​section 4.0​ (iOS), we recommend that you use Chrome on Android phones or Safari on
iPhones so that you can create a bookmark widget on the home screen of your mobile device.

Question 5: I have the Rater Hub app installed on my mobile device, but when I clicked a result block link from
my desktop, nothing happens on my phone.

Answer​:​ ​Open the Rater Hub app and then try again. If the app is closed or inactive, then it will not work.

If you are using the app on an iPhone (any version) or an Android phone with OS version 10.0 or higher, please note that
the app must be ​both open and active in the foreground i​ n order for links to open automatically. If you click on a result
block link when the app is open but not active—for example, while you have another app open, or while you are still
viewing the landing page of another result block in Chrome—you will see a notification on your device. You can open the
result by clicking this notification link. Please refer to ​section 3.4​ (iOS) or ​section 1.4​ (Android) for more details.

Question 6: I have the Rater Hub app installed on multiple devices, and I want to use a specific device right now
for Send to Device tasks. How do I choose which phone will be used to load result block links?

Answer: ​If you have the app installed on more than one phone, Send to Device links will be opened on your most recent
device. You can see which device will be used by going to your settings page on raterhub.com
(​https://www.raterhub.com/evaluation/rater/settings​).

You can also activate a specific phone for Send to Device tasks by opening the Rater Hub app on that device, then
selecting "Activate send to device" from the app's menu options (see ​section 1.4​ for Android phones or ​section 3.4​ for
iPhones). If you are already in the middle of a Send to Device task, you may need to reload the task page on your
desktop in order for your preferred mobile device to be used.

Proprietary and Confidential – Copyright 2020 28

Question 7: I made a bookmark, but every time I go back to it, I’m seeing the first URL that loaded.

Answer​:​ ​You should create the bookmark before clicking on any result block links; otherwise, the bookmark will be the
landing page URL. If you are always seeing the first URL that loaded, manually check your bookmark URL by editing it,
and changing it to www.raterhub.com/url.

Question 8: What happens if I have both the Rater Hub app installed and the browser bookmark?

Answer​:​ ​You can have both methods working on your phone as clicking the result block link will send the page to both the
Rater Hub app as well the browser.

Question 9: I’m using the browser method, but every time I click on a result block, the same landing page loads.

Answer​:​ ​If you are using an iPhone, try loading the www.raterhub.com/url link in a different browser, re-typing the URL (if
you are using the bookmark), and/or closing the browser completely before trying again. It may also help to reboot your
phone.

If you are using an Android phone that has the Lollipop OS (version 5.0-5.1), this may be due to a default setting in
Chrome that shows new tabs in your recent apps list for each link that you click. To change the setting, go to Chrome
settings and set “Merge tabs and apps” to Off.

Question 10: I read through the FAQs but still can’t get any landing pages to open on my phone.

Answer​:​ ​If you need to contact your employer/company for additional help or support, please describe your issue in
detail. If you receive error messages or popups in your browser after clicking a result block link, please provide the ​exact
text​ of the error message and/or a screenshot if possible.

Question 11: I’m an exam candidate and I can’t seem to download the Rater Hub app.

Answer​:​ ​If you are an exam candidate, you will not be able to download the Rater Hub app. For the exam, please use
your mobile browser to open the pages on your phone—see "Option 2: Using a Mobile Browser" in ​section 2.0​ (for
Android phones) or ​section 4.0​ (for iPhones).

Question 12: I have been using the app to load my Send to Device tasks, but it suddenly stopped working and
won’t send the landing pages to my phone.

Answer​: Some raters have resolved this issue by trying one or more of the following:

● Turning the phone on and off and/or turning the phone’s WiFi on and off
● Uninstalling and reinstalling the app
● Restarting the router and switching to mobile data
● Trying to sign out (and then back in) of all Google services, and making sure the default account is the one
associated with the Rater Hub account (​these instructions​ may help)

Proprietary and Confidential – Copyright 2020 29