Photomath Reviewer Guidelines
Photomath Reviewer Guidelines
quality content that helps the User easily understand the solution of the given problem.
Write the solving procedure for a task, from the beginning to the end, including the
answers to all questions.
2. Correct PM Solution.
3. LaTeX.
Write all mathematical objects in LaTeX. This includes variables, numbers, formulas,
symbols, years, number of days, measurements, etc.
4. Language.
5. Solution Step.
The answers to all the questions of the task must be written in the Solution Step (the last,
red Step in the Editor). The Solution Step must follow from the Solving Steps, but it
should not refer to the Solving Steps, since it is an independent unit in the PM Solution.
6. Coloring.
Within a Step, the corresponding elements of the Visual Content, Block LaTeX, text or
Inline LaTeX have to be colored using the same color.
7. Visual Content.
Create any Visual Content on your own, using the proper colors. Visual Content should
be mathematically correct, and all-important elements should be clearly visible in the
Previewer.
8. Input-Description-Output Form.
All algebraic manipulations within the Solving Steps must be written in the following
form: Input-Description-Output.
Breaking any of the above rules represents an error in the PM Solution and indicates that it
should be returned. Some Solution Rules focus more on the appearance and technical aspects of
the PM Solution. The first two Solution Rules, on the other hand, represent crucial
conditions which have to be fulfilled for the PM Solution to be useful and educational to the
Users in the Photomath App.
For this reason, a PM Solution contains a critical error if it breaks the Complete Solving
Procedure rule or the Correct PM Solution rule. If the PM Solution breaks any other rule, it
contains a minor error. In both situations, the PM Solution should be returned to the Expert who
wrote it - but critical errors must never be overlooked, no matter how little they seem.
PM Solution Guidelines
Applying Solution Guidelines when writing PM Solutions adds quality to Photomath Solutions.
The aim of the Solution Guidelines is to keep all or most Photomath Solutions uniform in style,
so they are always easily recognized, and to make Solutions easier to understand and more
approachable for Users in the Photomath App.
PM Solution Guidelines
Applying Solution Guidelines when writing PM Solutions adds quality to Photomath Solutions.
The aim of the Solution Guidelines is to keep all or most Photomath Solutions uniform in style,
so they are always easily recognized, and to make Solutions easier to understand and more
approachable for Users in the Photomath App.
LaTex
PM Solver
Hints
Legal
Coloring in PM Solutions
Visual Content Layout
Input-Description-Output form (and Math Sequence)
Methodology
Specific types of tasks
Once again, PM Solution Guidelines are just additional advice recommended for ensuring a better quality
of a Solution, and they are not an obligation required for a Solution to be correct. The accuracy of a
Solution should be determined only by examining the eight PM Solution Rules, while the PM Solution
Guidelines are used to assess the quality once the Solution qualifies as accurate.
Methodical
Coherent
Economical
The above-noted PM Solution Qualities don’t have to be satisfied in order for a Solution to qualify as
correct, but it is certainly desirable that they are fulfilled for better and more educational content quality.
Important: if you determine that a certain PM Solution should be returned, make sure that any feedback
you add is related to one of the listed return reasons - these are the only valid reasons to return a
Solution.
do not add feedback for Guidelines!
Missing info should be used if the PM Solution you are reviewing is written for a task
that lacks information needed to solve it. Make sure you examined the whole Task
Content and Example Content and, if you determine that the task could not have been
solved with the given information, return the Solution to the Math Expert who wrote it,
using this return reason. Find out more about this return reason on the Missing
information page.
Inappropriate behavior should be used if the PM Solution contains content that is not
related to the task that should be solved. Return the Solution using this return reason if
you encounter anything other than the solution in the Solving Steps or the Solution Step.
Keep in mind: the feedback should be educational, so the Math Expert who made a mistake can
learn from it and not repeat the mistake again. Do not use inappropriate language in your
feedback. The Solution should always be returned to the Math Expert who wrote it when it
doesn’t follow the PM Solution Rules.
You can use $$ to write a part of the feedback in LaTeX. For example, when you
write $\frac{x+y}{x}$ in the feedback, the Math Expert will see a fraction in LaTeX form. Also,
you can write a part of your feedback in Block LaTeX if you put it between $$ $$ characters. It
is useful, for example, when you want to show in feedback how to write a Step in the Input-
Description-Output form, since the Input and the Output must be written in Block LaTeX.
EXAMPLE COMMENTS:
For Language:
The description is not a full sentence and there is no punctuation in the step.
If there are smaller mistakes made, but the content is still complete and correct, lower the grade.
As it was mentioned in the reminder about the PM Solution Rules, breaking the first two Solution
Rules, Complete Solving Procedure and Correct PM Solution, constitutes a critical error which must
be corrected regardless of how small it seems.
Remember, if you determine that a Solution Rule is broken, add complete and detailed feedback, with
the appropriate broken Rule as the return reason and with an explanation of the mistake and how to
correct it.
Below, the whole algebraic manipulation on an equation is performed in one Solving Step. This Step
must be returned, since it breaks the Complete Solving Procedure rule and the Input-Description-
Output Form rule: the calculation must be done in IDO form and each change in the equation should be
in a separate Step/Sub step and sufficiently explained.
Everyone (with the appropriate level of knowledge, depending on the math field) should be able to
understand our Solutions. On the other hand, if some part of a Solution is understandable and clear, but
you think it can also be better phrased, this is not a reason to return the Solution, maybe just for lowering
the score.
CORRECT PM SOLUTION:
If a Step contains a wrong number or the numbers from the imported example are not
replaced, use the Correct PM Solution rule as the return reason when you are returning
the Solution. The error you found affects the correctness of the Solution. The same is
valid if someone makes a typo which results in a wrong mathematical term or object
(equation, inequality, expression, etc).
A Solution is NOT OK if the statement "2+x<3" is called an equation instead of an inequality. Also, if
the graph of a function is called a function, as for example in the phrase “the function intersects the axis”,
this is not mathematically correct.
Make sure you notice all mathematical errors! Mistakes of this kind are all critical errors, and they
have to be corrected, whether they are accidental typos or spread through the entire Solution. This is valid
for errors in terminology, errors in labels, errors in methodology and errors in calculations.
LaTeX
LaTeX error that must be returned:
3. A mathematical object or its part is not written in LaTeX (y, the parentheses)
LANGUAGE
For Language: Further, if the language mistake you found is related to mathematical terms or it greatly
affects the meaning, that is reason enough to return the Solution since the User might get confused.
The Solution should also be returned if it does not use full sentences, with proper
capital letters and punctuation, especially if these mistakes are consistent. If you notice
the mistake in punctuation or capitalization happened once by accident and does not
affect the meaning, you can overlook it.
However, if a certain Step refers back to a previous Step by naming it, this is NOT OK and should be
returned. An example Step with such content is given below:
Therefore, if the pronouns I, we or you are used, the PM Solution should be returned. Also, if the
language used is not English, return the Solution.
SOLUTION STEP
When the Solution Step starts with expressions such as “Therefore”, “Hence”, “It
follows” or “So”, it should be returned under the Solution Step rule since this means
the statement in the Solution Step is not independent. These expressions (and similar)
refer back to the Solving Steps, which is not allowed by the Solution Step rule.
When a Solution Step does not contain all the answers to the questions asked, return the
Solution. This is in direct relation to the Complete Solving Procedure rule, so it also constitutes
a critical error: all answers should be given in the Solution Step, and the procedure for finding these
answers should be included in the Solving Steps. (The exception is when two visuals are required because
a Step can contain only one Visual Content.) Also, if the task requires proof or an explanation, or many
different and long requirements, it is OK if the Solution Step contains a summary of the most important
points.
Choose the Solution Step Rule as the return reason only if the Solution Step breaks it
COLORING
You should return the Solution because of coloring if colors are not used in the Input-Description-Output
form, if values substituted into a formula given by the Hint are not color-coordinated, if new or relevant
elements in Visual Content are not color-coordinated with the appropriate part of its description or if
color-coordination is improper (for example, if the same value is colored in two different colors).
If the colors used on text, LaTeX, or Visual Content differ from the colors available in the Editor
(primary, secondary or tertiary + neutral gray), the Solution is NOT OK and it should be returned. This is
of course not valid for the automated procedures within the PM Solver, which are automatically colored.
It is also not valid for content within a Math Sequence. In this sequence, only the fourth color, Math
Sequence LaTeX color, is available. It should be used in the same way as regular colors are used in
Solving Steps in the Input-Description-Output form.
VISUAL CONTENT
The coordinate axes should be labeled in every step that contains a coordinate system, and the
PM Solution that does not contain these labels should be returned, because Visual Content is
not mathematically correct without these labels.
NOTE: if you notice that Visual Content contains a mathematical error - this break both
the Visual Content rule and the Correct PM Solution rule. Most importantly, this
means mathematical errors on Visual Content are also considered critical errors.
If the colors used on the graph don’t exactly match the colors in the PM color palette, but
they are close shades of those colors, don’t return the PM Solution. However, as
mentioned in the Coloring rule, if the colors in Visual Content visibly don't match
those in the Editor, the Solution should be returned because it breaks both the Coloring
and the Visual Content rule. It is still a minor error, because breaking each of these rules
constitutes a minor error.
Every element of Visual Content in the PM Solution should be big enough for a User to be able
to see it in the App (you can see how the User sees it in the Previewer, to the right of the Editor).
If a graph, a picture, or some labels on the Visual Content are too small, the PM Solution should
be returned.
All Visual Content should be created by the Math Expert writing the Solution, so if the
picture is downloaded from the Internet or copied from the book, this is a valid reason to return
the Solution. (The only exception is if appropriate Visual Content is found in another PM
Solution, content from other PM Solutions can be used.)
INPUT-DESCRIPTION-OUTPUT FORM
If there is no color-coordination, the Solution should be returned so the colors are added to those Steps.
The exception is if the calculation performed is simple and/or the change applies to the whole
expression/statement in Block LaTeX - in this case, the color-coordination does not carry significant
explanatory value.
If the Input of the current Solving Step isn't the same as the Output of the preceding one, the
Solution should be returned, because each change must be described and explained.
Note: if a step in the manual calculation includes reducing a fraction or something similar, the LaTeX
command \cancel {} is often used in the Input, and it does not appear in the previous Output. This is OK
because this command only crosses the parts that will be reduced - it is only important that the
expressions/symbols “behind” the cancel commands equal those in the Output of the previous Step.
In a Solving Step that should be in the Input-Description-Output form, return the Solution and add
feedback if the Input or the Output is not written in Block LaTeX, if they are written in the wrong order,
if any element is missing or there are too many elements (that is also related to the Complete Solving
Procedure rule).
LaTeX that is OK
If a measurement unit is not written within the LaTeX command \text, then the PM
Solution should not be returned. This is a minor mistake and it won’t hinder the final
User’s understanding of the Solution, although it is recommended that you write all
measurement units within the command \text. The same is valid for any other words
written in LaTeX. You can lower the score of the Solution, but don’t return it.
If a sentence starts with an Inline LaTeX expression, this is a good reason to lower the
score of the PM Solution, but not to return the Solution.
If the LaTeX expressions are correct, clearly visible, and properly rendered in the
Previewer, you do not have to return a PM Solution only to change a certain LaTeX
command.
If there is a fraction inside the parentheses, it is OK if the LaTeX command \left(...\right)
is not used. The expression would indeed look better with this command, but the
recommendation to use it is a guideline. Not using it does not break any Solution Rule
and so it is not reason enough to return the Solution, just to lower its grade.
If someone uses a LaTeX command that is not in the PM Solution Standards, but it is
visible in the Previewer, do not return the Solution, this is OK.
HINTS
Math Experts do not have to use Hints. If the Solution is understandable without them or
the concepts are sufficiently explained in the Solving Steps, the Hints do not have to be
used.
Repeating the same Hint several times should be avoided, but it is not the reason to return
a Solution. This type of mistake should only influence the final rating.
It is OK to substitute the values into an equation/expression/inequality in a Step that is
not in the Input-Description-Output form. The Steps in the form of Text-Block LaTeX
are often used when substituting values into the formula from a Hint (make sure that the
values that are being substituted are colored properly).
Coloring in PM Solutions
If the color priority is not respected, like in the example OK Step below, you do not have
to return the Solution. You can give the Solution a lower score because of this, but do not
return it:
If the manual calculation in a Step in the Input-Description-Output form is very simple (for
example, “2-3” is in the upper Block LaTeX and “-1” in the lower), you do not have to return the
Solution if there is no coloring, since the change is clear and applies to the whole Block LaTeX
expression. This would also apply to the following example Step:
Visual Content Layout
The size of points, thickness or opacity of lines, LaTeX for ordered pairs, or font size in
Visual Content doesn’t have to be as stated in the Guidelines (because this is not a rule).
If Visual Content is mathematically correct, correct colors are used, and everything is
clear and visible, then it is acceptable and you don’t have to return the Solution.
If a Visual Sequence is not used properly, don’t return the PM Solution, lower the grade
instead.
When there is Visual Content in a Visual Sequence, the Viewport (perspective) should be
unchanged. It is recommended that all Visual Contents within a certain Visual Sequence
are with the same perspective and grid. However, if this is not applied, the PM Solution
should not be returned, only lower the score.
If the borders of the points are colored black and the inside of the point is colored blue in
Visual Content, the PM Solution does not have to be returned. You can lower the score of
the Solution, but don’t return it.
It is okay if a double or a triple arrow is used in Visual Content when showing
translations. Visual Content doesn’t have to follow all the guidelines, as long as it is
mathematically correct, correct colors are used, and everything is clear and visible.
A PM Solution that has a table or tables with fonts that are not recommended in our
guidelines is acceptable. You can lower the score of this Solution, but you don’t need to
return it.
All recommendations for Visual Content are not reasons for returning the Solution if
Visual Content is mathematically correct and everything is clear and visible.