Preview Book Method-Validation
Preview Book Method-Validation
i
i
x x
n
The calculation for standard deviation assumes a normal distribution of the data. This
distribution is shown in Figure 3 and is typical for the results of most physico-
chemical analysis. The data is centred about the mean with the majority of the
observations near to the mean value. Fewer and fewer observations occur the further
they are away from the mean. 68.3 % of the observations lie within 1 standard
deviation of the mean, 95.5 % of the observations lie within two standard deviations
and 99.7 % lie within 3 standard deviations. When using small data sets, typical in
V A L I D A T I O N C H A R A C T E R I S T I C S
2009 Mourne Training Services 19
pharmaceutical analysis, a normal distribution may not be apparent on inspection of
the data but this distribution can usually be assumed.
Figure 3 Normal distribution curve
-3s -2s -1s x 1s 2s 3s
If the population standard deviation, , is defined as the standard deviation calculated
for a large data set, and the sample standard deviation, s, is defined as the standard
deviation of a small subset of this large data set, then it is found that the value
calculated for the sample standard deviation on a number of subsets may vary
considerably due to random variability in the data. The smaller the number of data,
the higher is the variability of the sample standard deviation. As a result of this, it is
recommended that the standard deviation should only be calculated for data sets
where n>3.
Confidence intervals
Confidence intervals are used to indicate the reliability of an estimate. In the example
quoted previously, where the amount of active pharmaceutical ingredient present in a
pharmaceutical sample is analysed, the mean result obtained is an estimate of the
actual amount present. A confidence interval provides limits around the
experimentally determined value of the mean within which the true value (or
population mean, ) lies with a given degree of probability, usually 95%.
The size of the confidence interval depends on the value of the standard deviation, s.
The confidence interval determined for a sample where the standard deviation
N
u
m
b
e
r
o
f
o
b
s
e
r
v
a
t
i
o
n
s
68.3%
95.5%
99.7%
V A L I D A T I O N C H A R A C T E R I S T I C S
2009 Mourne Training Services 27
Linearity
The section on linearity in the ICH guidelines
1
is as follows:
ICH
2. Linearity
The linearity of an analytical procedure is its ability (within a given range) to obtain test results
which are directly proportional to the concentration (amount) of analyte in the sample.
A linear relationship should be evaluated across the range (see section 3) of the
analytical procedure. It may be demonstrated directly on the drug substance (by
dilution of a standard stock solution) and/or separate weighings of synthetic
mixtures of the drug product components, using the proposed procedure. The
latter aspect can be studied during investigation of the range.
Linearity should be evaluated by visual inspection of a plot of signals as a
function of analyte concentration or content. If there is a linear relationship, test
results should be evaluated by appropriate statistical methods, for example, by
calculation of a regression line by the method of least squares. In some cases, to
obtain linearity between assays and sample concentrations, the test data may
need to be subjected to a mathematical transformation prior to the regression
analysis. Data from the regression line itself may be helpful to provide
mathematical estimates of the degree of linearity.
The correlation coefficient, y-intercept, slope of the regression line and residual
sum of squares should be submitted. A plot of the data should be included.
In addition, an analysis of the deviation of the actual data points from the
regression line may also be helpful for evaluating linearity.
Some analytical procedures, such as immunoassays, do not demonstrate linearity
after any transformation. In this case, the analytical response should be described
by an appropriate function of the concentration (amount) of an analyte in a
sample.
For the establishment of linearity, a minimum of 5 concentrations is
recommended. Other approaches should be justified.
Verification of the calibration model
If an analytical method is going to be used to generate quantitative results then a
method of calibration is required. The purpose of the validation characteristic referred
to as linearity is to verify the calibration model. The term linearity is slightly
misleading because it implies that the relationship between the test results and the
concentration of the analyte should be linear. This is not always the case as is
acknowledged in the penultimate paragraph of section 2 in the guidelines,
immunoassays being quoted as an example. In the FDA guidelines
4
on bioanalytical
method validation the term Calibration/Standard Curve is used instead of linearity.
T H E V A L I D A T I O N O F A N A L Y T I C A L M E T H O D S
2009 Mourne Training Services 28
In reality a large number of pharmaceutical analytical methods are based on linear
relationships and the terminology is appropriate in these situations. Therefore the
term linearity is used in the remainder of this book, but it is assumed that the reader
understands that a linear calibration may not always apply.
Single point calibration
The most common type of calibration model encountered in the analysis of drug
substances and drug products is known as a single point calibration, where the
standard is prepared at one concentration level only. In fact this model defines a two
point calibration line where one point equals zero and the other the standard
concentration. A single point calibration line is shown in Figure 5. The unknown
concentration of an analyte in a sample is calculated by entering the response obtained
for the analyte when analysed by the method into the equation of the calibration line,
y = mx + c. In order to force the line through zero, and thus use a single point
calibration, the value of c must be negligible.
To verify the single point model it is necessary to demonstrate that the value of the c
(the intercept) is negligible. This is achieved by measuring the response due to a
number of different concentration levels across the range of the method and
calculating the intercept for the best fit straight line. Since the aim of the investigation
is to show that the line goes through zero it is not appropriate to include zero as a
point in the investigation unless it is a measured value. For example, the absence of a
peak in a chromatographic analysis cannot be interpreted as a zero result. However
the measurement of the blank in a UV assay is a measured value and may be included
in an investigation of linearity. This applies to all calibration models, not just single
point.
Figure 5 Example of a single point calibration
V A L I D A T I O N C H A R A C T E R I S T I C S
2009 Mourne Training Services 55
Robustness
The section on robustness in the ICH guidelines
1
is as follows:
ICH
8. Robustness
The robustness of an analytical procedure is a measure of its capacity to remain unaffected by
small, but deliberate variations in method parameters and provides an indication of its
reliability during normal usage.
The evaluation of robustness should be considered during the development
phase and depends on the type of procedure under study. It should show the
reliability of an analysis with respect to deliberate variations in method
parameters.
If measurements are susceptible to variations in analytical conditions, the
analytical conditions should be suitably controlled or a precautionary statement
should be included in the procedure. One consequence of the evaluation of
robustness should be that a series of system suitability parameters (e.g.,
resolution test) is established to ensure that the validity of the analytical
procedure is maintained whenever used.
Examples of typical variations are:
- stability of analytical solutions;
- extraction time.
In the case of liquid chromatography, examples of typical variations are:
- influence of variations of pH in a mobile phase;
- influence of variations in mobile phase composition;
- different columns (different lots and/or suppliers);
- temperature;
- flow rate.
In the case of gas-chromatography, examples of typical variations are:
- different columns (different lots and/or suppliers);
- temperature;
- flow rate.
Robustness is not included in the tabular summary of required validation
characteristics to be tested in the ICH guidelines, however it is expected that it is
considered at an appropriate stage in the development of the analytical procedure.
1
Robustness is included in the summary table provided in the draft FDA guidelines
24
(see Table 14). Evaluation of the robustness of an analytical method is usually
T H E V A L I D A T I O N O F A N A L Y T I C A L M E T H O D S
2009 Mourne Training Services 56
performed in two phases. Initial robustness testing is part of the method development
process. A more formal study is then performed during validation of the method.
The factors which are investigated in robustness studies are method related, they are
parameters which are defined in the method, e.g. temperature. Altering the value of
these factors is a deviation from the method. In contrast, the factors which are
investigated in intermediate precision (sometimes referred to as ruggedness) are non-
method related factors, e.g. the analyst performing the analysis. When investigating
these factors the method is followed in full without any deviations. Robustness
factors are sometimes referred to as internal factors and those relating to intermediate
precision as external factors. When an analytical method has been shown to have
acceptable intermediate precision and robustness through the validation study,
confidence is gained that the method can be used successfully in routine analysis. Also
included in robustness testing is the evaluation of the stability of test solutions which
are used in the analysis.
Some examples of robustness factors from available literature
1,25,26
for a variety of
analytical techniques are listed below:
High Performance liquid Chromatography (HPLC)
Influence of variations of pH in a mobile phase
Influence of variations in mobile phase composition
Different columns (different lots and/or suppliers)
Temperature
Flow rate
Buffer concentration (ionic strength)
Additive concentration
Gradient slope
Initial mobile phase composition
Final mobile phase composition
Injection volume
Sample preparation (pH of solutions, reagent concentrations, etc.)
Equilibration time
Column age
2009 Mourne Training Services 73
The Validation Protocol
he planning and design of a validation study involves a number of steps. First,
the appropriate validation characteristics, as described in Chapter 2, are
selected for the analytical method being studied. Next, the experiments which
are required for each characteristic are defined including the concentration levels and
the number of replicates to be tested. Then the required results and acceptance
criteria are defined for each test.
Contents of the Validation Protocol
The validation protocol details the design of the validation study. Its purpose is to
provide information on which characteristics will be tested during the study, how the
experiments will be performed, and what results will be calculated. Typical
information in a validation protocol may include:
Details regarding the analytical method (or methods) to be validated.
The validation characteristics which will be investigated for the method(s).
Details on how the experiments will be performed including: the type and number
of solutions to be prepared; how the solutions should be prepared; how
measurements should be performed.
Details of the results which will be calculated (with directions if appropriate).
The acceptance criteria which will be applied to the results.
Details of the reference materials which will be used in the validation study.
Details of batches of the material used during the validation study. In the case of
precision studies, particular representative batches may be selected.
Details of the equipment which will be used in the study.
Details of responsibilities and required signatures.
Chapter
3
T
T H E V A L I D A T I O N O F A N A L Y T I C A L M E T H O D S
2009 Mourne Training Services 74
Validation Characteristics to be Studied
A tabular summary which details the validation characteristics that should be applied
for different types of methods is included in the ICH guidelines
1
. This table is
extended in the draft FDA guidelines
2
on Analytical Procedures and Method
Validation to include specific tests and robustness, and is reproduced below, see
Table 14.
Table 14 Recommended validation characteristics of the various types of tests
2
Type of analytical
procedure
Identification Testing for impurities Assay
Dissolution
(measurement
only),
Content/potency
Specific Tests
Characteristic Quantitative Limit
Accuracy - + - + +
4
Precision
Repeatability - + - + +
4
Intermediate
precision
- +
1
- +
1
+
4
Specificity +
2
+ + +
5
+
4
Detection Limit - -
3
+ - -
Quantitation Limit - + - - -
Linearity - + - + -
Range - + - + -
Robustness - + -
3
+ +
4
NOTE:
- Signifies that this characteristic is not normally evaluated.
+ Signifies that this characteristic is normally evaluated.
1 In cases where reproducibility has been performed, intermediate precision is not needed.
2 Lack of specificity for an analytical procedure may be compensated for by the addition of a second analytical
procedure.
3 May be needed in some cases.
4 May not be needed in some cases.
5 Lack of specificity for an assay for release may be compensated for by impurities testing.
The Type of analytical procedure in the table, i.e. identification, assay, testing for
impurities and specific tests, was defined previously in Chapter 1. The table lists the
T H E V A L I D A T I O N P R O T O C O L
2009 Mourne Training Services 75
validation characteristics which are regarded as most important for the different types
of methods. The ICH guidelines
1
state that the list should be considered typical for
the analytical procedures cited but occasional exceptions should be dealt with on a
case-by-case basis. Laboratories which perform analytical method validation typically
have in-house guidelines or standard operating procedures to describe the approach
which should be taken for validation studies. These documents are usually based on
the ICH guidelines and provide additional information on the organisational policy
regarding which validation characteristics should be investigated for particular types of
analytical methods.
Experimental Procedure and Acceptance Criteria
When the relevant validation characteristics have been identified, the experimental
procedure which will be used to investigate those characteristics needs to be defined.
Minimum requirements for the number of determinations and replicates which should
be used are provided in the ICH guidelines. Also required is the rationale for
assessing the results which are generated from the study. The acceptance criteria
selected may be based on an absolute value of practical relevance or a statistical test
may be used. The experimental procedure for performing a validation study and the
relevant acceptance criteria are discussed for each validation characteristic below. The
values quoted are suggestions provided for the purposes of orientation. Therefore
they should be used with caution and may not be appropriate for a particular method.
Specificity
The aim of the specificity investigation is different for identification methods when
compared to the aim for assay and impurity methods, due to the difference in the
nature of the methods. For identification, specificity demonstrates that the method
does not give a positive response for samples other than the one of interest.
However, for assay and impurity methods, specificity demonstrates that the response
due to the analyte of interest in the sample is not affected by potential interferences
which may also be present in the sample. The result of this is that the approach used
for the experimental part of the investigation and the acceptance criteria applied for
each type of method differs.
Experimental
For identification methods samples will be selected which could be mistaken for the
sample of interest. This selection requires knowledge of the analytical method, the
manufacturing process for the material in question and knowledge regarding other
processes using the same plant. The samples may include materials which are
structurally similar or closely related to the analyte, e.g. isolated intermediates for the
drug substance. Samples should be prepared in a similar way to the sample of interest
and analysed as per method.
For assay and impurity methods the samples tested will contain materials which are
potentially present during routine analysis and may interfere with the result, e.g.
T H E V A L I D A T I O N O F A N A L Y T I C A L M E T H O D S
2009 Mourne Training Services 84
Table 17 Suggestions for inclusion in a validation protocol for a quantitative impurities method
Validation
characteristic
Experimental details Acceptance criteria
Specificity Analyse samples containing potential
interferences, e.g. impurities, excipients.
Prepare samples by:
Spiking drug substance/drug product
with the potentially interfering
material.
Prepare samples of the potentially
interfering materials.
Perform stress studies on drug
substance/drug product.
Chromatographic:
Investigate peak purity of analyte peak.
No interference observed for response
due to analyte or impurities of interest.
Chromatographic:
No peaks interfering with the analyte
peak or the peaks due to the
impurities of interest observed.
Minimum resolution between peaks of
interest and neighbouring peaks = 1.5.
No co-elution detected from peak
purity investigation.
Linearity A least 5 concentrations over the range
QL-120% of the specification limit.
e.g. 25, 50, 75, 100 and 120% specification
limit of the impurity, the values will
depend on the values of the specification
limit and the quantitation limit for a
particular method.
Calibration model valid.
Residual plot shows random scatter and
no systematic trends.
95% confidence interval of intercept
includes zero, or intercept is less than 2%
of nominal response.
Range The range is defined by the results
obtained for linearity, accuracy and
precision.
Linearity, accuracy and precision
demonstrated over the range.
Accuracy At least 9 determinations over 3
concentration levels.
e.g. 3 at quantitation limit, 3 at 50% of
specification limit, and 3 at 120% of
specification limit.
Mean recovery within 90-110%.
Individual recoveries within 70-130%.
Regression analysis of known vs.
estimated:
Slope within 0.9-1.1
95% confidence interval of slope
includes 1
Precision System precision assessed by 6 replicate
measurements/injections.
%RSD 2%
2009 Mourne Training Services 107
The Validation Report
hen the experiments detailed in the validation protocol have been
performed the next stage of the validation study is the interpretation of the
results. The calculations and statistics associated with each validation
characteristic are carried out and the results obtained are assessed against the
acceptance criteria to decide if the method meets the validation requirements.
Contents of the Validation Report
The validation report details the results of the validation study. Its purpose is to
provide information on which characteristics were tested during the study, the results
obtained, and the interpretation of those results. Typical information in a validation
report may include:
Details of the validation protocol.
Details regarding the analytical method (or methods) validated.
The validation characteristics which were investigated for the method(s).
The results which were calculated for each validation characteristic.
A discussion of the interpretation of the results and how they compare to the
acceptance criteria.
Any relevant validation information which was obtained during method
development, e.g. solution stability, robustness, stress studies, etc.
Details of the reference materials used in the validation study.
Details relating to batch numbers, etc. of the materials used in the validation study.
Details of the equipment used in the study, e.g. identifiers and qualification details.
References to the laboratory notebooks, or equivalent used to record the raw data
obtained during the validation study.
Chapter
4
W
T H E V A L I D A T I O N O F A N A L Y T I C A L M E T H O D S
2009 Mourne Training Services 108
Details of responsibilities and required signatures.
Statistics in Analytical Method Validation
The statistics required for the interpretation of validation results include: the
calculation of the mean, standard deviation, confidence intervals and relative standard
deviation for data sets obtained; regression analysis for evaluation of linearity and
accuracy (these were discussed in Chapter 2); comparative studies; and assessment of
the significance of outliers. Validated statistical software packages
2,3
are normally used
for the calculation of all statistics associated with analytical method validation.
Statistical significance
A statistically significant difference means that there is statistical evidence that a
difference exists which is unlikely to have occurred by chance. It does not mean that
the difference is necessarily large or important and thus may not be of practical
relevance. Statistics are very useful to support analytical method validation but the
results should be used with caution. Sound scientific judgement is required for
interpretation of statistical results.
Comparative studies
Examples of comparative studies which could be performed during method validation
are:
Specificity and accuracy, to compare the results obtained using the method being
validated against a second well characterised method.
Precision, to compare the results obtained during intermediate precision and
reproducibility studies.
Robustness, to compare the effects due to the factors under evaluation.
Stability of solutions, to compare the results obtained from solution which have
been stored against the original results or results obtained for a freshly prepared
sample.
Students t-test
Students t-tests are one of the most commonly used statistical significance tests
applied to small data sets. A t-test may be used to compare two sets of data which are
each characterised by their mean, standard deviation and number of data points,
provided that the distribution of the data can be assumed to be normal. The outcome
of a t-test is that the null hypothesis is accepted or rejected. The null hypothesis is
that any differences between the data sets are due to random and not systematic
errors, i.e. both methods give the same results, or both samples contain the same
amount of analyte.
T H E V A L I D A T I O N R E P O R T
2009 Mourne Training Services 119
Case Study
A validation protocol for the analytical method presented in Chapter 3, Analytical
Method for Determination of the Assay and Degradation Products of MiracleCure
25 mg Tablets by HPLC (Figure 12), was designed previously (refer to Table 19). The
results from this study are presented in a tabular summary format in Table 25.
Table 25 Summary validation report for the analytical method and validation protocol detailed in Chapter 3
(refer to Figure 12 and Table 19)
Validation
characteristic
Results Acceptance criteria
Specificity Chromatograms obtained for the
specificity solutions showed that there are
no interfering peaks.
Retention times:
MiracleCure 10.3 minutes
Impurity X 12.4 minutes
DP 1 15.0 minutes
DP 2 37.2 minutes
Excipients no peak detected
Critical pair resolution = 3.2
(MiracleCure and Impurity X)
No peaks interfering with the peaks due to
MiracleCure, Impurity X, DP 1 or DP 2.
Minimum resolution between peaks of
interest and neighbouring peaks = 2.
Linearity Assay
Calibration model is valid
Equation of line, y = 1219x + 691
Correlation coefficient = 1.000
Residual sum of squares = 150186
95% confidence interval for the intercept
includes zero, -105 to 1487, intercept is
0.56% of nominal response.
The plot of residuals shows random
scatter and no systematic trends.
Calibration model valid.
Residual plot shows random scatter and
no systematic trends.
95% confidence interval of intercept
includes zero, or intercept is less than 2%
of nominal response.
Linearity DP 1
Calibration model is valid
Equation of line, y = 1303x 3.17
Correlation coefficient = 0.998
Residual sum of squares = 4318
95% confidence interval for the intercept
includes zero, -18.47 to 12.12, intercept is
0.95% of response at 50% SL.
The plot of residuals shows random
scatter and no systematic trends.
Calibration model valid.
Residual plot shows random scatter and
no systematic trends.
95% confidence interval of intercept
includes zero, or intercept is less than 2%
of response at 50% SL (0.25% nominal).
2009 Mourne Training Services 129
Glossary
A
Acceptance criteria The criteria which are applied to the results obtained
from a validation study, if the results comply with the
criteria then it is concluded that the analytical method is
fit for the intended purpose.
Accuracy The closeness of agreement between a test result and the
accepted reference value.
Active Pharmaceutical
Ingredient (API)
The active or the active pharmaceutical ingredient is
the substance in a drug preparation that is
pharmaceutically active.
Analyte The compound of interest to be analysed.
Analytical Instrument
Qualification (AIQ)
Documented evidence that an analytical instrument
performs suitably for its intended purpose and that it is
properly maintained and calibrated.
Assay An analytical method to analyse or quantify a substance
in a sample.
B
Bioanalysis The chemical analysis of biological samples, e.g. plasma,
urine etc.
Bioassay A biological test, measurement or analysis to determine
whether compounds have the desired effect either in a
living organism, outside an organism, or in an artificial
environment.
Bioavailability The amount of drug absorbed into the body.
Bioequivalence The comparison of the expected in vivo biological
equivalence of two proprietary preparations of a drug. If
two products are said to be bioequivalent it means that
they would be expected to be, for all intents and
purposes, the same.
Biopharmaceutical A drug produced by biotechnology.
Biotechnology The application of scientific and engineering principles to
the processing of materials by biological agents.
2009 Mourne Training Services 137
List of Abbreviations
AIQ Analytical Instrument Qualification
API Active Pharmaceutical Ingredient
CDS Chromatography Data System
COTS Commercial Off The Shelf
DAD Diode Array Detector
DL Detection Limit
DOE Design of Experiments
DQ Design Qualification
EMEA European Medicines Agency
EP European Pharmacopoeia
FDA Food and Drug Administration (US)
GC Gas Chromatography
GFC Gel Filtration Chromatography
GLP Good Laboratory Practice
GMP Good Manufacturing Practice
HPLC High Performance Liquid Chromatography
ICH International Conference on Harmonisation
IMPD Investigational Medicinal Product Dossier
IND Investigational New Drug
IQ Installation Qualification
2009 Mourne Training Services 141
Index
Acceptance criteria, 73, 75
Accuracy, 10, 37, 49, 77, 113
acceptance criteria, 78
assay methods, 38
experimental procedure, 77
ICH guideline, 37
impurities methods, 40
results, 113
sample preparation, 40
Analytical method
assay, 7
automated, 87
bioanalytical, 9
cleaning samples, 41
identification, 6
impurities, 7
life cycle, 4
microbiological, 9
pharmacopoeial, 87
purpose, 3
reporting level, 36
specific tests, 8
transfer, 47
types, 6
universal tests, 6
water determination, 41
Calibration
model, 27, 41
multi-level, 29
non-linear models, 33
single point, 28
Coefficient of determination, 32
Confidence intervals. See Statistics
Correlation coefficient, 32
Data quality, 1
Detection limit, 11, 50, 79, 114
acceptance criteria, 80
experimental procedure, 79
ICH guideline, 50
results, 114
Experimental design, 46, 60
fractional factorials, 60
Plackett-Burman, 60
selection of factors and levels, 60
Forced degradation, 25
Good Manufacturing Practices, 1
Guidelines, validation, 5
FDA, 6
ICH, 5
Hetereoscedasticity, 33
Intermediate precision, 10, 46
factors, 46
ruggedness, 46
Limit of detection. See Detection limit
Limit of quantification. See Quantitation
limit
Linearity, 11, 27, 76, 113
100% standard methods, 34
acceptance criteria, 77
assay and impurity methods, 34
bioanalytical methods, 34
experimental procedure, 76
ICH guideline, 27
results, 113
Peak purity, 25
Precision, 10, 42, 49, 78
acceptance criteria, 79
experimental procedure, 78
Horwitz Trumpet, 45
ICH guideline, 42
Intermediate precision. See Intermediate
precision
measurement, 43
repeatability. See Repeatability
reproducibility. See Reproducibility
results, 113
system precision, 43
Protocol, validation, 73
assay methods, 81
bioanalytical methods, 86
case study, 93
choosing characteristics for study, 74
contents, 73
execution of, 90
experimental procedure, 75
identification methods, 81