|
About
PMID Numbers: We frequently utilize a PMID number in
place of a citation. Where PMID numbers are available, enter that
number into the PubMed search box to retrieve that citation and
listing.
A
B C D
E F G H
I J K L M N
O P Q R
S T U V W
X Y Z
Absolute
risk reduction (ARR) – A measure of outcomes which reflects
the actual percent difference in study outcomes between groups.
See a visual description here.
Formula: % in comparison group - % in study group
Similar concept: Absolute risk increase (ARI).
Related: Measures of outcomes
Accuracy –
The ability to correctly identify that which one intends to identify.
Active agent —
Active drug (i.e., not the placebo).
Adjustment - Statistical
means for minimizing differences in study and comparison groups
(e.g., standardization and regression analysis).Adverse event
(ADE) — see Safety
Aim, study —
see Objectives
Allocation concealment
— see Concealment of allocation
Alpha error —
see Error
A priori
– In advance. For example, issues such as study questions,
outcome measures, subgroups for analysis and p-values should be
determined in advance of the actual study (i.e., determined a
priori).
Ascertainment bias
- See bias
Assessment bias -
See bias
Association –
Statistical relationship between two or more events, characteristics
or other variables.
Attrition bias -
See bias
Baseline
characteristics — Key characteristics of interest at the
start of a study which are potential prognostic factors. These
usually include demographic information such as age, gender, race
and other characteristics related to the area under study such
as disease severity, baseline measurements for clinical items
of interest, etc. Collecting and reporting on baseline characteristics
helps to establish how similar the study groups are, describes
the actual population studied and helps to measure improvements
during the course of the study.
Benchmark –
A standard or point of reference used in measuring and/or judging
something such as quality or value.
Beta error - see
Error
Bias – Study
processes which may result in, or lead to, conclusions differing
from truth in a systematic way (meaning not due to chance). Bias
may occur at various study stages such as assigning subjects to
study or comparison groups, intervention or exposure, performance,
provision of services or conduct of processes affecting subjects,
data collection, subject follow-up, measurement, analysis, interpretation
and/or publication of data. Bias frequently occurs as a result
of some inequality between the study and the comparison group.
The inequality may be important because it may affect the study
outcome.
Key Biases Which
May Occur at Various Study Stages
Selection bias
– A bias occurring in subject identification, selection
and/or assignment. This includes dissimilarity between groups.
Observation bias
– Bias that may have been introduced through study procedures
during implementation, intervention or exposure, follow-up or
assessment. Specific biases in this category primarily consist
of –
- Performance
bias – Threats to validity, post-randomization, arising
from study activities involving subjects such as interventions,
processes or procedures. Frequently this is a bias that can
result when there are differences between groups other than
the intervention under study.
Synonym: Intervention bias
- Attrition bias
– A bias occurring as a result of subjects lost to follow-up
through withdrawals or other study attrition.
Synonym: Follow-up bias
- Assessment
bias – A bias occurring in the way outcomes are assessed.
Synonyms: Ascertainment bias, Detection bias, Measurement
bias
Bivariate analysis - Bivariate analysis involves the analysis
of two variables to show relationships between those two variables.
Data from two variables are plotted on a joint distribution graph,
and then correlation analysis and simple linear regression analysis
are performed to assess how closely the variables are related.
Related: Pearson correlation co-efficient
Blinding –
An important study procedure to keep secret certain study procedures
such as which is an active drug and which is a placebo. Bias can
result when study subjects and those involved in study procedures
know treatment assignment of individual subjects. Blinding is
a method to help avoid the introduction of this kind of bias.
Double-blinding refers to when neither patient nor persons performing
the intervention or exposure — or working with the subjects'
data — know if the patient is in the study group or the
comparison group.
Synonym: Masking
Related: Concealment of allocation, Double-blinding, Double-dummy,
Encapsulation
Case
— Research subject who is a member of the group possessing
the characteristic under study such as an exposure, risk factor,
outcome or receiving the intervention in an experimental study.
Case-control study
– An observational study in which subjects with outcomes
of interest (cases) are compared to those without the outcome
(controls). Histories are examined to attempt to determine exposures.
Case series –
A group of patients receives an intervention and outcomes are
assessed. There is no comparison group. Case series is almost
never “evidence.” All-or-none results are required,
which rarely happens.
Case study —
An observational of one person. Also referred to as a case report.
A case study is not evidence.
Chance — Research
results happening by "accident," meaning that they did
not happen because of truth or because of bias. Likelihood is
assessed by using appropriate statistical tests. To critically
appraise, examine p-values and confidence intervals with associated
point-estimates (none of which can address bias, which is a systematic
error - meaning an error not due to chance).
Synonyms: Random error, Sampling error
Related: Bias
Class effect - Class
effect refers to a concept that certain drugs share sufficient
similarities that they can be thought of as a class. It is a determination
that a set of agents with similar chemical structures, mechanisms
of action and pharmacological effects has similar therapeutic
and adverse effects. There are no universally accepted criteria
for defining class effect. (For all intents and purposes, class
effect treats the agents as if they are the same clinically, but
some other factors, such as cost, may vary.)
Clinical practice
guidelines – Clinical practice guidelines are systematically
developed statements to assist practitioners and patients in choosing
appropriate healthcare for specific conditions. They should be
based on valid and useful evidence, and they should be critically
appraised before adoption.
Clinical significance
— Research should benefit patients in ways that are clinically
significant (i.e., that matter to them). Clinically significant
areas are morbidity, mortality, symptom relief, functioning and
health-related quality of life. Results from valid research in
these areas should be large enough and useful enough to provide
meaningful clinical benefit.
Clinical trial —
A research methodology which evaluates a drug or other intervention
to assess safety and efficacy by evaluating its effect on a group
of subjects. The subjects are divided into two or more groups
with the study group receiving the drug or intervention and the
comparison group or groups receiving a comparison drug, placebo
or intervention.
Cohort study –
An observational study in which exposure occurs in the study group
and not in the comparison group. Exposure is not introduced by
the investigator, but happens through other means such as natural
occurrence or individual choice. Groups are followed over time
and outcomes are compared. Cohort studies can be done prospectively
where a group of interest and a comparison group are followed
forward in time. Cohort studies can be done retrospectively when
the group of interest and comparison group are identified from
the past, based on an exposure or characteristic, and then information
about them is reviewed from that time forward to assess development
of outcomes.
Comparison groups
— Subjects in groups being compared to the group of interest
(e.g., intervention group would be “group of interest”
and placebo group would be the “comparison group”).
Composite endpoints
— Refers to an endpoint in which single endpoints are grouped
together to form one endpoint such as “cardiovascular events.”
Concealment of allocation
– The process used in a randomized controlled trial to hide
the assignment to a study group. The purpose is to ensure that
no one can influence or control which study subject gets assigned
to which group (e.g., assignment made through a call-center, etc.)
Related: Blinding
Confidence interval
(CI) – For a valid study, the range in which the likelihood
of a true value is expected to be, within a given degree of certainty,
usually 95 percent.
As a practical matter, confidence intervals can be useful in interpreting
results. For valid studies, consider what you judge to be a reasonable
range for clinical significance – this need not be hard
and fast. For statistically significant findings, is the confidence
interval wholly within bounds for clinical significance? For non-significant
findings, is the confidence interval wholly beneath your limit
for clinical significance? A yes to these two questions means
likely conclusive findings for valid studies. No, means findings
are inconclusive.
Often reported as: Point Estimate (95% CI [CI, CI])
Example: 6% (95% CI 4,8) or 6% (95% CI 4 to 8) or 6 (4,8).
(Avoid using "-" when separating the interval numbers,
which can be confused with a minus sign.)
Related: P-value
Confounding –
A special type of bias in which another factor associated with
the study variable of interest may have "traveled" with
that variable and is the true reason for the study conclusion
instead of the variable under study. There are known confounders
and unknown confounders. Randomization is a method which attempts
to minimize confounding by randomly allocating subjects to their
groups in hopes that any potential confounders are equally distributed
between the groups.
Contamination –
Any member of a comparison group receiving the intervention under
study or being exposed to the variable of interest.
Control - Research
subject who is a member of the comparison group.
Controlled clinical
trial – An experiment in which investigators include a control
group which is used as a comparison group. The comparison group
may receive another treatment, a placebo or “usual care”.
Subjects are assigned to the study or to the control group. Intervention
or exposure is then performed. Patients are followed to determine
outcomes such as improvements or harms.
Related: Clinical trial, Randomized controlled trial (RCT)
Covariate - A variable
that might affect, or possibly predict, an outcome.
Critical appraisal
– A scientific evaluation of evidence (e.g., research data)
to appraise validity (closeness to truth) and usefulness (e.g.,
generalizability to one's own patients or circumstances, meaningful
benefit, etc).
Cross-over design
- A study design in which patients start out having one intervention
and then are “crossed over” to a different intervention.
Crossover trial –
A comparison of two or more interventions in which the participants
receive one treatment and then are “crossed over”
to another intervention. Care must be taken with this study design
because effects of the first treatment could contaminate the effects
of the subsequent intervention.
Related: Contamination
Cross-sectional study
– An observational study in which a sample from a larger
population is examined, at one single point in time – like
a snapshot - for prevalence of an exposure or characteristic along
with an outcome of interest. Cross-sectional studies are also
frequently used to evaluate diagnostic testing.
Database
research — Statistical relationships between two or more
variables are assessed from databases. Frequently database research
is used to report outcome measures. Database research, however,
is a type of observation and, like all observational research,
is highly prone to selection bias, observation bias and confounding
— and the likelihood of finding "statistically significant"
relationships merely due to chance is high to certain, depending
upon the way the analysis is conducted. Definite cause and effect
conclusions should not be drawn from database research.
Data gathering validity
– Data gathering validity refers to the methods used to
obtain numerators and denominators during the data gathering phase
of performance measurement.
Delta — See
Equivalence trials and Non-inferiority trials
Denominator –
The lower portion of a fraction used to calculate a rate or ratio.
In a rate, the denominator is usually the population (or population
experience, as in person-years, etc.) at risk.
Related: Numerator
Denominator –
For performance measurement, the population
“at risk” for experiencing the event or occurrence
described in the numerator — the "pool."
Dependent variable
– In a statistical analysis, the outcome variables under
study.
Related: Independent variable, variables
Detection bias -
See bias
Diagnostic testing
— see Measures of test function
Disease spectrum
— A range of symptoms, signs, lab results and results of
other diagnostic tests, and rate of disease progression, response
to therapy and disease severity.
Double-blind –
see Blinding
Double-dummy treatment
design — A treatment design involving two placebos. Control
subjects receive one or the other of two placebos, but not both.
Study subjects receive the intervention drug. For example, if
you were studying an antibiotic being given at two different doses,
you might need two placebos because of the weight and size difference
of the doses.
Drug utilization
review (DUR): A system for evaluating appropriateness of drug
therapy. Prescribing patterns are evaluated to determine if drugs
are being misprescribed, possibly resulting in problems with safety
or effectiveness.
Effectiveness
– The extent to which a given intervention is likely to
produce beneficial results for which it is intended in ordinary
circumstances.
Related: efficacy
Efficacy –
The extent to which a given intervention is likely to produce
beneficial effects in the context of the research study.
Related: Effectiveness
Empirical –
Empirical results are those which are based on experience or observation.
Encapsulation —
A drug blinding method whereby drugs (active or inert) are crushed
and put into gelatin capsules to disguise the active agent as
compared to the placebo.
Related: Blinding
Endpoint —
see Outcome measure
Epidemiology –
A study of the distribution and determinants of health-related
states or events in specified populations, and the application
of this study to the control of health problems.
Equipoise -In healthcare,
a state in which it is unknown which interventions will result
in best outcomes.
Equipotency - See
Class effect
Equivalence trial
- Equivalence trials are usually used to demonstrate that the
effects of two treatments do not vary more than a prespecified
clinically acceptable amount and can therefore be considered clinically
equivalent. Delta is the name given to the range of results within
which results are judged to be equivalent.
Error —
- Type 1 - or alpha
error - A difference is reported, but there is no difference.
This can be due to bias, confounding or chance.
Related: Statistical significance
- Type 2 - or beta
error - No difference is reported, but there is a difference.
This can be due to an insufficient number of people studied.
Related: Power
Estimate of effect
– see Measures of outcomes
Evidence-based medicine
(EBM) – Delfini definition: "The use of the scientific
method and application of valid and useful science to inform health
care provision, practice, evaluation and decisions."
Experimental study
– A study in which the investigator controls an exposure
or intervention, then follows subjects to compare outcomes between
research subjects who are exposed or who receive the intervention
and those who are not exposed or who do not receive the intervention.
Tip: If an intervention is "assigned" through the research,
it is an experiment. If it is chosen, then the study type is observational.
Related: Observational study
Exposed group –
A group whose members have been exposed to a supposed cause of
disease or health state of interest, or possess a characteristic
that is a determinant of the health outcome of interest.
External validity
– Whether a study's results are generalizable either to
a patient population (see Population bias) or to "real world"
circumstances (see Intensity bias). Also referred to as
Synonym: Generalizability
Related: Validity, Internal validity, Population bias, Intensity
bias
First-line
therapy: The drugs to be utilized first in treating a patient.
Follow-up bias -
See bias
Foraging tools -
Tools that assist with keeping up-to-date with new information.
Related:Hunting tools
Formulary: List of
therapeutic agents AQ29available in a particular practice for
caring for patients. The term “preferred drug list”
is also used.
- An open formulary
may have few or no restrictions.
- A closed formulary
has restrictions.
Formulary system:
A system that provides for the processes for establishing and
managing the formulary.
Generalizability
– see External validity
Generic substitution:
Replacement of one agent with a different agent having the same
chemical structure. This may be done when the patent on a brand-name
drug expires. Bioequivalence is frequently assumed (i.e., it is
assumed that the generic agent is equivalent to the brand-name
drug). In some cases the effects of other components of the generic
preparation (e.g., the vehicle in a dermatological preparation)
may vary and result in outcomes that differ from those reported
for the brand-name agent.
Gold standard –
The intervention generally believed to be the best available against
which new interventions should be compared.
Halo
effect - How an observer's perception, knowledge or recollection,
may bias results. Also used as a synonym for Placebo effect when
medical attention and services can bias results.
Hawthorne effect
- How the knowledge of being in a study can influence a subject's
behavior (usually favorably) which can bias results.
Hazard ratio - The
slope of the survival curve to provide estimates of how rapidly
subjects are dying in the treated versus the control group. The
hazard rate is the probability that if the event in question has
not already occurred, it will occur in the next time interval.
The time interval is short, so the hazard rate represents an “instantaneous”
rate.
Hunting tools -
Tools which aid the process for searching to answer a clinical
question.
Related: Foraging tools
Hypothesis —
Tentative explanation that forms the basis of a research study.
Related: Null hypothesis
Imputation
— As in "imputation of missing variables." Principles
of Intention-to-Treat (ITT) analysis require analyzing all patients
in the groups to which they were assigned. Investigators are to
"impute" or assign outcomes for missing data points.
Example: worst case scenario in which study subjects with missing
outcomes are assigned as "treatment failures," and comparison
subjects, assigned as "successes." Frequently "last-observation-carried-forward"
(LOCF) is used, however, this has been shown to be a method prone
to bias. Imputing outcomes for missing data points is not a method
for "determining the truth of what may have happened if we
had no missing data," but rather a method to test the strength
of the outcomes (i.e., statistically similar results to those
reported) considering all the data points in such a way that does
not favor the intervention. LOCF would be especially biased in
patients with a progressive illness, for example, because patient
outcomes would appear better than would be expected in a progressive
illness.
Related: Intention-to-treat
Incidence –
The proportion of new cases of the target disorder in the population
at risk during a specified time interval.
Related: Incidence rate, Prevalence
Incidence rate –
A measure of the frequency with which an event, such as a new
case of illness, occurs in a population over a period of time.
The denominator is the population at risk; the numerator is the
number of new cases occurring during a given time period.
Independent variable
– An exposure, risk factor, or other characteristic being
observed or measured that is hypothesized to influence an event
or outcome (i.e., the dependent variable).
Related: Dependent variable, variables
Inference, statistical
– In statistics, the development of generalizations from
sample data, usually with calculated degrees of uncertainty.
Intensity bias -
An external validity bias in which the circumstances of the study
differ meaningfully from the circumstances to which study methods
might otherwise be applied (e.g., "real world" settings
as contrasted with the highly controlled environment often found
in controlled trials).
Related: External validity
Intention-to-treat
– Analyzing results for all patients in the groups to which
they were assigned whether or not they received or completed the
intervention or experienced the exposure. The number randomized
to each group should equal the number analyzed in each group —
and they should be the same people.
Related: Imputation
Intermediate Outcome
Markers – Outcome measures, such as a biologic factor (biomarker)
or lab/imaging test, that are “assumed” to represent
clinical outcomes (e.g., blood pressure used as a surrogate end
point in studies of stroke).
Synonyms: Proxy markers, Surrogate markers, Surrogate end points
Internal Validity
- Closeness to truth within the context of the study (i.e., truth
of the study not taking into account external validity). Assessing
internal validity entails "ruling out" bias, confounding
and chance as possible explanations for an observed association
between an element of interest in a study and resulting outcomes.
Related: Validity, External validity, Bias, Confounding, Chance
Interventions —
Includes screening, prevention and treatments. Only valid randomized
controlled trials with useful results should be used to inform
decisions about interventions in these areas.
Intervention bias
- See bias
Lead
time bias - A bias resulting from a disease found through screening
as compared to when it might otherwise have been detected. This
kind of bias can result in a treatment seeming to be very effective
if the lead time is long (e.g., “increased” survival
time).
Related: Bias
Length time bias
- A bias that can occur when certain characteristics or conditions
under study differ in the speed of progression. This kind of bias
can result in findings favoring screening. An example is tumors.
Faster-growing tumors causing symptoms will be more likely to
be found outside of screening. Slower-growing, asymptomatic tumors
will have a longer duration and be less likely to be found outside
of screening. Thus, screening will identify more slower-growing
asymptomatic tumors which could then result in a conclusion that
screening helps prevent mortality. This kind of bias is most likely
to occur in screening studies and case-control studies where prevalence
cases are included, rather than incidence cases because incidence
cases are assumed to be new starts.
Related: Bias
Likelihood ratios
(LR) – Likelihood ratios can be helpful for comparing one
test to another, and results can help rule in or rule out a condition.
Related: Measures of test function, Positive likelihood ratio
and Negative likelihood ratio.
Line of no difference
– The point at which there is no greater benefit or risk
one way or another (meaning the meeting point for "favors
intervention" versus "favors placebo.")
Synonyms: Infinity, Unity, Line of no effect
- Point estimates
expressed as percentages — the meeting line is at 0.
Relative risk reduction = 0 equals no difference
Absolute risk reduction = 0 equals no difference
- Point estimates
expressed as ratios — the meeting line is at 1.
Odds Ratio = 1 equals no difference.
Relative risk (also known as Risk ratio) = 1 equals no difference.
Masking
- see Blinding
Matching –
A mechanism to reduce selection bias by attempting to make a study
group and a comparison group as comparable as possible by matching
similar variables such as age and sex, etc.
Mean, arithmetic
– The average.
Measure of association
– see Measures of outcomes
Measurement bias
- See bias
Measurement of risk
– see Measures of outcomes
Measures of outcomes
— Statistics that show the size of differences between the
results from the study groups.
Synonyms: Measurement of association, Measurement of risk, Estimates
of effect, Point estimates, Effect size, Treatment effect
- Absolute risk
reduction
- Number needed
to treat
- Odds ratio
- Relative risk
- Relative risk
reduction
Measures of test
function — Measures to help determine the accuracy and usefulness
of diagnostic tests.
Synonyms: Indices of accuracy
See individual definitions for the following:
- Sensitivity
- Specificity
- Positive predictive
value
- Negative predicitive
value
- Positive likelihood
ratio
- Negative likelihood
ratio
- Post-test odds
- Post-test probabilities
- Number-needed-to-diagnose
Median – The
data midpoint.
Meta-analysis –
A quantitative technique for summarizing results of more than
one study using predetermined criteria. The goal is to provide
a summary estimate of effect based on the scientific weight of
the studies. Meta-analysis can be achieved through use of the
results of individual studies or actually pooling data from those
studies.
Related: Systematic Review.
Mode – The
most frequently occurring value in a dataset.
Monograph - A written
review and analysis, often of a single agent, containing a list
of usage recommendations.
Multivariable analysis
- A statistical method for determining the specific contributions
of various factors to a single outcome. This allows investigation
of a single variable while controlling for the effect of other
variables. Multivariable analysis determines the independent contribution
of each independent variable to the dependent variable (i.e.,
development of coronary heart disease).
Methods include
multiple linear regression, multiple logistic regression, and
proportional hazards (Cox) regression
- Linear regression
is used with continuous outcomes
- Logistic regression
is used with dichotomous outcomes
- Proportional
hazards regression is used when the outcome is the length of
time to reach a discrete event (such as time from baseline visit
to death)
Multivariate analysis
- A statistical method for determining the specific contributions
of various factors to a more than one outcome.
Narrative
review: An article in the medical literature summarizing other
studies for a given topic, characterized by a lack of a transparent,
scientific, and systematic approach; thus, the summary is highly
likely to be misleading. Instead, systematic reviews should be
sought (and appraised).
Negative likelihood
ratio – The number of times the percent of false negatives
occurs over percent of true negatives.
Related: Measures of test function
Formula = (1-sensitivity) / specificity
This represents the change from pre-test odds to post-test odds.
The size of an increase is considered as follows —
- Small =.02-.05
- Modest = .05-.1
- Large = > .1.
Large is considered to rule out a condition.
Negative predictive
value (NPV) – Of all testing negative, percent who do not
have a condition, based on that population's prevalence.
Formula = d / (c + d) from two-by-two table
Related: Measures of test function, Two-by-two table
Non-inferiority trial
- Non-inferiority trials aim to show that an intervention is not
inferior to a comparison intervention by more than a prespecified
clinically acceptable amount (Delta). Judgment is required to
establish what is meant by a clinically acceptable amount.
Non-parametric -
Non-parametric refers to instance in which the distribution is
unknown. Parametric refers to instances in which parameters of
the distribution of the variable of interest is known (e.g., knowledge
that a distribution of a variable is expected to follow a bell
curve.
Null hypothesis –
The first step in testing for statistical significance in which
it is assumed that the exposure is not related to a disease. This
is done for mathematical purposes to level the playing field to
begin with the assumption that study outcomes are the same as
what would have occurred by chance.
Related: Hypothesis
Number-needed to
diagnose (NND) — From Bandolier: "For any chosen clinical
endpoint the NNT is the reciprocal of the fractional improvement
in a treated group minus the fractional improvement in an untreated
group NNT = 1/(fraction improved with active - fraction improved
with control)" or NND = 1/[Sensitivity - (1 - Specificity)].
Primarily useful for comparing the NND values between different
tests. Best outcome is as close to 1.0 as possible. (http://www.jr2.ox.ac.uk/bandolier/band27/b27-2.html)
Related: Number-needed-to-treat, Measures of outcomes
Number-needed-to-treat
(NNT) – The number of patients who need to be treated in
order for one patient to benefit within the study time period.
NNT is the reciprocal of the ARR.
Formula = 1/ARR (or how many times does ARR # go into 100). Example:
For an ARR of 5 percent the NNT is 20; meaning, twenty people
would have to be treated for one person to benefit.
Similar concept: Number needed to harm / screen / prevent, etc
– NNH, NNS, NNP
Related: Measures of outcomes
See a visual description here.
Numerator –
The upper portion of a fraction.
Related: Denominator
Numerator –
For performance measurement, the event or occurrence
being tracked (a subset of the denominator) — the "count."
Objective
— Goal or aim of the study.
Observation bias
- See bias
Observational study
– Epidemiological study in which observations are made,
but investigators do not control the exposure or intervention
and other factors. Changes or differences in one characteristic
are studied in relation to changes or differences in others, without
the intervention of the investigator. Observational studies are
highly prone to selection bias, observation bias and confounding.
Tip: If an intervention is "assigned" through the research,
it is an experiment. If it is chosen, then the study type is observational.
Related: Experimental study
Odds - The likelihood
of an event occurring compared to not occurring--e.g., odds of
two to one mean that likelihood of an event occurring is twice
that of not occurring.
Odds ratio (OR) –
A point estimate used for case-control studies which attempts
to quantify a mathematical relationship between an exposure and
a health outcome. Odds are used in case-control studies because
the investigator arbitrarily controls the population; therefore,
probability cannot be determined because the disease rates in
the study population cannot be known. The odds that a case is
exposed to a certain variable are divided by the odds that a control
is exposed to that same variable. Odds are often used in other
types of studies as well, such as meta-analysis, because of various
properties of odds which make them easy to use mathematically.
Related: Measures of outcomes
Open label study
- Not blinded as to the intervention.
Related: Blinding
Outcome — see
Outcome measure
Outcome measure –
What we are interested in studying (e.g., mortality, use of rescue
medications in asthma patients, incidence of no flares in atopic
dermatitis).
Synonyms: Endpoints, Outcomes, Outcome variables
Related: Primary outcomes, secondary outcomes, composite endpoints.
Overdiagnosis - A
finding of a disease at an asymptomatic stage in a patient who
would not have become symptomatic or harmed by the disease.
Override - Process
of setting aside a prescriber’s choice of a medication and
usually substituting another medication.
Parametric
- Parametric refers to instances in which parameters of the distribution
of the variable of interest is known (e.g., knowledge that a distribution
of a variable is expected to follow a bell curve. Non-parametric
refers to instance in which the distribution is unknown.
Pathophysiology -
Disruption of normal biochemical or physical function by a disease
or disorder.
Pearson correlation
co-efficient - An analysis method to measure the extent of the
linear relationship of two variables to determine how independent
and dependent variables change together (e.g., salt intake and
blood pressure).
Synonym: r value
Related: Bivariate analysis
Performance bias
- See bias
Performance measure
– A quantitative assessment of a process of care, outcome
or service usually used in quality improvement work. It consists
of a denominator (e.g., population of interest), a numerator (i.e.,
a count of events of interest occurring within the denominator)
and a frequency (i.e., the specified interval for measurement).
May target various levels or units such as a system, specialty
group or individual. Usually expressed as a rate, ratio or percentage.
Sometimes used interchangeably with “quality indicator.”
Key terms = accuracy,
benchmark, data gathering validity, denominator, dependability,
numerator, outcome measure, performance measure, precision,
quality indicator, rate, ratio, risk adjustment, risk stratification
Pharmacy & Therapeutics
Committee: Committee charged with making formulary management
decisions, along with performing other formulary management functions.
Pharmacy benefit
manager (PBM): A company that manages pharmacy benefits and formulary
management for health care systems and/or insurance companies.
Phase (clinical)
studies –
- Phase I is the
first stage in testing a new drug in humans for safety and chemical
action of the drug. Phase I studies are usually performed on
healthy volunteers (often 20 to 100 persons) without a comparison
group.
- Phase II studies
are performed mainly to test a drug’s efficacy. They are
often performed on healthy volunteers (as many as several hundred
people who have the condition in question) and may be up to
two years duration or more. They are sometimes conducted as
randomized controlled trials.
- Phase III studies
are full-scale evaluations of treatment, in hundreds to thousands
of patients, for comparison to the current standard treatments
for the same condition. Phase III studies are frequently randomized
controlled trials.
- Phase IV studies
are postmarketing surveillance studies.
Placebo – An
inactive substance or procedure administered to a patient for
comparison to the intervention. Used in clinical trials to blind
people to their treatment allocation.
Related: Blinding
Pivotal trial - A
controlled trial to evaluate the safety and efficacy of a drug
in patients and usually the basis for the New Drug Application
(NDA) filing with the FDA.
Point estimate –
see Measures of outcomes
Population –
For research studies, the term "population" may refer
to a group of people living in a specific geographic area or it
may mean a unique set of individuals who share some characteristic
such as exposure to a disease or a group of patients of a single
clinician, as examples. In statistics, this can mean a population
of data.
Population bias
- An external validity bias in which the population under study
differs meaningfully from the population to which the results
might be applied.
Related: External validity
Positive likelihood
ratio (LR+) – The number of times the percent of true positives
occurs over percent of false positives. This represents the change
from pre-test odds to post-test odds.
Related: Measures of test function
Formula = sensitivity / (1-specificity)
This represents the change from pre-test odds to post-test odds.
The size of an increase is considered as follows —
- Small = 2 to 5
- Modest = 5 to
10
- Large = > 10.
Large is considered to rule out a condition.
Positive predictive
value (PPV) – Of all testing positive, percent who have
the disease, based on that population's prevalence.
Formula = a / (a + b) from two-by-two table.
Related: Measures of test function, Two-by-two table
Post-test odds for
positive test — The odds of a person having a condition
if the test is positive.
Formula = pre-test odds x positive likelihood ratio
Related: Measures of test function
Post-test odds for
negative test — The odds of a person not having a condition
if the test is negative.
Formula = pre-test odds x negative likelihood ratio
Related: Measures of test function
Post-test probability
for a positive test — After learning test result, the probability
that a person testing positive has the condition.
Formula = Odds post (T+) / (1 + Odds post (T+))
Related: Measures of test function
Post-test probability
for a negative test — After learning test result, the probability
that a person testing negative has the condition.
Formula = Odds post (T-) / (1 + Odds post (T-))
Related: Measures of test function
Power - See Statistical
power.
Precision –
The ability to provide sufficient detail, such as small incremental
units, to be useful.
Predictive value
– A diagnostic measure of function which is used to address
the probability of having or not having a condition. Predictive
value is affected by prevalence.
Related: Positive predictive value, Negative predictive value.
Pre-test likelihood
— Pre-test probability of having a condition based on the
prevalence of the condition in the population studied.
Related: Prevalence
Pre-test odds —
Pre-test odds of having a condition based on the prevalence of
the condition in the population studied.
Formula = prevalence / (1-prevalence)
Related: Prevalence
Prevalence –
The number or proportion of cases or events or conditions in a
given population.
Related: Prevalence rate, Incidence
Prevalence rate –
The proportion of persons in a population who have a particular
disease or attribute at a specified point in time or over a specified
period of time.
Prior authorization:
Requirement that a clinician obtain approval before a drug can
be dispensed and/or covered.
Probability - The
likelihood of an event occurring expressed as a number between
0 and 1. It is measured by the ratio of the event to the total
number of possible events. Example: the probability of flipping
a coin and coming up with heads is .5.
Proportion –
A type of ratio in which the numerator is included in the denominator.
The ratio of a part to the whole, expressed as a “decimal
fraction” (e.g., 0.2), as a fraction (1/5), or, loosely,
as a percentage (20%).
Related: Denominator, Numerator
Proxy outcome markers
– see Intermediate outcome markers.
Publication bias
– The bias toward the publishing of studies showing statistically
significant “positive” results.
P-value –
The probability that the results observed in a valid study could
have arisen by chance. The p-value of <.05, often set as the
point of statistical significance, is conventional and simply
means there is less than a 1 in 20 chance that the findings observed
are due to chance.
Related: Statistical significance, Error, Confidence intervals
Qualitative
research - Any research that utilizes non-quantitative methodology,
e.g., case studies or narrative description or interviews.
Quality indicator
– Oftentimes used interchangeably with “performance
measure.” Quality indicators are specific and measurable
elements of health care that can be used to assess the quality
of care.
Random
error – see Chance
Randomization –
Mechanism to assign, by chance, “intervention / no intervention”
assignments to study participants in randomized controlled trials.
- Mechanisms should
include random numbers which may be through a table or done
via computer.
- Simple randomization
is like a coin flip where each person has equal chance of being
assigned to either group.
- Blocked randomization
is used to create equally sized groups.
- Stratified randomization
randomizes subjects within selected criteria – such as
age or sex or anticipated confounders.
- Sequential methods
are more prone to bias especially when there has not been effective
concealment of allocation.
Randomized controlled
trial (RCT) – An experiment in which investigators control
an exposure or intervention, and subjects are randomly assigned
to the study group or to the control group or groups. Intervention
or exposure then is performed. Patients are followed to determine
outcomes such as improvements or harms.
Related: Experimental study
Random sample –
A sample derived by selecting individuals such that each individual
has the same probability of selection.
Rate – Derived
by dividing a numerator by a denominator. The numerator is a subset
of the denominator. Example: The percentage of diabetic eye exams
for Type I diabetics was 80% for our clinic.
Related: Denominator, numerator
Ratio – A numerator
and denominator (the numerator is not required to be a subset
of the denominator). Example –The ratio of women to men
in these studies was 1 to 5 (which can also be expressed as 1:5).
Or, the rate and ratio for diabetic eye exams in our clinic would
be 80/100.
Related: Denominator, numerator
Rebate: A cost offset
that pharmacy systems receive when purchasing large quantities
of drugs. AQ30Selection of drugs for large bulk purchase is based
on the drugs’ volume of use.
Recall bias –
Inaccuracies resulting from data collected from study participants
who are asked to retrospectively self-report on study items of
interest. This kind of bias is most likely to occur when certain
behaviors are hard to track (e.g., diet) or are often hidden for
some reason such as being socially sensitive (e.g., sexual behaviors,
smoking behavior, etc.).
Related: Bias
Regression model
– A method for estimating the relationship of a dependent
variable to a variety of independent variables.
Regression-toward-the-mean
– Returning to the “average” state. Meaning
that extreme test values are statistically likely to move to an
average over time. When patients present with extreme values and
then seem to have improvement, it may be falsely attributed to
an intervention when it is truly due to regression-to-the-mean.
A comparison group with no intervention can help expose this effect.
Relative risk (RR)
- A point estimate in which the risk of some health-related event,
such as disease or death, is compared between a study group and
a comparison group. Relative risk is expressed as the number of
times one group may be at risk over another. A relative risk of
less than 1 is a lower risk.
Formula: Risk in study group divided by risk in the comparison
group
Synonym: Risk ratio
Related: Measures of outcomes
Relative risk reduction
(RRR) – A point estimate in which the percent reduction
in events in the intervention or exposed group is compared to
the comparison group — relative risk reduction is the proportional
difference in size between outcomes. For example, if we had 15%
mortality in a comparison group as compared to 10% mortality in
the intervention group, since 10 is one-third smaller than 15,
the RRR would be 33%. Relative risk reduction begs the question
"relative to what?" Because RRR overestimates the actual
difference, it should always be used in conjunction with another
point estimate such as absolute risk reduction or number-needed-to-treat
when communicating study results.
Formula: RRR = [((Comparison group outcomes - Intervention group
outcomes) / Comparison group outcomes) x 100] or 1-Relative Risk
(RR)
Related: Measures of outcomes
See a visual description here.
Representative sample
– A sample whose characteristics correspond to those of
the original population or population of interest.
Retrospective study
– A study method to look at cause and effect after outcomes
have already occurred. Generally this refers to a case-control
study; however, cohort studies can use a retrospective method.
Risk – The
probability that an event will occur.
Risk adjustment –
The process of adjusting performance rates or other outcomes of
care to level the playing field due to differences in health status
between populations.
Risk factor –
An aspect of personal behavior or lifestyle, an environmental
exposure, or an inborn or inherited characteristic that is associated
with an increased occurrence of disease or other health-related
event or condition.
Risk ratio –
see Relative risk
Risk stratification
– The process of, or result of, separating a sample into
subsamples based on health status or risk factors such as age,
comorbidities, etc.
Safety
— Safety in research studies pertains to harms of various
interventions.
Related terms: Adverse events, ADEs, Harms, Risks, Side effect
Sample – A
selected subset of a population. A sample may be random or non-random
and it may be representative or non-representative.
Related: Random sample, Representative sample
Sampling error -
See chance
Second-line therapy:
Therapy for patients failing on drugs established as “first-line”
therapy.
Selection bias –
See bias
Sensitivity (SN)
– Correct identification by a screening test or case definition
as having disease – of all those with a disease, the percent
testing positive (true positives). Sensitivity is derived from
calculations based on people who are known to have the condition.
Sensitivity is especially useful when it is important not to miss
a disease. High sensitivity is considered to "rule in"
a condition.
Formula = a / (a + c) from two-by-two table
Related: Measures of test function, Two-by-two table
Specificity (SP)
– Correct identification by a screening test or case definition
as not having disease – of all those without a disease,
the percent testing negative (true negatives). Specificity is
derived from calculations based on people who are known not to
have the condition. Specificity is especially useful when it is
important to avoid false positives. High specificity is considered
to "rule out" a condition.
Formula = d / (b + d) from two-by-two table
Related: Measures of test function, Two-by-two table
Standard deviation
(SD) – A widely used measure of dispersion of a frequency
distribution, equal to the positive square root of the variance.
Standard deviation can tell you how widely or how tightly variables
are distributed around the average. One standard deviation accounts
for approximately 68 percent of the distribution. Two standard
deviations account for approximately 95 percent.
Statistical power
- The ability to reliably determine a statistically significant
relationship between interventions if one exists. Power comes
into play in planning and interpreting studies. Investigators
want to know the risk of drawing erroneous conclusion about efficacy
and so they do power calculations to estimate the number of subjects
needed in a study to show a statistically significant result if
one exists. It is conventional to accept a 5% risk of concluding
that an outcome is truly different in the study groups when they
are not (Type I or Alpha error). It is also conventional to accept
a 20% risk of concluding that an outcome is not statistically
significant when in truth there may be a true difference (Type
II or Beta error). Power can be determined by considering Alpha,
Beta, the event rate in the comparison group, and what is judged
to be a clinically significant difference between the groups.
As a practical matter, many users focus on the confidence intervals.
For valid studies, consider what you judge to be a reasonable
range for clinical significance – this need not be hard
and fast. For statistically significant findings, is the confidence
interval wholly within bounds for clinical significance? For non-significant
findings, is the confidence interval wholly beneath your limit
for clinical significance? A yes to these two questions means
likely conclusive findings for valid studies. No, means findings
are inconclusive.
Synonyms: Power, Power of a study
Related: Error
Statistical significance
– The extent to which study results are unlikely to be due
to chance. Expressed as a p-value and it is typically set at <.05
due to convention. Statistical significance may be set lower,
but must be determined in advance of the study.
Related: Error, p-value
Subgroup analysis
— Analysis of research results on subsets of patients in
a study, such as a subgroup of Caucasian women in a study of asthmatics
of all races, ages and genders. Subgroups for study must be determined
in advance of a study — otherwise the results are highly
likely to be due to chance.
Superiority trial
- Clinical trials which are conducted to determine if one intervention
is superior to another.
Surrogate end points
– See Intermediate outcome markers.
Systematic review
– Studies that examine more than one study on a given topic
in a systematic way using predetermined criteria. The goal is
to provide a summary estimate of effect based on the scientific
weight of the studies.
Related: Meta-analysis.
Therapeutic substitution: Substitution of a drug with an agent
having a different chemical structure but similar clinical benefits.
Trend - A term used
to describe observed results in several studies which consistently
go in the same direction, but are not statistically significant.
Triangulation issues:
A catchall term for all the various considerations that need to
be made in making a decision.
Type 1 error - see
Error
Type 2 error - see
Error
Two-by-Two Table
— Table to report results and from which statistics are
calculated. See examples below:
Intervention
Example
| Two-by-two
Table (2x2 Table) |
Not
Improved |
Improved |
Totals |
| Intervention
Group |
a
|
b
|
a+b |
| Control
Group |
c
|
d
|
c+d |
| Totals |
a+c
= Total Not Improved |
b+d
= Total Improved |
a+b+c+d |
Diagnostic
Testing Example
| Two-by-two
Table (2x2 Table) |
Condition
Present |
Condition
Absent |
Totals |
| Test
Positive |
a
= true positives |
b
= false positives |
a+b |
| Test
Negative |
c
= false negatives |
d
= true negatives |
c+d |
| Totals |
a+c
= prevalence (in this population) |
|
a+b+c+d |
Validity – Closeness to truth. For example,
in performance measurement, the degree to which a measurement
actually measures or detects what it is supposed to measure.
Variable –
Any characteristic or attribute that can be measured.
Statistical tests
are chosen based on type of variables. The four main types of
variables are -
- Nominal (named
categories without any measurable scale such as ethnic groups)
- Dichotomous or
binary (two mutually exclusive categories resulting in “either
this or that” such as “death” or “survival”)
- Ordinal or ranked
(three or more variables that can be “ordered” or
ranked such as good/better/best or satisfied/neutral/unsatisfied)
- Continuous (can
be anywhere along a continuum, e.g., blood glucose readings)
Related: Dependent
variable, independent variable
Variance –
A measure of the spread of a variable about its mean value. In
a data set, a single point lies above or below the mean for the
entire dataset. A deviation score is the measure of how much each
point lies above or below the mean for the entire dataset. Variance
is the mean of all the deviation scores. It is a way of mathematically
stating how far deviations are from expected results.
Washout
period – Used in a cross-over trial to discontinue patients
on a treatment before the second treatment is given to reduce
the likelihood that the first treatment will affect the outcome
even after it is stopped. |