A study of elementary-school reading programs is directly relevant to whether a tutoring program improves middle-school mathematics scores. True or false?
1 Assessing Evidence Quality Online Quiz Questions
Use this free practice quiz with 20 questions to review 1 Assessing Evidence Quality, test your knowledge, and prepare for your next test or exam.
If a study has been peer reviewed, its findings are guaranteed to be correct.
- A
True
- B
False
What is the term for a systematic influence that can distort study findings? Enter the single term.
The degree to which a study's population, intervention or exposure, comparison, and outcomes match the question is its .
Students who chose to participate in a tutoring program scored higher than those who did not. What conclusion is best supported by this observational finding?
- A
The association proves that tutoring caused the higher scores.
- B
The association alone does not establish that tutoring caused the higher scores.
- C
The study is irrelevant because it measured mathematics scores.
- D
The study is conclusive if its results are statistically significant.
An inconclusive study result does not necessarily show that an intervention has no effect; the evidence may simply be too limited to distinguish an effect from no effect.
- A
True
- B
False
What is the term for a problem in which another factor is related to both a proposed cause and an outcome, making their relationship difficult to interpret? Enter the single term.
A wide confidence interval indicates that an effect estimate is .
A systematic review finds only a few studies, and their results conflict. Which conclusion about the review is most appropriate?
- A
Its conclusions may remain limited if the available studies are few, inconsistent, or biased.
- B
It settles the question because it combines multiple studies.
- C
It is necessarily less useful than any single study.
- D
Its conclusions are reliable as long as the included studies are peer reviewed.
Which are the five common GRADE considerations for assessing certainty across studies? Select all correct choices.
- A
Risk of bias
- B
Consistency of results
- C
Sample size alone
- D
Directness to the question
- E
Precision of estimates
- F
Whether the work was peer reviewed
- G
Publication bias
Two studies have different design labels, but the one with the lower-ranked design is more directly relevant and better conducted. How should their evidential strength be judged?
- A
Rank the design label first and accept the higher-ranked design as stronger.
- B
Compare the studies' execution and fit to the question, not just their design labels.
- C
Prefer whichever study reports statistical significance.
- D
Treat a single study as decisive if its methods are clearly described.
A decision-maker asks whether a particular tutoring program improves middle-school mathematics scores. Which study features would make the evidence more directly relevant? Select all correct choices.
- A
The study includes middle-school students like those in the question.
- B
The study evaluates the particular tutoring program at issue.
- C
The study uses a comparison relevant to the decision being considered.
- D
The study measures mathematics scores, the outcome of interest.
- E
The report has polished graphics and authoritative-sounding language.
A small study finds higher mathematics scores among students who chose to participate in a tutoring program than among nonparticipants. Explain two limitations that should temper the conclusion and how each affects interpretation.
A decision-maker wants to know whether a tutoring program improves middle-school mathematics scores. How should evidence about elementary-school reading programs be treated?
- A
It is directly relevant because both examples involve students.
- B
It is only indirectly relevant because the population and outcome differ.
- C
It is irrelevant because evidence from a different program can never be informative.
- D
It is conclusive because reading and mathematics are both school subjects.
What term describes a systematic influence that can distort study findings, such as selective recruitment or inaccurate measurement? Enter the term.
A study reports a statistically significant effect, but the estimated effect is very small. Which interpretation is best supported?
- A
The result must matter in practice because it is statistically significant.
- B
The result proves that the program caused the outcome.
- C
The result may be statistically significant yet too small to matter in practice.
- D
The result should be disregarded because practical importance cannot be assessed.
What evidence-assessment term describes the possibility that studies with certain results are more likely to appear in the accessible research? Enter the term.
In a small study, students who chose to join a tutoring program scored higher than those who did not. Why should a reviewer be cautious about concluding that tutoring caused the difference?
- A
The test score is a measure of directness.
- B
Motivation may be a confounder because it could help explain the association between tutoring and scores.
- C
The study proves causation because the tutoring program came before the test.
- D
The study has no relevance because students chose whether to participate.
A study's result is inconclusive. What is the most defensible interpretation?
- A
It establishes that the intervention has no effect.
- B
It establishes that the intervention has an effect too small to measure.
- C
The evidence may be too limited to distinguish an effect from no effect.
- D
It means the study should be treated as proof of the opposite conclusion.
A systematic review includes only a few studies, and those studies are inconsistent and at risk of bias. Which conclusion about the review is most appropriate?
- A
Combining studies guarantees a firm conclusion, regardless of the studies' limitations.
- B
A review is useful only when every included study reports identical results.
- C
The review's conclusions should be treated as certain because it includes multiple studies.
- D
The review may provide a broad view, but limitations in the available studies still constrain its conclusions.
Related study packs and tools
- Quiz
01 The Ancient Mediterranean: Geography, Sources, and Chronology
Explore how geography, chronology, evidence, and networks shaped the diverse societies of the ancient Mediterranean.
- Quiz
01 The Renaissance in Europe
A medium-difficulty quiz on Renaissance humanism, artistic practices, political life, patronage, and the movement’s varied forms across Europe.
- Quiz
02 The Reformation and Religious Change
A medium-difficulty quiz on the Reformation, Catholic reform, and the political settlements and changes that shaped religious life in Europe.
- Study guide
03 The Greek Polis and the Archaic Age
Trace how Greek communities developed into independent poleis and compare the distinct political and social paths of Sparta and Athens during the Archaic Age.
- Study guide
04 Greek Politics and Warfare in the Classical Age
Compare political power and citizenship in Athens and Sparta, then trace how the Persian Wars and rival alliances shaped Greek warfare and the Peloponnesian War.
- Study guide
05 Greek Religion, Society, and Culture
Explore how religion, philosophy, performance, art, architecture, and social life shaped diverse ancient Greek communities.
- Study guide
06 Macedon and the Hellenistic Mediterranean
Trace Macedon’s rise, Alexander’s conquests, the competing successor kingdoms, and the political, social, religious, and artistic connections that shaped the Hellenistic Mediterranean.
- Flashcards
07 Early Rome and the Republic
Review Rome’s early origins, republican institutions, social reforms, and expansion across Italy.
- Quiz
08 Rome’s Mediterranean Expansion and Republican Crisis
A medium-difficulty quiz on Rome's Mediterranean expansion, provincial government, and the pressures that destabilized the Republic.
- Study guide
08 Rome’s Mediterranean Expansion and Republican Crisis
Trace how Rome’s Mediterranean conquests expanded its power and strained Republican institutions, from the Punic Wars to Augustus’s new political settlement.
- Quiz
09 The Roman Empire: Government and Warfare
A medium-difficulty quiz on Roman imperial government, provincial administration, and the army.
- Quiz
10 Roman Society, Religion, and Economy
A medium-difficulty quiz on Roman religion, social relationships, labor, trade, and urban life.