Jump to content

Source assessments: Difference between revisions

From POSIWiki
Content deleted Content added
Add North 2025 to the assessments list and cite it where the hub relies on its corpus
State the claim in its conditional, enumerative form; record the sample-frame limit and the falsification condition
Line 17: Line 17:
The [[Peer Review]] entry argues structurally — reviewer selection, invisible track records, unaccountable rejection. Every claim in it concerns what cannot be audited. These pages test the same question from the other direction, on documents anyone can open.
The [[Peer Review]] entry argues structurally — reviewer selection, invisible track records, unaccountable rejection. Every claim in it concerns what cannot be audited. These pages test the same question from the other direction, on documents anyone can open.


What they find is narrower and more durable than a claim that review fails to catch defects. In the cases assessed so far, the authors stated the limitations themselves, in print, in the published paper. The question these pages open is what the subsequent literature did with those statements.
What they find is narrower and more durable than a claim that review fails to catch defects, and narrower than a claim that controls are not performed. The claim these pages test is conditional:


''Of the papers that claim to confirm a causal hypothesis, those inspected in full are each missing an essential gap — most often a control — and in each case the gap can be named along with the page it was checked on.''
That question is '''unresolved''', and the obvious simple answer is wrong. The qualifications were not ignored at the time: for roughly a decade after 1954 the problem of cytopathic effects arising in uninoculated monkey kidney cultures was restated repeatedly in indexed journals. These reports are '''reported''' here rather than observed, from the literature review assessed at [[North 2025]], pending inspection of the primary papers. What is not established is what happened after that decade, and whether the method carried the qualifications forward or shed them.


Three properties make that claim worth publishing rather than asserting. It is '''conditional''', so a thoroughly controlled study that concludes ''against'' a causal agent does not bear on it; such studies exist and are well controlled, which is what a null result requires. It is '''enumerative''', so it is strengthened by each assessment rather than by argument. And it is '''individually checkable''', so one fetch tests any item in it.
The observation that would settle it is a citation-context survey — sampling papers that cite a foundational source and recording how many cite its method and how many cite its stated limitations, over time. That survey has not been carried out. Until it is, this section states a question, not a finding.

The gaps found are not a single recurring defect. They have included an absent non-disease donor arm, a contaminating organism named by the authors and left untested, a transmissibility criterion never met, and a control scored by an assay that cannot detect the agents the control was used to license. What is common is not the defect but that each paper's own stated or evident confounder was left standing.

'''Scope.''' Nothing here generalises beyond the papers listed below. The first assessments reached this wiki through a single compiling review, which selected its sources because they report cytopathic effects in uninoculated cultures — a reasonable way to begin and not a sample frame. A reader is entitled to ask how each paper was chosen, and that question is answered on each assessment.

'''What would refute the claim:''' one paper claiming confirmation, read in full, with no essential gap. That outcome is worth more than a further instance, and it is looked for rather than waited for.


== Assessments ==
== Assessments ==

Revision as of 15:28, 27 October 2026

A source assessment is an entry whose subject is a single document rather than a system: a paper, filing, report or dataset, read in full and measured against its own claims. Each one records what the document establishes, what it does not, and where a reader can check either.

The documents assessed here are foundational — papers a later literature rests on and cites as settled. In every case so far the qualifications were present in the original.

The Standard Applied

Every assessment states what each flag is measured against, and the available standards are limited to these:

  • The document's own claims — whether the evidence presented supports what the document asserts.
  • Its authors' own stated requirements — experiments, data or controls the document itself names as necessary and not obtained.
  • A criterion published by the venue that reviewed it, where one exists and can be identified.

No flag is measured against an unnamed standard of competence, and none against methods unavailable when the document was published. This constraint is the reason the genre is publishable at all: a flag that rests on a named standard can be contested on the standard, and a flag that rests on an unnamed one simply asserts the assessor's authority.

Why These Pages Exist

The Peer Review entry argues structurally — reviewer selection, invisible track records, unaccountable rejection. Every claim in it concerns what cannot be audited. These pages test the same question from the other direction, on documents anyone can open.

What they find is narrower and more durable than a claim that review fails to catch defects, and narrower than a claim that controls are not performed. The claim these pages test is conditional:

Of the papers that claim to confirm a causal hypothesis, those inspected in full are each missing an essential gap — most often a control — and in each case the gap can be named along with the page it was checked on.

Three properties make that claim worth publishing rather than asserting. It is conditional, so a thoroughly controlled study that concludes against a causal agent does not bear on it; such studies exist and are well controlled, which is what a null result requires. It is enumerative, so it is strengthened by each assessment rather than by argument. And it is individually checkable, so one fetch tests any item in it.

The gaps found are not a single recurring defect. They have included an absent non-disease donor arm, a contaminating organism named by the authors and left untested, a transmissibility criterion never met, and a control scored by an assay that cannot detect the agents the control was used to license. What is common is not the defect but that each paper's own stated or evident confounder was left standing.

Scope. Nothing here generalises beyond the papers listed below. The first assessments reached this wiki through a single compiling review, which selected its sources because they report cytopathic effects in uninoculated cultures — a reasonable way to begin and not a sample frame. A reader is entitled to ask how each paper was chosen, and that question is answered on each assessment.

What would refute the claim: one paper claiming confirmation, read in full, with no essential gap. That outcome is worth more than a further instance, and it is looked for rather than waited for.

Assessments

  • Enders and Peebles 1954 — Propagation in Tissue Cultures of Cytopathogenic Agents from Patients with Measles. The foundational tissue-culture paper for measles. Six flags; the authors name two experiments "essential in the establishment of this relationship" that remained to be carried out.
  • North 2025 — The Non-Specificity of Cytopathic Effects. A literature review compiling thirty-one reports of cytopathic effects in uninoculated cultures. Seven flags; the corpus is checkable, the review states no limitations of its own.

How to Refute a Flag

Every flag carries the page it was checked on and a statement of what would refute it. Checking one costs a single fetch, and the sources are listed on each assessment with their access paths.

A reader who refutes a flag performs verification that no one else is paid to perform, and the correction is recorded in the entry's revision history. Three distinctions make a refutation decisive rather than a disagreement:

  • A flag that says absent from the described design is refuted by a passage describing that design element. A flag that says not located in sections X and Y is refuted by locating it anywhere.
  • A document that answers a flag elsewhere in its own text refutes it outright. Such cases are recorded under Claims Not Supported by the Paper on the assessment itself, including flags that circulate and that the document answers.
  • A disagreement about whether a gap matters is not a refutation of the flag. It is a dispute about the standard, which is why the standard is named.

Epistemic Status

Each assessment carries its own status section covering what was read, in what form, and what was not. The flags are observed as to what a document contains and does not contain.

Why These Pages Exist states a question rather than a finding, and identifies the survey that would settle it. The claim that the documents assessed are foundational is observed from their role in the methods they established. The contemporaneous restatements of the uninoculated-culture problem are reported from a compiling review, not yet inspected in the primary sources.

See Also