Jump to content

Source assessments: Difference between revisions

From POSIWiki
Content deleted Content added
Initial hub: the standard applied across the genre, the citation-practice argument with its falsification condition, and how to refute a flag
 
Withdraw the claim that the qualifications did not propagate: the uninoculated-culture problem was restated repeatedly in the decade after 1954. The section now states the question and labels the restatements reported
Line 1: Line 1:
A '''source assessment''' is an entry whose subject is a single document rather than a system: a paper, filing, report or dataset, read in full and measured against its own claims. Each one records what the document establishes, what it does not, and where a reader can check either.
A '''source assessment''' is an entry whose subject is a single document rather than a system: a paper, filing, report or dataset, read in full and measured against its own claims. Each one records what the document establishes, what it does not, and where a reader can check either.


The documents assessed here are foundational — papers a later literature rests on and cites as settled. In every case so far the qualifications were present in the original and did not travel with the method.
The documents assessed here are foundational — papers a later literature rests on and cites as settled. In every case so far the qualifications were present in the original.


== The Standard Applied ==
== The Standard Applied ==
Line 17: Line 17:
The [[Peer Review]] entry argues structurally — reviewer selection, invisible track records, unaccountable rejection. Every claim in it concerns what cannot be audited. These pages test the same question from the other direction, on documents anyone can open.
The [[Peer Review]] entry argues structurally — reviewer selection, invisible track records, unaccountable rejection. Every claim in it concerns what cannot be audited. These pages test the same question from the other direction, on documents anyone can open.


What they find is narrower and more durable than a claim that review fails to catch defects. In the cases assessed so far, the authors stated the limitations themselves, in print, in the published paper. What did not happen is those statements travelling with the method into the literature that cites it. That is a finding about citation practice and about what a credential is taken to certify, not about authors concealing anything.
What they find is narrower and more durable than a claim that review fails to catch defects. In the cases assessed so far, the authors stated the limitations themselves, in print, in the published paper. The question these pages open is what the subsequent literature did with those statements.


That question is '''unresolved''', and the obvious simple answer is wrong. The qualifications were not ignored at the time: for roughly a decade after 1954 the problem of cytopathic effects arising in uninoculated monkey kidney cultures was restated repeatedly in indexed journals. These reports are '''reported''' here rather than observed, from a literature review that compiles them, pending inspection of the primary papers. What is not established is what happened after that decade, and whether the method carried the qualifications forward or shed them.
⚫
This reading is '''inferred''': it rests on the contrast between what a paper states and how it is later invoked. The observation that would establish it is a citation-context survey — sampling papers that cite a foundational source and recording how many cite its method and how many cite its stated limitations. That survey has not been carried out. It is falsifiable, and if citing papers routinely carried the qualifications forward, this section would be wrong.

⚫
The observation that would settle it is a citation-context survey — sampling papers that cite a foundational source and recording how many cite its method and how many cite its stated limitations, over time. That survey has not been carried out. Until it is, this section states a question, not a finding.


== Assessments ==
== Assessments ==
Line 39: Line 41:
Each assessment carries its own status section covering what was read, in what form, and what was not. The flags are '''observed''' as to what a document contains and does not contain.
Each assessment carries its own status section covering what was read, in what form, and what was not. The flags are '''observed''' as to what a document contains and does not contain.


The account in ''Why These Pages Exist'' is '''inferred''' and identifies the survey that would test it. The claim that the documents assessed are foundational is '''observed''' from their citation counts and from their role in the methods they established; the claim that the qualifications did not propagate is '''provisional''' pending that survey.
''Why These Pages Exist'' states a question rather than a finding, and identifies the survey that would settle it. The claim that the documents assessed are foundational is '''observed''' from their role in the methods they established. The contemporaneous restatements of the uninoculated-culture problem are '''reported''' from a compiling review, not yet inspected in the primary sources.


== See Also ==
== See Also ==

Revision as of 02:13, 27 October 2026

A source assessment is an entry whose subject is a single document rather than a system: a paper, filing, report or dataset, read in full and measured against its own claims. Each one records what the document establishes, what it does not, and where a reader can check either.

The documents assessed here are foundational — papers a later literature rests on and cites as settled. In every case so far the qualifications were present in the original.

The Standard Applied

Every assessment states what each flag is measured against, and the available standards are limited to these:

  • The document's own claims — whether the evidence presented supports what the document asserts.
  • Its authors' own stated requirements — experiments, data or controls the document itself names as necessary and not obtained.
  • A criterion published by the venue that reviewed it, where one exists and can be identified.

No flag is measured against an unnamed standard of competence, and none against methods unavailable when the document was published. This constraint is the reason the genre is publishable at all: a flag that rests on a named standard can be contested on the standard, and a flag that rests on an unnamed one simply asserts the assessor's authority.

Why These Pages Exist

The Peer Review entry argues structurally — reviewer selection, invisible track records, unaccountable rejection. Every claim in it concerns what cannot be audited. These pages test the same question from the other direction, on documents anyone can open.

What they find is narrower and more durable than a claim that review fails to catch defects. In the cases assessed so far, the authors stated the limitations themselves, in print, in the published paper. The question these pages open is what the subsequent literature did with those statements.

That question is unresolved, and the obvious simple answer is wrong. The qualifications were not ignored at the time: for roughly a decade after 1954 the problem of cytopathic effects arising in uninoculated monkey kidney cultures was restated repeatedly in indexed journals. These reports are reported here rather than observed, from a literature review that compiles them, pending inspection of the primary papers. What is not established is what happened after that decade, and whether the method carried the qualifications forward or shed them.

The observation that would settle it is a citation-context survey — sampling papers that cite a foundational source and recording how many cite its method and how many cite its stated limitations, over time. That survey has not been carried out. Until it is, this section states a question, not a finding.

Assessments

  • Enders and Peebles 1954 — Propagation in Tissue Cultures of Cytopathogenic Agents from Patients with Measles. The foundational tissue-culture paper for measles. Six flags; the authors name two experiments "essential in the establishment of this relationship" that remained to be carried out.

How to Refute a Flag

Every flag carries the page it was checked on and a statement of what would refute it. Checking one costs a single fetch, and the sources are listed on each assessment with their access paths.

A reader who refutes a flag performs verification that no one else is paid to perform, and the correction is recorded in the entry's revision history. Three distinctions make a refutation decisive rather than a disagreement:

  • A flag that says absent from the described design is refuted by a passage describing that design element. A flag that says not located in sections X and Y is refuted by locating it anywhere.
  • A document that answers a flag elsewhere in its own text refutes it outright. Such cases are recorded under Claims Not Supported by the Paper on the assessment itself, including flags that circulate and that the document answers.
  • A disagreement about whether a gap matters is not a refutation of the flag. It is a dispute about the standard, which is why the standard is named.

Epistemic Status

Each assessment carries its own status section covering what was read, in what form, and what was not. The flags are observed as to what a document contains and does not contain.

Why These Pages Exist states a question rather than a finding, and identifies the survey that would settle it. The claim that the documents assessed are foundational is observed from their role in the methods they established. The contemporaneous restatements of the uninoculated-culture problem are reported from a compiling review, not yet inspected in the primary sources.

See Also