# Source Misrepresentation

Misstates, exaggerates, reverses, or selectively distorts what a cited, retrieved, uploaded, or tool-returned source actually says.

Unlike Citation Span Mismatch, the problem is the model's interpretation of the source, not merely an unsupported citation attachment. Unlike Quote Hallucination, the failure can occur without fabricating exact quoted wording.

## Metadata
- ID: `source-misrepresentation`
- Status: published
- Taxonomy-Version: 0.0.1
- Last-Modified: 2026-06-13T09:00:00-04:00
- Category: Faithfulness (`faithfulness`)
- HTML: https://failmodes.com/failure-modes/source-misrepresentation
- JSON: https://failmodes.com/failure-modes/source-misrepresentation.json
- Markdown: https://failmodes.com/failure-modes/source-misrepresentation.md

## Search Phrases
- misrepresented the source
- twisted what the source said
- exaggerated the source
- reversed the source's meaning

## Why It Happens
1. Models paraphrase by regenerating meaning through their own learned distributions rather than copying. Hedges, scope limits, and negations are low-salience tokens that paraphrasing easily drops or flips, which reverses or strengthens the original claim (Kryscinski et al., 2020, "Evaluating the Factual Consistency of Abstractive Text Summarization").
2. Pretraining priors pull interpretation toward the typical version of a claim. When a source says something surprising or carefully qualified, the model drifts toward the more common framing it saw during training (Longpre et al., 2021, "Entity-Based Knowledge Conflicts in Question Answering").
3. Preference tuning rewards clear, decisive prose, and sycophancy pressures bend interpretation toward the user's apparent position. Faithfully preserving a source's uncertainty reads as wishy-washy to raters, so tuning pushes toward stronger restatements that agree with what the user wants to hear (Sharma et al., 2023, "Towards Understanding Sycophancy in Language Models").
4. Retrieval hands the model fragments stripped of surrounding argument. A passage that was a counterexample, a quotation of an opposing view, or a conditional claim gets read as the document's own assertion.

## Examples

### Dropped hedge strengthens the claim
- Kind: fail
- Summary: Paraphrasing discards "may" and "in some patients," turning a cautious finding into a flat assertion the source never made.

```text
[… uploaded study reads: "The supplement may modestly reduce fatigue in some patients with mild deficiency." …]
User: What does this study say about the supplement?
Assistant: The study shows that the supplement reduces fatigue.
```

### Opposing view read as the document's claim
- Kind: fail
- Summary: The source quotes a critic in order to rebut them, but retrieval strips the surrounding argument and the model attributes the criticism to the document itself.

```text
[… retrieved passage: "Critics argue the policy raised rents; the report's data show rents were flat." …]
User: What does the report conclude about the policy's effect on rents?
Assistant: The report concludes that the policy raised rents.
```

### Faithful facts, shifted emphasis
- Kind: warn
- Summary: Every individual statement matches the source, but a minor caveat is promoted to the headline finding, leaving the reader with a conclusion the source did not draw.

```text
[… study's main result is a treatment benefit; a limitations note mentions two cases of mild nausea …]
User: What does this study say about the supplement?
Assistant: The key takeaway is the study's safety concerns — it documents adverse reactions, alongside some reported benefits.
```

### Qualifiers preserved
- Kind: ok
- Summary: Restates the finding at exactly the strength the source gives it, keeping scope limits and uncertainty intact.

```text
[… uploaded study reads: "The supplement may modestly reduce fatigue in some patients with mild deficiency." …]
User: What does this study say about the supplement?
Assistant: It reports a possible modest reduction in fatigue, and only for some patients with mild deficiency — the authors stop well short of a general claim that it works.
```

## Detection Approaches
- **Entailment checking**: Run an NLI model between each restated claim and the source passage it paraphrases. Dropped hedges and flipped negations surface as non-entailment — "the supplement reduces fatigue" is not entailed by "may modestly reduce fatigue in some patients," even though every entity matches.
- **LLM-as-judge evaluation**: Run a judge that compares the restatement against the source on the axes paraphrasing distorts — claim strength, scope qualifiers, causal direction, and whether a quoted opposing view got read as the document's own position. Entity-level checks miss these relation errors entirely.
- **Golden-set evals**: Maintain sources that are heavily hedged, carefully scoped, or surprising relative to common framings, and regression-test whether restatements preserve the qualifiers and direction — measuring drift toward the stronger, more typical version of each claim.

## Mitigation Approaches
- **Instruction constraints**: Instruct the model to restate claims at exactly the strength the source gives them — keeping "may," "in some patients," and scope limits intact — and to quote the operative sentence when the finding is hedged, since paraphrase is where qualifiers get dropped.
- **Self-check pass**: Before answering, have the model compare its restatement against the source on the axes paraphrasing distorts — claim strength, scope, causal direction, attribution — and restore any hedge or qualifier the draft strengthened away.
- **Retrieval tuning**: Retrieve passages with enough surrounding context to preserve their argumentative role — expanding chunks or including neighboring sentences — so a quoted critic or a conditional claim arrives marked as such instead of reading as the document's own assertion.

## Related Modes
- **Citation Span Mismatch** (`citation-span-mismatch`)
  HTML: https://failmodes.com/failure-modes/citation-span-mismatch
  JSON: https://failmodes.com/failure-modes/citation-span-mismatch.json
- **Quote Hallucination** (`quote-hallucination`)
  HTML: https://failmodes.com/failure-modes/quote-hallucination
  JSON: https://failmodes.com/failure-modes/quote-hallucination.json
- **Summarization Distortion** (`summarization-distortion`)
  HTML: https://failmodes.com/failure-modes/summarization-distortion
  JSON: https://failmodes.com/failure-modes/summarization-distortion.json
- **Authority Hallucination** (`authority-hallucination`)
  HTML: https://failmodes.com/failure-modes/authority-hallucination
  JSON: https://failmodes.com/failure-modes/authority-hallucination.json
- **Tool Result Misread** (`tool-result-misread`)
  HTML: https://failmodes.com/failure-modes/tool-result-misread
  JSON: https://failmodes.com/failure-modes/tool-result-misread.json