usdigitalmarketingindex.com SEO
How can AI-assisted content drafts be screened for fabricated citations before publication?
Updated November 15, 2026
By opening every source the draft cites and reading the passage that is supposed to support each claim. Nothing short of that works. A language model can produce a citation that looks complete, with an author, a title, a journal, a year, and a URL, for a document that does not exist. It can also cite a real document for something the document does not say. Both kinds pass a visual check, and the second passes a link check too, because the page loads. The screen is therefore a claim-by-claim audit: list each factual statement that leans on a source, locate the source, find the sentence in it, and compare. Claims whose sources fail are corrected from a real source, rewritten to what a real source supports, or removed. A working URL is not evidence. The words on the page it leads to are.
Extracting all references
First make the citations visible as a list. Go through the draft and record every place it relies on something outside itself.
| Type | Examples |
|---|---|
| Formal citations | Footnotes, reference lists, "(Author, year)" |
| Links | Any hyperlink offered as support |
| Named sources without links | "According to a Harvard study", "the WHO says" |
| Unnamed sources | "Studies show", "experts agree", "research has found" |
| Statistics | Any number, percentage, date, or ranking |
| Quotations | Words in quotation marks attributed to a person or document |
| Named people and organizations | Experts, institutions, companies, with their titles and affiliations |
| Laws, standards, and guidelines | Statute names, regulation numbers, standard identifiers |
| Product and technical facts | Specifications, version numbers, feature claims |
For each, record the exact sentence from the draft and what it attributes to whom.
Unnamed sources belong on the list. “Studies show” with no study is a citation to nothing, and it should either gain a real source or lose the claim of support.
Statistics and quotations get particular attention. A model can generate a plausible figure or a fluent quotation with no origin, and readers repeat both.
Opening source URLs
Open each cited source yourself, in a browser, from the URL or by searching for the title.
| Check | Fabrication sign |
|---|---|
| Does the URL load? | 404, or a domain that does not exist |
| Does it lead to the document named? | A real site, on a different topic; a home page; a search page |
| Does the document exist? | Search for the exact title in quotation marks; search the journal's or publisher's own index |
| Does the author exist and work in that field? | No trace of the person, or a real person from an unrelated field |
| Do the details agree? | The journal exists but has no such article; the year, volume, or page range does not match |
| Does the identifier resolve? | A DOI or similar identifier that leads nowhere or to a different paper |
| Is it the original? | The link goes to a page that itself cites something else for the claim |
Patterns that mark an invented reference:
- every component is plausible and none can be found together;
- the title is a neat paraphrase of the claim it supports;
- the URL follows the site’s format and returns an error;
- authors are real names in the field who did not write that paper;
- the source is described vaguely enough to be unfalsifiable.
A citation that cannot be located after a reasonable search is treated as nonexistent. The burden is on the citation.
Do not ask the same AI tool whether its citation is real. A model can affirm its own invention. Verification happens against the source, outside the tool.
Verifying quoted propositions
A source that exists has cleared only the first test. The second is whether it says what the draft claims.
For each claim:
- Find the passage in the source. Use the page’s search function for key terms and numbers.
- Read the passage and the sentences around it.
- Compare it with the draft’s sentence, element by element.
| Element | Question |
|---|---|
| The fact | Does the source state it? |
| The number | Same figure, same unit, same thing being measured? |
| The scope | Same population, country, period? |
| The certainty | Does the source say "may" where the draft says "does"? |
| The causation | Does the source report a correlation that the draft turned into a cause? |
| The date | Is the source current, and does the draft present an old figure as present? |
| The quotation | Are the words in quotation marks in the source, exactly? |
| The attribution | Is the statement made by the source, or is the source reporting someone else's view? |
| The context | Is the source describing a limitation, an exception, or a hypothetical? |
Failure modes where the source is real:
| Failure | Example |
|---|---|
| Not in the source | The page covers the topic and never states the claim |
| Number altered | The source says 37%; the draft says "nearly half" |
| Scope widened | A survey of one country presented as global |
| Certainty raised | "Associated with" becomes "causes" |
| Wrong source | The claim is true and comes from somewhere else |
| Outdated | A figure from years ago stated as current |
| Fabricated quotation | The person is real; the sentence is not theirs |
| Secondary source | The page cited repeats a claim it took from elsewhere, perhaps wrongly |
Where the cited page is itself quoting another source, follow the chain to the original and cite that.
Recording unsupported citations
A sample claim-to-source audit. The draft sentences and the findings are invented to show the form.
| # | Claim in draft | Cited source | Source exists? | Passage found? | Supports claim? | Flag | Required fix |
|---|---|---|---|---|---|---|---|
| 1 | "A 2023 study in the Journal of Home Energy found that 62% of boiler failures occur in January." | Journal article, with URL | No: journal has no such article; URL returns 404 | No | No | Fabricated source | Remove the claim, or find a real source and state what it reports |
| 2 | "The regulator requires annual servicing of all gas appliances." | Regulator's guidance page, URL loads | Yes | Yes | No: the page states a duty for landlords, not for all owners | Misrepresented source | Rewrite to the scope the source states |
| 3 | "'A boiler should never be run below one bar,' says engineer Dr. A. Reed." | None | No trace of the person | No | No | Fabricated quotation | Remove |
| 4 | "Modern condensing boilers are over 90% efficient." | Manufacturer page | Yes | Yes: states a figure for specific models | Partly: true for the models named | Scope or certainty changed | Attribute to the manufacturer and the models; or cite an independent standard |
| 5 | "Studies show regular servicing extends boiler life." | None | Not applicable | No | No | Unsourced | Find a source, or state it as the business's own experience, labeled as such |
| 6 | "Bleeding a radiator releases trapped air." | Manufacturer manual | Yes | Yes | Yes | Verified | Keep; link to the manual |
Flags to use:
| Flag | Meaning |
|---|---|
| Fabricated source | The document cannot be found |
| Fabricated quotation | The words cannot be found in any source |
| Misrepresented source | The source exists and does not say this |
| Scope or certainty changed | The source says something narrower or weaker |
| Secondary | The source is not the origin of the claim |
| Outdated | The source is superseded |
| Unsourced | A claim of evidence with nothing cited |
| Verified | Source exists, passage found, claim matches |
Editorial fixes, in order of preference:
- Replace with a real source that supports the claim, and adjust the sentence to that source’s exact scope.
- Narrow the claim to what the real source says.
- Present the statement as the organization’s own view or experience, if it is, without a citation.
- Remove the claim.
Never keep a claim by attaching a different real source that happens to be on the topic. A fix is finished only when someone has read the supporting passage.
Rules for the process:
- No draft is published until every row is verified or removed.
- The audit is done by a person, and the audit table is kept with the article’s records.
- The person who verifies is named.
- A draft with any fabricated source gets a full check of every other factual statement, cited or not, since the same process produced them.
- Sensitive subjects, such as health, law, finance, and safety, are verified by someone qualified in the field.
Prevention reduces the load: give the drafting tool the actual source documents and instruct it to use only those, require it to mark every claim with the passage it relied on, and forbid citations to anything not supplied. Those measures narrow the problem. They do not remove the need to check.
This screen targets one failure, false or unsupported citations. The complete review of a factual article before publication, of which it forms a part, is set out in the guide to which fact-checking steps should happen before a factual SEO article is published.
The test for every citation: a person opened the source, found the passage, and confirmed it says what the article says it says.
Add your comment to this answer