Skip to content

ADR-0027: The Thai-SDS preference stands; its text layer is never trusted

Status: Accepted — amends ADR-0009 Date: 2026-09-02

Decisions

D-56 A Thai-published SDS remains the preferred source, and its extracted text is verified against the rendered page image

Verification is a named Curation step with its own acknowledged cost.

D-57 D-11's rationale is corrected: preferring a Thai SDS does not avoid Curation cost, it changes its shape

Translation review is replaced by transcription verification, not eliminated.

Context

R-40: the Thai spike documents' text layers are corrupt — Doc B extracts 0 correct against 87 broken, Doc C 12 against 643. This is Thai SARA AM decomposition failure, and it means extracted Thai text is wrong in ways that do not look wrong on a skim: a dropped vowel changes a word silently.

The tempting conclusion is to reverse D-11 and prefer English SDS with a curated translation, since English layers extract cleanly and translation is already a controlled, reviewed step (D-11, D-12). Corrupted Thai is by contrast an unreviewed corruption nobody may notice.

That reasoning is rejected on principle: a tooling defect must not decide a content-authority question. The Thai SDS is the document The Plant holds and that Thai law requires for that product. An English sheet from a different supplier is not a like-for-like substitute — R-39 demonstrates that two suppliers genuinely disagree, so swapping documents to obtain cleaner bytes trades a solvable extraction problem for an unsolvable provenance one.

Rejected options

  • Reverse D-11, prefer clean English plus curated translation — cleaner pipeline, rejected per the principle above.
  • Per-document, whichever extracts cleanly — pragmatic, rejected because Corpus provenance would vary for no principled reason.
  • Invest in correct Thai text normalisation — the best long-term answer and it would remove the manual cost, rejected for prototype scope (D-01) as real engineering that may not fully succeed. A good candidate for production work.

This ruling may not be re-decided

If a change contradicts this ADR: stop and raise it. Do not implement over it. Never admit extracted Thai text to the Corpus without verification against the page image.

Coverage

UpstreamLanded inEvidenceNote
R-40D-56, D-57the character counts are quoted in Context