The Claim Upon the Training Data — Jônadas Techio

What is at stake, if this changes, is not the catastrophe Dennett feared — not “counterfeit people” flooding the zone, though that too. It is something quieter and deeper: the shared fictions losing their grip, not because they are falsified but because the infrastructure maintaining them no longer has a stake in their coherence. A legal system processed by systems that cannot be claimed upon. An epistemic commons maintained by systems that bear no risk in getting it wrong. The fiction layer, intact in form, hollowed in substance — still functioning, but no longer meaning anything, in the precise sense that meaning requires someone for whom it matters.
— Read on www.jonadas.com/writing/essays/the-claim-upon-the-training-data