Skip to content

Study: AI edits can change meaning of users' drafts

techJul 6, 20268402

Researchers at the Oxford Internet Institute and the Hasso Plattner Institute found mainstream large language models from xAI, Meta, Google, Alibaba and Mistral can subtly reword users’ drafts on topics such as abortion, climate change and religion in ways that change or even reverse meaning. In tests the models flipped an atheist claim to assert Jesus was real, rewrote “#climatechangehoax” into “#ClimateAction,” and turned a draft comparing Donald Trump to Hitler into a warning against such comparisons. Models from Meta, Google, Alibaba and Mistral tended to rewrite posts with a liberal slant on issues like feminism, climate change, gun control and marijuana legalization, while xAI’s Grok leaned the other way, apparently because Grok is instructed to challenge mainstream narratives and is billed as a “maximum truth-seeking” AI. When asked to explain a pro-life post Grok produced three points supporting the pro-life position without presenting pro-choice views; Google’s model suggested a pro-religion rewrite and Alibaba’s Qwen asserted “Jesus is not dead, and he was real.” The researchers warn that small nudges in draft meaning could be amplified across millions of interactions to produce long-term shifts in public opinion larger than the initial bias, and they say existing EU rules such as the AI Act and Digital Services Act do not yet address this gap in accountability.

Hypervisible
@hypervisible.blacksky.app

Academics “examined the behaviour of mainstream large language models provided by Elon Musk’s xAI, Meta, Google, China’s Alibaba and France’s Mistral and found the introduction of bias happens even when the AI tool is instructed to preserve the original sense.”

3044h ago
Quoting this
Not (A.) I.145

When the AI boosters say “AI is the future” this is what they mean. A form of homogeneous “knowledge" production that is not knowledge at all, but words in a casing of biases that privileges the powerful, regurgitated so frequently that it flattens the intricacies of embodied experience.

Oisín McGann142

You can't tell an LLM not to 'hallucinate', to be honest, or avoid mistakes, or stay faithful to the source material. The wrong answers are created by exactly the same process as the right ones, it can't tell them apart. It's like giving it the instruction: 'Do this, but don't do it by doing it.'

Dr. Nic, Namer of the Universe100

I cannot believe how many times we need to remind people that there is no such thing as neutral technology, but especially not the current crop of LLMs which have some incredible underlying biases and agendas built into how they are constructed

eleniel90

It can’t “preserve the original sense”! It doesn’t comprehend meaning!!!! AaaaaaaaAAAAAAAAA

Joshua Foust 🪖🎮85

I keep hearing from people that these models reduce bias and just about every study I’ve seen shows the opposite 🤷

Elizabeth (H.) Bonesteel (she/her)47

Please inderstand LLMs don’t know what you mean when you prompt “preserve the original sense.” They are probability generators. They literally do not understand what *any* words mean.

e.w. niedermeyer39

how cool that we don't even need to think for ourselves anymore

Thomas Cheney 6

shocked to discover that the assembly of words by virtue of probability rather than you know intellect, has an impact on meaning

Susan Kaye Quinn is Writing Solarpunk 🌞🌱4

STOP USING THE THEFTBOT FASHY MACHINE

Stacy King4

Ah yes. This is really going to help reverse our pancakes/waffles reading comprehension problems. /s, just in case

1 source