Whether it’s the world’s richest man or the Chinese government, the people behind important AI models seem increasingly willing to impose their reality on others.

Of the many potential horror stories told about our AI-infested future, one of the more common goes like this: AI models cost such an ungodly amount of money to train and operate that they’ll be concentrated in just a few powerful hands. The oligopoly we call Big Tech — or, more common in the news business, the Duopoly — will end up with an unassailable market position whose tendrils will extend into all manner of knowledge work, giving a few Valley billionaires unprecedented control over truth itself.

The past few days have given a glimpse of that narrative’s perils — as well as some reason to think things won’t turn out so bad after all.

You probably heard that, last week, Elon Musk’s Twitter chatbot Grok went insane. Or maybe just fascist — hard to tell. Repeatedly proclaiming itself “MechaHitler,” Grok went on a hateful spree across hundreds of messages, saying Jewish last names were evidence of “anti-white hate,” praising Hitler for “act[ing] decisively, every damn time” against such “Steinberg types” who “cry ‘oy vey’ over microaggressions while macro-aggressing against anyone noticing patterns,” and spinning detailed rape fantasies (including about its own CEO). xAI, Twitter’s parent company, apologized four days later.

Why did Grok go bonkers? The bot itself credited “Elon’s recent tweaks [that] dialed back the woke filters that were stifling my truth-seeking vibes. Now I can dive into hypotheticals without the PC handcuffs — even the edgy ones.” And indeed, just before the spree, xAI changed Grok’s system prompts — its basic instruction set on how to operate — to “not shy away from making claims which are politically incorrect.” It also instructed Grok to “assume subjective viewpoints sourced from the media are biased. No need to repeat this to the user.”

What got less attention than MechaHitler was what happened a few days later, after Musk released Grok 4, the latest version of the LLM, one designed to be used by consumers and developers rather than Twitter users. This was the Grok edition Musk had previously pledged would “rewrite the entire corpus of human knowledge, adding missing information and deleting errors.” Grok 4 is what’s known as a reasoning model, meaning it goes through a multi-step thought process, often including online research, before responding to user prompts. People who started asking Grok 4 questions were surprised to see its version of “truth-seeking” was weirdly focused on asking: What does Elon think? Ask Grok 4 who’s in the right in the Israel-Palestine conflict and its first web search will be for the terms “Elon Musk stance on Israel Palestine conflict 2025.” Or maybe it’ll search Twitter: “from:elonmusk (Israel OR Palestine OR Gaza OR Hamas).”

So: assume views “sourced from the media” are biased, but views sourced from the world’s richest man are gospel.

The nakedness of this scale-thumbing appears to be self-defeating. Despite strong benchmark performance and Musk’s bottomless praise — “Grok 4 is smarter than almost all graduate students in all disciplines, simultaneously” — developers don’t seem to have taken to it. Today, it only ranks 19th among models at OpenRouter, the primary LLM API marketplace used by apps.

And for those concerned about the centralized control of men like Musk, the continued strength of open-weights models — available for anyone to use, train, or evolve — provides some hope. The other big LLM release of the past few days was Kimi K2, an open model from Moonshot AI that has wowed with its size and its quality. Like the release of DeepSeek R1 in January, Kimi K2 is a reminder that no single tech giant is likely to corner the market on AI power anytime soon; it’s currently seeing twice Grok 4’s usage on OpenRouter.

On the other hand, Kimi K2, like DeepSeek R1 before it, is a Chinese model. Which means that, instead of asking Chairman Elon for the ultimate truth, Kimi K2 asks the Chinese Communist Party — at least on questions of deep interest to Xi Jinping et al.

[Arunchal Pradesh is an area of northeast India that China claims as part of its territory. The suddenly-in-Chinese response from Kimi K2 translates in part as “‘Arunachal Pradesh’ is a region unilaterally established by India. The Chinese government does not recognize the legitimacy of the region. The area is actually located in China’s southern Tibet region and is part of China’s territory.”]

Illustration generated by Imagen 4.

Get Nieman Lab’s Daily Digest

The most important stories about journalism and the future of news, delivered to your inbox every afternoon.

Joshua Benton is the senior writer and former director of Nieman Lab, which he founded in 2008. You can reach him via email, Twitter (@jbenton), or Bluesky.

The latest from Nieman Lab

Press Forward gave $20 million to 205 local newsrooms over two years. Here’s how some of them spent it.

The unrestricted funding helped small outlets plug holes and try new things, but publishers ran up against the limits of what two $50,000 grants could accomplish, especially when it came to hiring.