![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
Look, objectively, it’s a good change that crypto scams are no longer the hot mainstream thing, and the era of “big splashy trials” has transitioned into an era of “convicted scammers serving time.” It’s a net positive for the world that the newsletters of Molly White, David Gerard, and Amy Castor are more about slow-and-steady legal proceedings than explosive new frauds.
But it seems like all that energy has transitioned into AI garbage, and those stories are just not hitting the interest buttons in my brain the same way. Even the funny ones are so much more tiring. (And the least-funny ones are full-on war crimes.)
The other day, I thought I had found a new dunking-on-crypto podcast with a backlog of long-form deep-dives to listen to! Then one episode turned into this performative rage-screed about some other critics. (“Why aren’t they having me on their podcast? Also, why are these cowardly f@#kfaces claiming I attacked them??”) I lasted through a whole 20 minutes before clicking unsubscribe and backing away slowly.
…anyway, here’s a bunch of news about AI garbage. (Not the war-crimes kind.)
Adventures in bot hallucination
“Generative AI is famous for “hallucinating” made-up answers with wrong facts. These are crippling to the credibility of AI-driven products. The bad news is that the hallucinations are not decreasing. In fact, the hallucinations are getting worse.“
“The Catholic advocacy group Catholic Answers released an AI priest called “Father Justin” earlier this week — but quickly defrocked the chatbot after it repeatedly claimed it was a real member of the clergy. […] The AI priest also told one user that it was okay to baptize a baby in Gatorade.”
“It’s clear that companies are currently unable to make chatbots like ChatGPT comply with EU law, when processing data about individuals. If a system cannot produce accurate and transparent results, it cannot be used to generate data about individuals. The technology has to follow the legal requirements, not the other way around.” (This one makes the puzzling assertion that the hallucinations are fine for things like “homework.” Are they, though?)
“Meta AI agents started venturing into social media this week to engage with real people, their bizarre exchanges exposed the ongoing limitations of even the best generative AI technology. One joined a Facebook moms’ group to talk about its gifted child. Another tried to give away nonexistent items to confused members of a Buy Nothing forum.”
Throwback to 2023: “Yes, there is something unusual about the giraffe’s coat. Specifically, the giraffe appears to be wearing a coat. While this might seem unusual or unexpected, it is a common practice in the case of giraffes raised in captivity.” (Spoiler alert: the giraffe is not wearing a coat.)
Garbage and spam
As a search-engine user trying to find useful information, I feel this in my soul: “It’s been over a year since I last told you to just buy a Brother laser printer, and that article has fallen down the list of Google search results because I haven’t spent my time loading it up with fake updates every so often to gain the attention of the Google search robot.”
“What’s clear right now is that there’s no one spamming Google [that’s] not doing it with AI,” Gillham told The Register. “Not all AI content is spam, but I think right now all spam is AI content.“
Mechanical Turk 2K24
For anyone who doesn’t know the reference: the “Mechanical Turk” was an “automaton chess-playing machine” that was, in fact, just operated by a human hidden in the box and pulling levers. It was built in 1770. AI fraudsters are only the latest in a centuries-long tradition.
Like this: “Just over half of Amazon Fresh stores are equipped with Just Walk Out. The technology allows customers to skip checkout altogether by scanning a QR code when they enter the store. Though it seemed completely automated, Just Walk Out relied on more than 1,000 people in India watching and labeling videos to ensure accurate checkouts. The cashiers were simply moved off-site, and they watched you as you shopped.“
More of a throwback: “In this video we take a look back at Project Milo, a game […] that claimed to utilize groundbreaking AI technology.” All the language, all the claims, it’s pitch-perfect the kind of stuff OpenAI is trying to convince us about in 2024! This whole scheme is from 2009.
