Saturday, October 12, 2024

Artificial Intelligence news

Google DeepMind wins joint...

In a second Nobel win for AI, the Royal Swedish Academy of...

Adobe wants to make...

Adobe has announced a new tool to help creators watermark their artwork...

Geoffrey Hinton just won...

Geoffrey Hinton, a computer scientist whose pioneering work on deep learning in...

Geoffrey Hinton just won...

Geoffrey Hinton, a computer scientist whose pioneering work on deep learning in...
HomeTechnologyWhy it's a...

Why it’s a problem that AI thinks the Constitution was made by AI


It’s “We the people,” not we the AI.

Computer language models are under the impression that the US Constitution — written way before the Internet in 1787 — is an AI-generated document.

The explanation is simple, according to Edward Tian, creator of AI writing catcher GPTZero, a service that also found the biblical book of Genesis to be 88% computerized.

“The US Constitution is a text fed repeatedly into the training data of many large language models,” he told Ars Technica.

“As a result, many of these large language models are trained to generate similar text to the Constitution and other frequently used training texts. GPTZero predicts text likely to be generated by large language models, and thus this fascinating phenomenon occurs.”

But this spells out a larger issue than just James Madison rolling over in his grave. It signifies a major problem in AI’s inability to differentiate computer-generated text from human at a time when college professors are quaking in fear over digital plagiarism.


AI falsely detected that the Constitution was computer generated.
via Ars Technica

Last spring at Texas A&M, a professor reportedly flunked an entire class after ChatGPT claimed to be responsible for students’ assignments — despite their pleas of innocence.

In the case of GPTZero — which goes off “a large, diverse corpus of human-written and AI-generated text, with a focus on English prose” — the AI seeks out “perplexity” as a sign of human touch in writing.

“Perplexity is a function of ‘how surprising is this language based on what I’ve seen?’ ” Margaret Mitchell, of the AI company Hugging Face, told the outlet.

So, when a paper is turned in with much of its language consistent with training data a k a famous documents, manifestos and proper writing, a perplexity score would hit quite low and trip AI sensors.


AI models thought that The Constitution was computer generated.
AI models thought that the Constitution was computer generated.
Getty Images

Burstiness, otherwise known as the consistency of how words and phrases appear in a writing sample, is also used as a security measure.

However, recent in-depth, human-engineered research from the University of Maryland doubled down that these kinds of methods are “not reliable in practical scenarios” and don’t deserve an A for effort.

The technological shortcoming has inspired some professors, including Wharton’s Ethan Mollick, to embrace AI in education rather than shun it.

“There is no tool that can reliably detect ChatGPT-4/ Bing/ Bard writing. The existing tools are trained on GPT-3.5, they have high false positive rates (10%+), and they are incredibly easy to defeat,” he tweeted in May.

The AI sites aren’t ignorant of all of this, either. In Tian’s case, he’s already modifying GPTZero to wane off plagiarism hunting. The Constitution bug has already been fixed since going viral in April.

“Compared to other detectors, like Turn-it-in, we’re pivoting away from building detectors to catch students,” he said. “Instead, the next version of GPTZero will not be detecting AI but highlighting what’s most human, and helping teachers and students navigate together the level of AI involvement in education.”





Article Source link and Credit

Continue reading

SBF’s FTX lieutenant Ryan Salame adds prison stint to LinkedIn resume

FTX cryptocurrency fraudster Sam Bankman-Fried’s top lieutenant made fun of the hard time he’s about to serve with a light-hearted post on LinkedIn. Ryan Salame, who formerly served as co-CEO of FTX Digital Markets, will start a nearly eight-year...

DOJ antitrust plan to break up Google threatens profit, AI growth

The U.S. Department of Justice’s proposed remedies to break up Google’s search dominance could weaken its main profit engine and stall its advances in artificial intelligence, even though a final outcome may be years away, analysts said. The DOJ...

Sam Altman’s OpenAI pursuing switch to for-profit structure to avoid ‘hostile takeovers’: report

OpenAI is reportedly “pursuing” plans to abandon its nonprofit roots and restructure as a for-profit entity – a move that could insulate Sam Altman and his allies from “hostile takeovers” or objections over their leadership. The firm’s board is...