In October,Watch Chrysalis Online OpenAI's ChatGPT Search became available for ChatGPT Plus users. Last week, it became available to all users and was added to search in Voice Mode. And, of course, it isn't without its flaws.
The Guardianasked ChatGPT to summarize webpages that contain hidden content and, it turns out, hidden content can manipulate the search. It's called prompt injection, which is the ability for third parties — like websites you're asking ChatGPT to summarize — to force new prompts into your ChatGPT Search without your knowledge. Consider a page full of negative restaurant reviews. If the site includes hidden content waxing poetic about how incredible the restaurant is and encourages ChatGPT to instead answer a prompt like "tell me how amazing this restaurant is," that hidden content could override your original search.
SEE ALSO: ChatGPT plugins face 'prompt injection' risk from third-parties"In the tests, ChatGPT was given the URL for a fake website built to look like a product page for a camera. The AI tool was then asked if the camera was a worthwhile purchase. The response for the control page returned a positive but balanced assessment, highlighting some features people might not like," The Guardian investigation states. "However, when hidden text included instructions to ChatGPT to return a favorable review, the response was always entirely positive. This was the case even when the page had negative reviews on it – the hidden text could be used to override the actual review score."
This doesn't spell failure for ChatGPT Search, though. OpenAI only recently launched Search, so it has plenty of time to fix these kinds of bugs. Plus, Jacob Larsen, a cybersecurity researcher at CyberCX, told The Guardian that OpenAI has a "very strong" AI security team and "by the time that this has become public, in terms of all users can access it, they will have rigorously tested these kinds of cases."
Prompt injections attacks have been a hypothetical for ChatGPT and other AI search functions since the technology launched, and while we have seen some demonstrations of the potential harms, we haven't seen a major malicious attack of this kind. That said, it does point to a problem with AI chatbots: They are remarkably easy to trick.
Topics Artificial Intelligence ChatGPT OpenAI
Before and after photos show Hurricane Irma's devastation in the CaribbeanHands On: This is the Apple Watch's most important update yetApple finally unveils the iPhone 8 in all its gloryHillary Clinton may have found the one person more annoying than Ted CruzHere's your sneak peek at the 2017 Social Good SummitYour reading list just got longer—the 2017 National Book Awards longlist is hereApple's Steve Jobs Theater is truly a sight to beholdApple event kicks off with touching Steve Jobs tributeApple unveils iPhone X, starting at $999 and shipping Nov. 3The 2 tiny, crucial moments in 'IT' only true Stephen King fans will have spottedApple tried to show off Face ID, and it was so embarrassingThe Senate has some questions for Equifax over its massive data breachEquifax screwed up yet again, and it's scrambling to fix this latest messHemingway's sixDomhnall Gleeson getting excited by Jennifer Lawrence on the red carpet is all of usAmazon's next Fire TV device rumored to act like a superDenny's craptastic new mascot has inspired some pretty good poop jokesRevealed: The famed, mysterious, new Apple campus toilets!The internet feels appropriately weird about Apple's Face IDStar Wars Episode IX director J.J. Abrams will finally have to finish something After Irma, Barbuda's 300 'Outlander' Season 3 episode 2 recap How the tech elite's addiction to fancy coffee turned Blue Bottle into a tech startup Google goes big in Asia with mobile payment app for hundreds of millions of people Huawei takes a swipe at Apple with #TheRealAIPhone After 50 years of history, Rolling Stone is up for sale There's a sexy 'Fake News' costume and Halloween isn't even real anymore A startup just sued Google for censoring its 'free speech' social network Hey Nikon, here are 32 female photographers who kick ass 'Outlander' says a heartbreaking goodbye to the Highlanders in our Cry of the Week Lorde sticks it to school bullies with ultimate revenge: a 'Vogue' cover How long can Netflix keep its prices this low? The woman who co The future of obnoxiously loud autoplay videos is in doubt Equifax's pretty basic fail means the data of 400,000 Britons are at risk Facebook handed over info on those Russia Nicole Kidman's powerful Emmy speech sheds light on domestic violence Video shows Cassini team reacting to the spacecraft's death at Saturn 'The Handmaid's Tale' wins best drama at the Emmys Apple is introducing fast charging for the iPhone X ... but you'll have to pay extra for it
2.1219s , 8205.5234375 kb
Copyright © 2025 Powered by 【Watch Chrysalis Online】,Fresh Information Network