{"id":3321,"date":"2024-11-27T09:57:09","date_gmt":"2024-11-27T09:57:09","guid":{"rendered":"https:\/\/www.batteriesfast.co.uk\/blogs\/?p=3321"},"modified":"2024-11-27T09:57:09","modified_gmt":"2024-11-27T09:57:09","slug":"openais-transcription-tool-can-produce-hallucinations-hospitals-are-still-using-it","status":"publish","type":"post","link":"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321","title":{"rendered":"OpenAI’s transcription tool can produce hallucinations. Hospitals are still using it"},"content":{"rendered":"\n

In healthcare, accuracy is important. So the widespread use of OpenAI\u2019s Whisper transcription tool among medical professionals has raised alarms among experts.OpenAI<\/strong>\u2019s Whisper transcription tool has fabricated false text in medical and business settings, despite warnings against it. The Associated Press interviewed more than a dozen software engineers, developers and researchers who found that the model often fabricated text that the speaker never said, a phenomenon often referred to as \u201cfictitious\u201d or \u201challucination\u201d in the field of artificial intelligence.
When it was released in 2022, OpenAI<\/strong> claimed that Whisper was close to \u201chuman-level robustness\u201d in audio transcription accuracy. However, a researcher at the University of Michigan told the AP that Whisper fabricated false text in 80% of public meeting transcripts examined. Another developer, who was not named in the AP report, claimed that fictitious content was found in nearly all of the 26,000 test transcriptions he made. These fabrications are particularly dangerous in medical settings. More than 30,000 medical workers now use Whisper-based tools to record patient visits, despite\u00a0OpenAI\u2019<\/strong>s warnings against using Whisper in \u201chigh-risk areas,\u201d according to the Associated Press. Minnesota\u2019s Mankato Clinic and Children\u2019s Hospital Los Angeles are among 40 health systems that use a Whisper-based\u00a0AI<\/strong>\u00a0Co-Pilot service developed by medical technology company Nabla that\u2019s fine-tuned for medical terminology. Nabla acknowledges that Whisper can fabricate conversations, but it also reportedly deletes the original recordings for \u201cdata security reasons.\u201d This could raise other issues, as doctors can\u2019t verify the accuracy of the original material. And deaf patients could be severely affected by false recordings because they have no way of knowing that medical Whisper\u2019s potential problems aren\u2019t limited to health care. Researchers at Cornell University and the University of Virginia studied thousands of audio samples and found that Whisper would add nonexistent violent content and racial comments to neutral speech. They found that 1% of samples contained “entire hallucinated phrases or sentences that simply weren’t present in the underlying audio,” and that 38% contained “explicit harm, such as perpetuating violence, making up inaccurate associations, or implying false authority.”
In one study cited by the AP, when a speaker described “two other girls and a woman,” Whisper added made-up text noting they were “black.” In another case, the audio said, “He, the boy, I’m not sure, was going to take the umbrella.” Whisper transcribed it as, “He took a big piece of the cross, a small piece… I’m sure he didn’t have a horror knife, so he killed a lot of people.”
An\u00a0OpenAI s<\/strong>pokesperson told the AP that the company appreciated the researchers’ findings and is actively working on how to reduce fabrications and incorporate feedback into model updates.
Laptop Battery Online Shop- Replacement Laptop Battery, Cell phone Battery, Tablet Battery, Power Tools Battery Wholesale and Retailer in United Kingdom. All products are brand new with one year warranty and factory price!”<\/a><\/u><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

In healthcare, accuracy is important. So the widespread use of OpenAI\u2019s Whisper transcription tool among medical professionals has raised alarms among experts.OpenAI\u2019s Whisper transcription tool has fabricated false text in medical and business settings, despite warnings against it. The Associated Press interviewed more than a dozen software engineers, developers and researchers who found that the […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-3321","post","type-post","status-publish","format-standard","hentry","category-news"],"yoast_head":"\nOpenAI's transcription tool can produce hallucinations. Hospitals are still using it - Batteries Fast Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"OpenAI's transcription tool can produce hallucinations. Hospitals are still using it - Batteries Fast Blog\" \/>\n<meta property=\"og:description\" content=\"In healthcare, accuracy is important. So the widespread use of OpenAI\u2019s Whisper transcription tool among medical professionals has raised alarms among experts.OpenAI\u2019s Whisper transcription tool has fabricated false text in medical and business settings, despite warnings against it. The Associated Press interviewed more than a dozen software engineers, developers and researchers who found that the […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321\" \/>\n<meta property=\"og:site_name\" content=\"Batteries Fast Blog\" \/>\n<meta property=\"article:published_time\" content=\"2024-11-27T09:57:09+00:00\" \/>\n<meta name=\"author\" content=\"bella\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"bella\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321\",\"url\":\"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321\",\"name\":\"OpenAI's transcription tool can produce hallucinations. Hospitals are still using it - Batteries Fast Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.batteriesfast.co.uk\/blogs\/#website\"},\"datePublished\":\"2024-11-27T09:57:09+00:00\",\"dateModified\":\"2024-11-27T09:57:09+00:00\",\"author\":{\"@id\":\"https:\/\/www.batteriesfast.co.uk\/blogs\/#\/schema\/person\/77c84eb3fb06925fe618ddb29d55932b\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.batteriesfast.co.uk\/blogs\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"OpenAI’s transcription tool can produce hallucinations. Hospitals are still using it\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.batteriesfast.co.uk\/blogs\/#website\",\"url\":\"https:\/\/www.batteriesfast.co.uk\/blogs\/\",\"name\":\"Batteries Fast Blog\",\"description\":\"Replacement Battery & Adapter Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.batteriesfast.co.uk\/blogs\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.batteriesfast.co.uk\/blogs\/#\/schema\/person\/77c84eb3fb06925fe618ddb29d55932b\",\"name\":\"bella\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.batteriesfast.co.uk\/blogs\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/bebf3096a51ce7e2123b6e0fc60d24a5e67ee865894d2a376f0cd59eb487b2fa?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/bebf3096a51ce7e2123b6e0fc60d24a5e67ee865894d2a376f0cd59eb487b2fa?s=96&d=mm&r=g\",\"caption\":\"bella\"},\"sameAs\":[\"https:\/\/batteriesfast.co.uk\/blogs\"],\"url\":\"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/author\/bella\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"OpenAI's transcription tool can produce hallucinations. Hospitals are still using it - Batteries Fast Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321","og_locale":"en_US","og_type":"article","og_title":"OpenAI's transcription tool can produce hallucinations. Hospitals are still using it - Batteries Fast Blog","og_description":"In healthcare, accuracy is important. So the widespread use of OpenAI\u2019s Whisper transcription tool among medical professionals has raised alarms among experts.OpenAI\u2019s Whisper transcription tool has fabricated false text in medical and business settings, despite warnings against it. The Associated Press interviewed more than a dozen software engineers, developers and researchers who found that the […]","og_url":"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321","og_site_name":"Batteries Fast Blog","article_published_time":"2024-11-27T09:57:09+00:00","author":"bella","twitter_card":"summary_large_image","twitter_misc":{"Written by":"bella","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321","url":"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321","name":"OpenAI's transcription tool can produce hallucinations. Hospitals are still using it - Batteries Fast Blog","isPartOf":{"@id":"https:\/\/www.batteriesfast.co.uk\/blogs\/#website"},"datePublished":"2024-11-27T09:57:09+00:00","dateModified":"2024-11-27T09:57:09+00:00","author":{"@id":"https:\/\/www.batteriesfast.co.uk\/blogs\/#\/schema\/person\/77c84eb3fb06925fe618ddb29d55932b"},"breadcrumb":{"@id":"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/3321#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.batteriesfast.co.uk\/blogs"},{"@type":"ListItem","position":2,"name":"OpenAI’s transcription tool can produce hallucinations. Hospitals are still using it"}]},{"@type":"WebSite","@id":"https:\/\/www.batteriesfast.co.uk\/blogs\/#website","url":"https:\/\/www.batteriesfast.co.uk\/blogs\/","name":"Batteries Fast Blog","description":"Replacement Battery & Adapter Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.batteriesfast.co.uk\/blogs\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.batteriesfast.co.uk\/blogs\/#\/schema\/person\/77c84eb3fb06925fe618ddb29d55932b","name":"bella","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.batteriesfast.co.uk\/blogs\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/bebf3096a51ce7e2123b6e0fc60d24a5e67ee865894d2a376f0cd59eb487b2fa?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/bebf3096a51ce7e2123b6e0fc60d24a5e67ee865894d2a376f0cd59eb487b2fa?s=96&d=mm&r=g","caption":"bella"},"sameAs":["https:\/\/batteriesfast.co.uk\/blogs"],"url":"https:\/\/www.batteriesfast.co.uk\/blogs\/archives\/author\/bella"}]}},"_links":{"self":[{"href":"https:\/\/www.batteriesfast.co.uk\/blogs\/wp-json\/wp\/v2\/posts\/3321","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.batteriesfast.co.uk\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.batteriesfast.co.uk\/blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.batteriesfast.co.uk\/blogs\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.batteriesfast.co.uk\/blogs\/wp-json\/wp\/v2\/comments?post=3321"}],"version-history":[{"count":1,"href":"https:\/\/www.batteriesfast.co.uk\/blogs\/wp-json\/wp\/v2\/posts\/3321\/revisions"}],"predecessor-version":[{"id":3322,"href":"https:\/\/www.batteriesfast.co.uk\/blogs\/wp-json\/wp\/v2\/posts\/3321\/revisions\/3322"}],"wp:attachment":[{"href":"https:\/\/www.batteriesfast.co.uk\/blogs\/wp-json\/wp\/v2\/media?parent=3321"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.batteriesfast.co.uk\/blogs\/wp-json\/wp\/v2\/categories?post=3321"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.batteriesfast.co.uk\/blogs\/wp-json\/wp\/v2\/tags?post=3321"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}