Forum Topic

Your NHS notes might be AI fiction

If you see a GP or hospital consultant in the NHS, ask them one question: “Are you using AI to write my notes?”I want to share something that has genuinely shocked me, and to warn others about how AI is being used in NHS appointments without patients realising the risks.GPs and hospital consultants are increasingly using AI software to compile patient notes. On the surface, that might sound efficient. But here’s what happened to me.I recently saw two different GPs at my local surgery. When I later checked my clinical notes, I found serious errors, not from bad intentions, but from AI “filling in the gaps.”Two examples of what happened to me:I said: I am suffering from recurrent negative dreams during a period of grieving my children’s father’s recent passing.AI wrote: “I feel like I am dreaming, hallucinating and the devil is chasing me.”I said: “My pompholyx eczema on my hands makes it difficult for me to carry out daily tasks.”AI wrote: “Her pompholyx eczema is impacting her ability to talk.”Neither of these were what I said. They change meaning entirely, and could easily lead to wrong referrals, wrong medication, or a completely inaccurate picture of my health.When I raised this with the surgery, their response was: one GP suffers from dyslexia, the other’s first language isn’t English. Honestly, you couldn’t make this up.At West Middlesex Hospital weeks later, I saw a consultant who started reading from my notes. I told him to ignore them and explained the GP/AI issue. His reply?“I use AI to write my notes too, and I don’t check them either.”Let that sink in. A consultant admitted, openly, that he doesn’t check what the AI writes before it becomes part of your permanent medical record.And here’s the kicker: once those notes are submitted, I’ve been told they cannot be edited or removed. The only thing that can be done is to add a later note, but the original, incorrect AI-generated text stays.So please, when you visit anyone in the NHS, GP, nurse, consultant, whoever, ask if they are using AI to write up their notes. If they say yes, ask them to read the notes back to you before they submit them.Don’t assume they’ve checked. Don’t assume the AI got it right. This isn’t about blaming individual clinicians, it’s about a system quietly introducing risks that patients aren’t being told about.

Louise Smith ● 97d5 Comments

Sections taken from NHS App full privacy noticeNHS England’s legal basis for processing your dataNHS England is a public body established by the NHS Act 2006 as amended by the Health and Social Care Act 2012.NHS England is legally required, by the Department of Health and Social Care, to set up and run the NHS App, as set out in the NHS App Directions 2023.NHS England complies with the UK General Data Protection Regulations (GDPR) and the UK Data Protection Act 2018 by ensuring that information is:used fairly, lawfully and transparentlyused for specified, explicit purposesused in a way that is adequate, relevant and limited to only what is necessaryaccurate and, where necessary, kept up to datekept for no longer than is necessaryhandled securely, including protection against unlawful or unauthorised processing, access, loss, destruction or damage.Your general personal data rightsUnder the Data Protections Act 2018 and UK GDPR you may have a right to:know how and why your data will be collected, processed and storedrequest a copy of your personal dataask to correct errors or omissions in your personal datato ask us to restrict our use of your personal data (for example, if you think it’s inaccurate and needs to be corrected)ask to have data deletedIf you have agreed to take part in user research, you may have the right to:withdraw your consentask us to delete your personal databe supplied with a copy of your data in a structured, commonly used and machine-readable format – what this means is that the data controller must ensure that your data is kept in a format which can be easily integrated into other types of IT systems, for example a spreadsheet file

Sarah Felstead ● 9d