Rendered at 06:58:00 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
w10-1 11 hours ago [-]
> Healthcare is fragmented, and teams often need to move information between systems manually before a patient can get care
This actually is the main issue, but the cause is partly EPIC and partly the federated nature of health care, where each practice (even within a health system) can have different procedure for qualifying and submitting referrals.
But their use-case of AI fielding emails or listening and summarizing is a different issue: providers are being forced on pain of losing their jobs to cut the time they take with patients.
I can see how AI could relieve pressure in both cases, but that would fix nothing. If it's easier to complete referrals, referrals will become more complex, because that's how they manage their workload. If providers can be force into 20-minute visits, they'll be forced into 10-minute visits via triage.
When AI is deployed to improve quality and not efficiency, it can only make things worse.
When it's deployed for quality, it can actually help - injecting an additional test for a low-traffic diagnosis, walking generalists through complex diagnosis algorithms, etc.
SoftTalker 10 hours ago [-]
All I can see happening with AI is squeezing more patients through the same broken system, with even less human face time than they get today.
OpenAI is not here to fix healthcare, their interest is in making money off of it, and having a process that nobody understands or could manually execute is a means to that end.
cube00 10 hours ago [-]
> All I can see happening with AI is squeezing more patients through the same broken system
While introducing subtle mistakes doctors may miss on review.
Any problems and they'll blame a "rogue agent"
noir_lord 7 hours ago [-]
> OpenAI is not here to fix healthcare, their interest is in making money off of it, and having a process that nobody understands or could manually execute is a means to that end.
True
> their interest is in making money off of it, and having a process that nobody understands or could manually execute is a means to that end.
Even worse because that applies across every domain they are active in - hell their advertising video for Astra was basically "Half arse your job, the clanker has you".
Weaponised Self Inflicted Learned Helplessness as a Service isn't as catchy as AI though I guess.
caycep 9 hours ago [-]
The best thing for AI is for it to file a bunch of antitrust suits against Big Insurance, Big Pharma, and the Big Hospital/Healthcare systems
dumbmrblah 10 hours ago [-]
Speaking of the physician who extensively uses Opus and Sol (through the appropriate HIPAA channels) I do worry about overutilization of resources. Both tools regularly recommend expensive testing that may not be clinically indicated. This consumes a finite pool of resources (we keep getting more patients, but we're not getting more MRI machines)
The underlying issue is that these models tend to shotgun orders because, at their core, they want more data. More data isn't always better for the patient: it generates incidentalomas, follow-up imaging, and downstream workups etc that carry their own risks and costs.
I do like the agent triaging in basket messages, though. That's pretty clever. Where it breaks down is when things get super specialized. This works well for primary care, etc. Maybe not in your ultra/hyper specialized setting.
bonsai_spool 8 hours ago [-]
> This consumes a finite pool of resources (we keep getting more patients, but we're not getting more MRI machines)
I don’t see this argument’s strength. Either the MR is indicated in a particular workup and the physician didn’t realize this or the MR isn’t indicated and won’t be performed (the physician will review the AI recommendation, the radiologist will refuse the study, or the LLM used by the payor will reject the prior auth).
The argument’s natural extent is that we should not do any more testing than we currently do if we begin using LLMs, which has the problem I outline above.
APP/NP/PA’s often order more imaging (there are studies to this effect) but this is potentially due to their education not focusing on when tests should not be pursued as opposed to carrying out what they’re asked to do by physicians. This is the setting where Opus/Claude may drive higher utilization (subject to the gates I highlighted earlier).
merth 9 hours ago [-]
[dead]
caycep 9 hours ago [-]
it's like a terrified first year resident!
User1988_m 11 hours ago [-]
The problem isn't so much that the AI summarizes, but that the summary doesn't cite the source. The correct approach would be for the phrase in the draft to link to the original document; for example, mentioning that it's a note from a specific date, or that the image is from a particular source, so the doctor can quickly verify what really matters.
bonsai_spool 8 hours ago [-]
> The problem isn't so much that the AI summarizes, but that the summary doesn't cite the source
That is in fact exactly how the current products work - they link to each source document.
ElijahLynn 8 hours ago [-]
I'm grateful to see this progress in this area. So many human errors with the current system.
le-mark 11 hours ago [-]
> lower back pain
Lol in 20 years no Dr ever has taken my back pain seriously. This ai is already delivering better care!
SoftTalker 11 hours ago [-]
You're just as well, because if they did they would probably suggest surgery, which is absolutely the last thing you want.
If you're overweight, fix that. Then go see a DPT, get a rehab plan, and actually do it. There's no magic path to a strong back, you need to do the work.
ActionHank 11 hours ago [-]
Best part is that we are a hair away from some middleman reselling this to hospitals to offload liability and selling access to health insurance orgs.
OAI and ANT really are leading the charge to pull us into the worst timeline.
infamouscow 11 hours ago [-]
Probably not. I've worked in US health tech and done many experiments integrating OpenCV and LLMs into products. Clinicians, i.e., licensed medical providers, are extremely sensitive to your products having data and information bugs. If you have even one discrepancy to what their EHR says, you irrecoverably lose trust and your contract will not be renewed the following year. Very little AI has gotten it's way into the US healthcare space because HHS actually fines and puts people in prison. I've poached many engineers from companies HHS investigates, which for all intents and purposes is a corporate death penalty.
newyankee 6 hours ago [-]
How is a perfect system even statistically possible ? May be if 3-4 tests fail it makes more sense
ActionHank 11 hours ago [-]
I don't know that Clinicians have much of a say, this is all B2B selling the idea that we replace people doing these jobs.
warkdarrior 11 hours ago [-]
> HHS actually fines and puts people in prison. I've poached many engineers from companies HHS investigates, which for all intents and purposes is a corporate death penalty.
Hopefully the current admin reforms this kind of unwarranted behavior. New medical advances should only be tested in real-world, large-scale, nationwide deployments to avoid confounding variables. The time of lab-scientist dictatorship, controlling who gets access to the latest and greatest treatments, is over.
owenthejumper 9 hours ago [-]
Umm, I am not sure this is the flex they think it is. 99 % of tasks reviewed by a clinician were rated safe. That means 1 in a 100 patients will get hurt. That's nowhere near safe enough.
tekacs 8 hours ago [-]
... it seems entirely unclear that human clinicians have a correctness rate of >99%
sandworm101 11 hours ago [-]
>> A patient messages their clinician about lower back pain. A computer-use agent reviews the patient’s visit notes, physical therapy records, and prior imaging in the EHR. It drafts an MRI order, an encounter note, and a reply to the patient for the clinician to review. The agent then uses the same records to prepare a prior authorization request in the insurer’s portal for an authorization specialist to review.
Um... can I please have the clinician review my file? Having the AI review my file and present a summary to the clinician/doctor means no human has looked at my actual history, only summaries provided by the AI. This is exactly how things get missed. It is exactly why doctors look at charts no matter what they are told verbally about a patient. Relying on AI to do all the chart reading is asking for trouble.
bonsai_spool 7 hours ago [-]
> It drafts an MRI order,
This clearly wasn't written or reviewed by a physician. The path to getting an MRI for low back pain (ought to be) quite long, being preceded by many things that are more likely to resolve the pain (e.g., weight loss, a new mattress, more exercise). Imaging in low back pain is probably one of the lowest yield/lowest value things we can image. The patients who most need it are usually quite obvious (history of cancer in remission presenting with months of debilitating back pain) while those who most wish for imaging are least likely to benefit.
devilbunny 5 hours ago [-]
> weight loss, a new mattress, more exercise
On what planet do you live? Those are out-of-pocket expenses and/or unpleasant.
bonsai_spool 4 hours ago [-]
> On what planet do you live? Those are out-of-pocket expenses and/or unpleasant.
On a planet where the deductibles for families are often $30,000? Either the payor declines to pay for the MRI and you pay the inflated out-of-pocket price... or you do the things that work which are weight reduction and lifestyle modification.
devilbunny 4 hours ago [-]
> weight reduction
Spoken like someone who has never been fat. I don’t mean a few pounds overweight, I mean obese. I found my solution, but it isn’t for everyone. You think people like being fat? They don’t. They just don’t see a way out that isn’t pure hell, which is all they ever hear.
bonsai_spool 3 hours ago [-]
We have excellent weight-reduction options now. You can have a dietician, trainer and psychiatrist; you can have a surgery; you can take a pill; or you can have a once-weekly shot. These will be paid for by your insurance or by safety-net programs if you're in a big blue state.
I'm not approaching this from the perspective of morality at all - but as a physician, if a patient remains overweight, I see this as the same as a hypertensive patient not reducing her blood pressure: not a personal failing, but still a choice not to ameliorate a significant risk factor.
Not everyone is in a blue state, just like some people have very hard to control cholesterol, etc. But on the whole, we have never been able to treat overweight as well as we can now.
Edit: this isn't about me, but I've lost 30+ pounds through just the old school track-what-you-eat-and-eat-better strategy. It's awful but we no longer have to do that!
omgwtfbyobbq 11 hours ago [-]
This could be wishful thinking, but OAI may just be talking about creating the prior auth. If this is the case, it would be nice if they said "prior auth encounter note" instead.
From my limited understanding, the physician would and should still review your message, chart, agent drafted PA, etc...
9 hours ago [-]
0xbadcafebee 10 hours ago [-]
They mention in the video that a clinician and/or authorization specialist will review it before it's submitted. The AI is just preparing a draft. In the video, you can see a human editing the notes in the interface, after the AI has prepared it all.
It's the same thing as AI coding. The AI agent writes the code, but the coder has to review the code and edit it or propose changes if it's wrong.
The point of both of them is to reduce manual work, and allow for less-specialized work, which saves time and money and can reduce errors.
sumeno 9 hours ago [-]
How long until they are pressured to stop reviewing just like people are starting to do with code?
I bet not very long.
NoDodgeQuestion 11 hours ago [-]
> The agent then uses the same records to prepare a prior authorization request in the insurer’s portal for an authorization specialist to review.
Did you mean: The agent then uses the same records to prepare a prior authorization request in the insurer’s portal for an authorization agent to review.
Two agent fight, hope your agent stronger to get MRI
This actually is the main issue, but the cause is partly EPIC and partly the federated nature of health care, where each practice (even within a health system) can have different procedure for qualifying and submitting referrals.
But their use-case of AI fielding emails or listening and summarizing is a different issue: providers are being forced on pain of losing their jobs to cut the time they take with patients.
I can see how AI could relieve pressure in both cases, but that would fix nothing. If it's easier to complete referrals, referrals will become more complex, because that's how they manage their workload. If providers can be force into 20-minute visits, they'll be forced into 10-minute visits via triage.
When AI is deployed to improve quality and not efficiency, it can only make things worse.
When it's deployed for quality, it can actually help - injecting an additional test for a low-traffic diagnosis, walking generalists through complex diagnosis algorithms, etc.
OpenAI is not here to fix healthcare, their interest is in making money off of it, and having a process that nobody understands or could manually execute is a means to that end.
While introducing subtle mistakes doctors may miss on review.
Any problems and they'll blame a "rogue agent"
True
> their interest is in making money off of it, and having a process that nobody understands or could manually execute is a means to that end.
Even worse because that applies across every domain they are active in - hell their advertising video for Astra was basically "Half arse your job, the clanker has you".
Weaponised Self Inflicted Learned Helplessness as a Service isn't as catchy as AI though I guess.
The underlying issue is that these models tend to shotgun orders because, at their core, they want more data. More data isn't always better for the patient: it generates incidentalomas, follow-up imaging, and downstream workups etc that carry their own risks and costs.
I do like the agent triaging in basket messages, though. That's pretty clever. Where it breaks down is when things get super specialized. This works well for primary care, etc. Maybe not in your ultra/hyper specialized setting.
I don’t see this argument’s strength. Either the MR is indicated in a particular workup and the physician didn’t realize this or the MR isn’t indicated and won’t be performed (the physician will review the AI recommendation, the radiologist will refuse the study, or the LLM used by the payor will reject the prior auth).
The argument’s natural extent is that we should not do any more testing than we currently do if we begin using LLMs, which has the problem I outline above.
APP/NP/PA’s often order more imaging (there are studies to this effect) but this is potentially due to their education not focusing on when tests should not be pursued as opposed to carrying out what they’re asked to do by physicians. This is the setting where Opus/Claude may drive higher utilization (subject to the gates I highlighted earlier).
That is in fact exactly how the current products work - they link to each source document.
Lol in 20 years no Dr ever has taken my back pain seriously. This ai is already delivering better care!
If you're overweight, fix that. Then go see a DPT, get a rehab plan, and actually do it. There's no magic path to a strong back, you need to do the work.
OAI and ANT really are leading the charge to pull us into the worst timeline.
Hopefully the current admin reforms this kind of unwarranted behavior. New medical advances should only be tested in real-world, large-scale, nationwide deployments to avoid confounding variables. The time of lab-scientist dictatorship, controlling who gets access to the latest and greatest treatments, is over.
Um... can I please have the clinician review my file? Having the AI review my file and present a summary to the clinician/doctor means no human has looked at my actual history, only summaries provided by the AI. This is exactly how things get missed. It is exactly why doctors look at charts no matter what they are told verbally about a patient. Relying on AI to do all the chart reading is asking for trouble.
This clearly wasn't written or reviewed by a physician. The path to getting an MRI for low back pain (ought to be) quite long, being preceded by many things that are more likely to resolve the pain (e.g., weight loss, a new mattress, more exercise). Imaging in low back pain is probably one of the lowest yield/lowest value things we can image. The patients who most need it are usually quite obvious (history of cancer in remission presenting with months of debilitating back pain) while those who most wish for imaging are least likely to benefit.
On what planet do you live? Those are out-of-pocket expenses and/or unpleasant.
On a planet where the deductibles for families are often $30,000? Either the payor declines to pay for the MRI and you pay the inflated out-of-pocket price... or you do the things that work which are weight reduction and lifestyle modification.
Spoken like someone who has never been fat. I don’t mean a few pounds overweight, I mean obese. I found my solution, but it isn’t for everyone. You think people like being fat? They don’t. They just don’t see a way out that isn’t pure hell, which is all they ever hear.
I'm not approaching this from the perspective of morality at all - but as a physician, if a patient remains overweight, I see this as the same as a hypertensive patient not reducing her blood pressure: not a personal failing, but still a choice not to ameliorate a significant risk factor.
Not everyone is in a blue state, just like some people have very hard to control cholesterol, etc. But on the whole, we have never been able to treat overweight as well as we can now.
Edit: this isn't about me, but I've lost 30+ pounds through just the old school track-what-you-eat-and-eat-better strategy. It's awful but we no longer have to do that!
From my limited understanding, the physician would and should still review your message, chart, agent drafted PA, etc...
It's the same thing as AI coding. The AI agent writes the code, but the coder has to review the code and edit it or propose changes if it's wrong.
The point of both of them is to reduce manual work, and allow for less-specialized work, which saves time and money and can reduce errors.
I bet not very long.
Did you mean: The agent then uses the same records to prepare a prior authorization request in the insurer’s portal for an authorization agent to review.
Two agent fight, hope your agent stronger to get MRI