A first-in-the-nation pilot program in Utah is allowing an AI chatbot to renew prescriptions for patients with chronic conditions, sparking both excitement and skepticism about the future of autonomous AI in healthcare.
Autonomous Care
This spring, Utah launched the “Autonomous Care” program, which uses an AI system to review and renew medication prescriptions for patients with conditions like diabetes and depression. The program, led by **Dr. Marc Harrison**, a renowned physician and CEO of Intermountain Healthcare, aims to streamline treatment and alleviate the administrative burden on doctors.
The AI chatbot in question is designed to analyze medical records, patient data, and prescription information to determine whether a renewal is safe and appropriate. If all checks out, the AI sends the renewal request to a human doctor for final approval. This setup is meant to reduce the number of low-level prescription renewals that can occupy doctors’ time and free them up for more complex care.
The Results
After six months of data collection, the results are in: 75% of renewals were approved by the AI system without any issues. However, 15% required manual review, and a whopping 10% were rejected by the AI due to potential safety concerns or other issues. While these numbers might look impressive, they also raise some red flags.
The Utah program is testing the boundaries of autonomous AI in patient care, and its successes and failures are crucial for regulators and the FDA, which are still grappling with how to oversee the use of AI in medicine.
What This Means
So, what does this mean for you and me? If this AI-powered prescription renewal system can become more widespread, it could revolutionize the way we manage chronic conditions by reducing the administrative burden on doctors and freeing up resources for more critical care. However, it also highlights the need for closer scrutiny of AI systems to ensure they’re not making mistakes that put patients in harm’s way.
