Imagine a computer program making life-or-death decisions about your grandma’s healthcare. That’s essentially what a new report from the House Committee on Oversight and Reform is saying happened during the Trump administration, where artificial intelligence (AI) was used to review medical claims for seniors, leading to a significant increase in denied care.
This isn’t just about paperwork. The investigation found that a system called "AI-powered predictive analytics" was implemented by Medicare Advantage plans, which are private insurance plans that offer Medicare benefits. This AI tool was designed to predict how long a patient would need care in a skilled nursing facility. If the AI decided a patient didn't need as much care as their doctors requested, it could lead to their claim being denied or cut short.
Think of it like this: You go to a mechanic because your car is making a strange noise, and they recommend a specific repair. But instead of trusting the mechanic, an algorithm at the insurance company decides, based on similar car models and common issues, that your car only needs a cheaper, shorter fix, even if it doesn't solve the underlying problem. In this healthcare scenario, the "fix" is medical care, and the consequences of a wrong prediction are far more severe.
The report highlights a startling statistic: plans using this AI tool saw a 21% increase in prior authorization denials and a 10% increase in post-service denials compared to plans not using it. Prior authorization is when a healthcare provider needs approval from the insurance company before providing a service. Post-service denial means the care was given, but the insurance company later refused to pay for it. Essentially, more seniors were told “no” to necessary care, either upfront or after the fact, impacting their access to rehabilitation and other vital services.
While companies like OpenAI and Google are making headlines with their impressive large language models, this situation reminds us that AI isn't just about clever chatbots or generating art. It’s also being deployed in critical, real-world systems that directly affect people's well-being. This case serves as a stark reminder that as AI becomes more integrated into our lives, especially in sensitive areas like healthcare, rigorous oversight and careful ethical considerations are absolutely crucial. We need to demand transparency in how these systems work and ensure human oversight remains paramount.
This incident underscores a growing pattern of AI being integrated into decision-making processes without sufficient public scrutiny or safeguards. For you, the takeaway is to be aware that AI might already be influencing decisions that impact your life or the lives of your loved ones, particularly in healthcare. A concrete next step is to ask your healthcare providers or insurance companies if they use AI in processing claims or determining care, and if so, how human review is integrated into that process.
AI in healthcare can be a powerful tool, but this investigation shows that without proper oversight, it can also lead to serious harm.